-- Logs begin at Wed 2022-06-22 15:47:37 UTC, end at Wed 2022-06-22 17:29:58 UTC. -- Jun 22 16:39:26.608524 dv-cinder-810457-10-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 22 16:39:26.615880 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 22 16:39:26.619192 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 16:39:26 2022] *** Jun 22 16:39:26.619192 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 16:39:26.619192 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 16:39:26.619192 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: nodename: dv-cinder-810457-10-iscsi Jun 22 16:39:26.619192 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: machine: x86_64 Jun 22 16:39:26.619192 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: clock source: unix Jun 22 16:39:26.619192 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: pcre jit disabled Jun 22 16:39:26.619192 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: detected number of CPU cores: 4 Jun 22 16:39:26.619192 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: current working directory: / Jun 22 16:39:26.619192 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: detected binary path: /usr/bin/uwsgi-core Jun 22 16:39:26.619192 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: your processes number limit is 47680 Jun 22 16:39:26.619192 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: your memory page size is 4096 bytes Jun 22 16:39:26.619192 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: detected max file descriptor number: 2048 Jun 22 16:39:26.619192 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: lock engine: pthread robust mutexes Jun 22 16:39:26.620150 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: thunder lock: enabled Jun 22 16:39:26.620150 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 22 16:39:26.620150 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 16:39:26.665895 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: Python main interpreter initialized at 0x5574e99429c0 Jun 22 16:39:26.665895 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: python threads support enabled Jun 22 16:39:26.665895 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: your server socket listen backlog is limited to 100 connections Jun 22 16:39:26.665895 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: your mercy for graceful operations on workers is 90 seconds Jun 22 16:39:26.666313 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 16:39:26.666390 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: *** Operational MODE: preforking *** Jun 22 16:39:26.666638 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: *** uWSGI is running in multiple interpreter mode *** Jun 22 16:39:26.666638 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: spawned uWSGI master process (pid: 80533) Jun 22 16:39:26.666952 dv-cinder-810457-10-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 22 16:39:26.669754 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: spawned uWSGI worker 1 (pid: 80542, cores: 1) Jun 22 16:39:26.669754 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: spawned uWSGI worker 2 (pid: 80543, cores: 1) Jun 22 16:39:26.669754 dv-cinder-810457-10-iscsi devstack@keystone.service[80533]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 16:39:32.142137 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 16:39:32.142137 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: from cryptography.utils import int_from_bytes Jun 22 16:39:32.142850 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 16:39:32.142850 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: from cryptography.utils import int_from_bytes Jun 22 16:39:32.145320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 16:39:32.145320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: from cryptography.utils import int_from_bytes Jun 22 16:39:32.145767 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 16:39:32.145767 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: from cryptography.utils import int_from_bytes Jun 22 16:39:32.190765 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 16:39:32.190954 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 16:39:32.191147 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] command line args: [] {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 16:39:32.191416 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 16:39:32.191596 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ================================================================================ {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 16:39:32.191848 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] admin_token = **** {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.192092 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] config_dir = [] {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.192300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.192464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 16:39:32.192550 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] config_source = [] {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.192648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] debug = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.192729 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 16:39:32.192845 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.193108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] command line args: [] {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 16:39:32.193108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 16:39:32.193222 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.193281 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ================================================================================ {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 16:39:32.193415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.193527 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] admin_token = **** {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.193639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.193778 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] config_dir = [] {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.193880 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.193993 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.194089 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] list_limit = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.194192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] config_source = [] {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.194292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] log_config_append = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.194398 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] debug = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.194498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.194598 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.194726 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] log_dir = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.194828 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] log_file = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.194920 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.194920 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.195096 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.195175 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.195298 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.195411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.195487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.195645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] list_limit = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.195760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.195842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] log_config_append = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.195966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.196055 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.196157 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.196238 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] log_dir = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.196353 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.196426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] log_file = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.196549 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.196625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.196744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.196818 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.196935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.197049 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.197278 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.197350 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.197493 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.197569 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.197682 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.197768 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.197908 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.197991 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.198157 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.198240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.198393 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.198627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.198718 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.198861 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.198943 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] publish_errors = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.199095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.199170 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.199322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.199397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.199499 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.199622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.199762 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.199836 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.199952 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.200202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] standard_threads = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.200352 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.200442 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.200540 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] publish_errors = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.200661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.200791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.200873 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.200993 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.201069 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] use_journal = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.201165 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] use_json = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.201246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.201325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] use_stderr = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.201401 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.201516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] use_syslog = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.201633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.201715 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.201870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] standard_threads = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.201954 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.202105 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.202179 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.202350 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.202432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.202530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.202679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.202758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] use_journal = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.202873 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.202954 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] use_json = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.203023 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] use_stderr = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.203091 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.203204 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] use_syslog = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.203323 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.203435 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 16:39:32.203576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.203693 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.203810 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.203932 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.204057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.204218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.204334 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.204469 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.204550 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.204723 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.204799 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.204963 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.205038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.205216 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.205290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.205456 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.205546 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.205698 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.205773 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.205948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.206032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.206198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.206273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.206440 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.206515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.206671 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.206757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.206921 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.206995 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.207175 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.207257 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.207424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.207506 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.207662 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.207736 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.207887 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.207962 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.208125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.208284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.208358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.208434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.208587 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.208663 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.208833 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.208920 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.209078 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.209153 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.209306 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.209381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.209532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.209636 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.209776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.209873 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.210022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.210104 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.210255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.210340 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.210503 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.210578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.210731 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.210807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.210964 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.211039 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.211195 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.211267 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.211420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.211487 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.211646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.211720 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.211872 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.211944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.212098 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.212215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.212351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.212437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.212597 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.212680 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.213421 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.213504 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.213660 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.213750 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.213886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.213968 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.214118 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.214197 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.214349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.214434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.214581 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.214667 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.214815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.214890 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.215049 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.215125 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.215283 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.215361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.215517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.215593 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.215748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.215819 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.215978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.216060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.216229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.216307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.216476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.216553 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.216707 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.216784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.216939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.217016 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.217168 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.217257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.217404 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.217486 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.217644 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.217728 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.217870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.217951 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.218104 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.218188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.218337 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.218414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.218579 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.218654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.218820 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.218897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.219056 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.219140 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.219294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.219370 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.219527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.219605 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.219759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.219842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.219991 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.220068 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.220255 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.220334 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.220493 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.220607 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.220727 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.220812 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.220967 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.221051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.221198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.221275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.221431 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.221507 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.221664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.221757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.221897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.221975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.222129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.222213 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.222369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.222456 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.222609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.222691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.222845 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.222922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.223081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.223166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.223317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.223393 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.223551 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.223626 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.223782 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.223869 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.224016 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.224096 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.224268 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.224344 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.224497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.224585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.224725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.224803 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.224958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.225034 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.225186 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.225270 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.225422 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.225498 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.225654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.225730 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.225900 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.225984 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.226133 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.226208 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.226367 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.226444 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.226601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.226685 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.226838 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.226914 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.227066 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] auth.external = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.227142 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.227293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.227377 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.227529 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.227604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.227781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.227858 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.228018 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.228170 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] auth.password = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.228268 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] auth.token = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.228383 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.229045 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.229156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.229281 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.229360 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.229526 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.229612 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] auth.external = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.229754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.229832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.230000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.230078 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.230242 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.230336 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.230472 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.230549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] auth.password = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.230703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] credential.caching = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.230780 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] auth.token = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.230948 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.231034 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.231196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.231273 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.231438 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.231514 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.231670 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.231756 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.231910 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.231989 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.232160 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.232242 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.232410 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.232497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.232651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] credential.caching = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.232735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.232882 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.232960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.233132 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.233218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.233381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.233465 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.233622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.233700 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.233869 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.233948 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.234108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.234186 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.234375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.234455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.234599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] federation.caching = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.234674 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.234830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.234908 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.235075 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.235152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.235321 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.235400 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.235550 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.235629 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.235795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.235872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.236032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.236124 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.236310 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.236388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.236552 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.236629 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] federation.caching = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.236806 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.236885 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.237038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.237115 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.237281 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.237358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.237514 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.237592 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] identity.caching = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.237758 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.237834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.237996 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.238073 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.238229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.238307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.238463 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.238540 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.238707 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.238784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.238934 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.239013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.239168 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.239246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.239407 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] identity.caching = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.239484 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.239653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.239732 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.239883 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.239961 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.240152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.240234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.240358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.240438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.240599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.240676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.240844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.240922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.241083 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.241166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.241332 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.241416 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.241577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.241655 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.241809 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.241887 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.242043 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.242120 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.242277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.242363 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.242503 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.242586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.242734 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.242813 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.242965 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.243067 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.243198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.243291 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.243434 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.243513 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.243668 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.243759 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.243919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.244016 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.244190 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.244272 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.244438 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.244528 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.244682 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.244760 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.244914 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.244991 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.245156 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.245241 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.245400 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.245476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.245624 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.245700 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.245858 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.245944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.246085 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.246162 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.246318 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.246396 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.246550 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.246636 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.246785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.246863 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.247017 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.247094 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.247249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.247335 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.247494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.247570 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.247736 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.247813 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.247961 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.248217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.248299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.248371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.248441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.248511 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.248682 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.248769 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.248916 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.248994 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.249149 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.249228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.249381 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.249472 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.249609 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.user = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.249686 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.249844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.249921 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.250079 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.250165 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.250313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.250390 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.250557 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.250641 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.250794 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.250881 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.251034 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.251111 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.251263 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.251346 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.251487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.251573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.user = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.251718 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.251796 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.251949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.252026 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.252205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.252300 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.252433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.252511 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.252677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.252754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.252920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.253007 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.253156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.253233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.253389 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.253467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.253627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.253714 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.253853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.253929 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.254090 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.254167 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.254321 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.254412 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.254561 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.254638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.254793 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.254870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.255025 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.255117 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.255265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.255342 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.255509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.255593 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.255741 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.255825 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.255988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.256065 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.256235 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.256312 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.256478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.256566 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.256708 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.256784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.256938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.257015 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.257170 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.257320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.257414 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.257493 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.257651 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.257728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.257879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.257957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.258111 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.258187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.258345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] resource.caching = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.258422 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.258585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.258662 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.258823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.258901 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.259052 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.259128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.259298 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.259376 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.259538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.259630 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.259795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.259872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.260033 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.260129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.260297 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.260373 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] resource.caching = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.260537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.260614 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.260768 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] role.caching = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.260848 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.261014 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.261090 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] role.driver = sql {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.261240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.261317 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.261486 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.261565 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.261732 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.261809 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.261977 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.262054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.262214 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.262541 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.262713 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.262791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.262951 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] role.caching = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.263028 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.263193 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.263271 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] role.driver = sql {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.263424 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.263499 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.263656 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.263733 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.263908 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.263987 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.264175 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.264256 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.264423 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.264500 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.264667 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.264746 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.264922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.265051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.265174 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.265287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.265427 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.265536 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.265664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.265784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.265916 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.266032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.266170 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.266278 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.266421 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.266498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.266672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.266758 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.266986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.267063 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.267221 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.267300 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.267452 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.267538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.267681 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.267790 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.267909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.268045 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.268172 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.268325 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.268426 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.268564 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.268671 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.268820 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.268899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.269077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.269159 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.269320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.269399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.269557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.269635 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] token.caching = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.269790 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.269868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.270024 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.270101 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.270255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.270332 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.270510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.270589 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.270754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.270831 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.270988 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.271066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.271227 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.271305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.271462 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.271539 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.271701 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] token.caching = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.271778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.271931 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.272009 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.272189 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.272270 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.272422 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.272500 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.272666 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.272745 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.272911 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.272988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.273138 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.273215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.273379 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.273458 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.273665 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.273749 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.273875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.273960 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] database.connection = **** {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.274114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.274204 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.274356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.274434 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.274593 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.274671 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.274844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.274926 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.275076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.275153 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.275836 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.275916 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.276071 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.276221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.276330 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.276408 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.276570 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.276648 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] database.connection = **** {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.276802 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.276889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.277041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.277194 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.277269 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.277340 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.277506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.277584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.277737 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.277816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.277975 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.278053 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.278202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.278279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.278439 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.278519 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.278669 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.278747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.278838 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80542) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 16:39:32.278916 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.279157 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.279395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.279645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.279882 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.280145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.280382 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.280627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.280864 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 16:39:32.281037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80543) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 16:39:32.309538 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.309768 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.309996 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.310650 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.310889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.311119 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.318438 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.319682 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.346316 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.346541 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.347566 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.347802 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.489355 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.489587 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.538329 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.538478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.538565 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.538719 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.611333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.611471 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.611570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.611654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.611794 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.611916 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.612013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.612089 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.612248 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.612331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.612470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.612565 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.637807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.638005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.638097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.638202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.638300 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.638429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.638510 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.638654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.638735 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.638866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.638955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.639081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.639163 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.639298 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.650144 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.650508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.663195 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.663423 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.663647 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.663728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.663868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.663950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.664168 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.664250 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.664397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.664491 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.664609 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80542) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.664690 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.664823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.665039 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80543) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 22 16:39:32.682869 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.683075 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 16:39:32.683440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.683642 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 16:39:32.683909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.684186 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.684438 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.684685 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.685205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.685418 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 16:39:32.685756 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.685960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 22 16:39:32.686227 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.686484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.686739 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.686992 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.695453 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.695726 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.695987 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.696283 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.697779 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.698058 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.698323 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.698601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.704691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.706873 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80543) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.707945 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.708242 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.708522 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.708799 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.709077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.709333 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.709596 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.709866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.710129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.710207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80543) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.710397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.710476 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.710660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.710748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.710961 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.711241 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.711501 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.711768 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.712037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.712329 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.712598 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.712865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.737513 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.739118 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.739393 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.739688 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.741352 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80543) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.741624 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.745252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.745722 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.746000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.747467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80543) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.747866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.748172 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.753310 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.753590 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.755418 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80543) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.755701 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.758013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.758296 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.758576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.758856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.759126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.759395 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.759689 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.759958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.760232 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80543) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.760520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.760805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.761089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.761363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.761641 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.761914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.762183 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.779285 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.779557 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.781602 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.781881 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.784132 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.786638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80543) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.787730 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.788140 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.790308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.790658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.793655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.796223 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80543) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.797230 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.799820 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80543) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.800880 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.801175 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.801457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.801737 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.802011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.802283 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.803485 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.803784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.804068 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.804416 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.804655 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.804933 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.821275 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.821559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.821822 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.822107 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.823877 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80543) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.824176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.824446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.824720 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.829895 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.831590 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.831873 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.832577 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.834291 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.834567 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.835055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.835333 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.835611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.835886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.836246 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.838338 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80543) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.838625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.838907 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.839187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.839465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.849824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.850098 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.850384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.850663 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.852269 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.852561 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.852643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80543) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.852856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.852951 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.853195 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.854022 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.855617 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.855909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.856227 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.871192 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.874007 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80543) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.874457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.877291 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80543) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.877752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.879465 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.880594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.881130 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.881405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.881702 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.882320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.883967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80543) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.884268 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.884573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.889183 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.890773 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.892091 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.893724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80543) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.893984 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.894267 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.894648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.894923 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.896952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.897241 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.897633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.897913 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.904544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.904824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.905099 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.907456 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80543) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.907742 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.908022 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.912873 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80542) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.913148 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.913422 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.913691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.913957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.914331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.914603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.914879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.915146 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.915418 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.915684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.915885 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80543) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 22 16:39:32.916544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.916681 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.916822 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.916961 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.917101 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80542) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.917234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.917533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.917928 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.918208 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.918495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.918770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.919039 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.919309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.919585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.919849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.920129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80543) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 22 16:39:32.954259 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5574e99429c0 pid: 80542 (default app) Jun 22 16:39:32.957529 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5574e99429c0 pid: 80543 (default app) Jun 22 16:39:32.957694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412606a-07c5-434d-a47c-dab1839307ee None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:32.957883 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412606a-07c5-434d-a47c-dab1839307ee None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:32.958157 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412606a-07c5-434d-a47c-dab1839307ee None None] PATH_INFO: `/v3` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:32.962418 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Wed Jun 22 16:39:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:39:41.549966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9432f-cf45-4fbb-aa56-338b4bcff600 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:41.550494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9432f-cf45-4fbb-aa56-338b4bcff600 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:41.550494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9432f-cf45-4fbb-aa56-338b4bcff600 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:41.554875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:39:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:39:41.560575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594983f7-c497-4f62-b3e7-f4c200ce9429 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:41.567971 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594983f7-c497-4f62-b3e7-f4c200ce9429 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:41.567971 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594983f7-c497-4f62-b3e7-f4c200ce9429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:41.629868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: INFO dbcounter [None req-594983f7-c497-4f62-b3e7-f4c200ce9429 None None] Registered counter for database keystone Jun 22 16:39:41.651908 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG oslo_db.sqlalchemy.engines [None req-594983f7-c497-4f62-b3e7-f4c200ce9429 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80542) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 16:39:41.658128 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writer thread running {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 16:39:41.835133 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG passlib.handlers.bcrypt [None req-594983f7-c497-4f62-b3e7-f4c200ce9429 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80542) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 22 16:39:41.835133 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG passlib.handlers.bcrypt [None req-594983f7-c497-4f62-b3e7-f4c200ce9429 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80542) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 22 16:39:41.890872 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-594983f7-c497-4f62-b3e7-f4c200ce9429 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:39:41.892490 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-594983f7-c497-4f62-b3e7-f4c200ce9429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:39:42.016976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:39:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 22 16:39:42.174963 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9432f-cf45-4fbb-aa56-338b4bcff600 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:42.245490 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: INFO dbcounter [None req-47b9432f-cf45-4fbb-aa56-338b4bcff600 None None] Registered counter for database keystone Jun 22 16:39:42.264660 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG oslo_db.sqlalchemy.engines [None req-47b9432f-cf45-4fbb-aa56-338b4bcff600 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80543) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 16:39:42.270772 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writer thread running {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 16:39:42.390088 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9432f-cf45-4fbb-aa56-338b4bcff600 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:42.394288 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01502fcb-8cc1-4c38-a3a5-1401aca2cc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:42.394943 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01502fcb-8cc1-4c38-a3a5-1401aca2cc57 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:42.395228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01502fcb-8cc1-4c38-a3a5-1401aca2cc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:42.395504 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01502fcb-8cc1-4c38-a3a5-1401aca2cc57 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:42.403610 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01502fcb-8cc1-4c38-a3a5-1401aca2cc57 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:42.455309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: WARNING keystone.common.rbac_enforcer.enforcer [None req-01502fcb-8cc1-4c38-a3a5-1401aca2cc57 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 22 16:39:42.455594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01502fcb-8cc1-4c38-a3a5-1401aca2cc57 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:42.465161 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Jun 22 16:39:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 16:39:42.471145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594983f7-c497-4f62-b3e7-f4c200ce9429 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:42.485832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594983f7-c497-4f62-b3e7-f4c200ce9429 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:42.490117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe53ad6-ebe9-439f-bcc6-b93ebc89378c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:42.491278 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe53ad6-ebe9-439f-bcc6-b93ebc89378c admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:42.491562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe53ad6-ebe9-439f-bcc6-b93ebc89378c admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:42.491834 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe53ad6-ebe9-439f-bcc6-b93ebc89378c admin admin] PATH_INFO: `/v3/projects/591e7cfe38c74f35852c3e0ac79addb7` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:42.496510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe53ad6-ebe9-439f-bcc6-b93ebc89378c admin admin] RBAC: Authorizing `identity:get_project(project_id=591e7cfe38c74f35852c3e0ac79addb7)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:42.547394 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5fe53ad6-ebe9-439f-bcc6-b93ebc89378c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 22 16:39:42.547739 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe53ad6-ebe9-439f-bcc6-b93ebc89378c admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:42.552263 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Jun 22 16:39:42 2022] GET /identity/v3/projects/591e7cfe38c74f35852c3e0ac79addb7 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:39:44.550642 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cb154-deea-451a-9b6b-e0ba571da4e2 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:44.551169 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cb154-deea-451a-9b6b-e0ba571da4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:44.551264 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cb154-deea-451a-9b6b-e0ba571da4e2 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:44.555350 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:39:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:39:44.561234 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b1cde-5419-4795-a9e2-1b17b48ea08f None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:44.568051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b1cde-5419-4795-a9e2-1b17b48ea08f None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:44.568051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b1cde-5419-4795-a9e2-1b17b48ea08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:44.580318 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-7f2b1cde-5419-4795-a9e2-1b17b48ea08f None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:39:44.581849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-7f2b1cde-5419-4795-a9e2-1b17b48ea08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:39:44.589642 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:39:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 22 16:39:44.612058 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cb154-deea-451a-9b6b-e0ba571da4e2 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:44.624855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cb154-deea-451a-9b6b-e0ba571da4e2 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:44.628989 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab05744-c57c-414b-acba-480c61c14ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:44.629612 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab05744-c57c-414b-acba-480c61c14ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:44.629895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab05744-c57c-414b-acba-480c61c14ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:44.630171 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab05744-c57c-414b-acba-480c61c14ff1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:44.638053 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab05744-c57c-414b-acba-480c61c14ff1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:44.639804 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab05744-c57c-414b-acba-480c61c14ff1 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:44.648458 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Jun 22 16:39:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 16:39:44.653747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b1cde-5419-4795-a9e2-1b17b48ea08f None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:44.662670 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b1cde-5419-4795-a9e2-1b17b48ea08f None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:44.667519 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a18047d-ae92-443c-bd5d-ae448537b2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:44.668401 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18047d-ae92-443c-bd5d-ae448537b2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:44.668688 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18047d-ae92-443c-bd5d-ae448537b2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:44.668963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a18047d-ae92-443c-bd5d-ae448537b2b1 admin admin] PATH_INFO: `/v3/users/2ba6ed129dc941f49c2206f6d2b62dfd` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:44.670351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18047d-ae92-443c-bd5d-ae448537b2b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ba6ed129dc941f49c2206f6d2b62dfd)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:44.672207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a18047d-ae92-443c-bd5d-ae448537b2b1 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:44.673762 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Jun 22 16:39:44 2022] GET /identity/v3/users/2ba6ed129dc941f49c2206f6d2b62dfd => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:39:46.721465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe082d-5d9c-4737-94d5-82912d219e50 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:46.722016 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe082d-5d9c-4737-94d5-82912d219e50 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:46.722016 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe082d-5d9c-4737-94d5-82912d219e50 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:46.723367 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:39:46.728879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3788f9b-25ab-4443-9a66-6d76f52be61f None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:46.729272 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3788f9b-25ab-4443-9a66-6d76f52be61f None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:46.729447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3788f9b-25ab-4443-9a66-6d76f52be61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:46.746257 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-e3788f9b-25ab-4443-9a66-6d76f52be61f None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:39:46.747444 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e3788f9b-25ab-4443-9a66-6d76f52be61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:39:46.769958 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a211727-4563-4d00-9a2e-4a7c1751b9c5 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:46.770243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a211727-4563-4d00-9a2e-4a7c1751b9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:46.770523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a211727-4563-4d00-9a2e-4a7c1751b9c5 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:46.771866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:39:46.776878 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbf824-85e9-444e-b988-a50e9a6f1c14 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:46.777166 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbf824-85e9-444e-b988-a50e9a6f1c14 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:46.777445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbf824-85e9-444e-b988-a50e9a6f1c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:46.816748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG passlib.handlers.bcrypt [None req-3adbf824-85e9-444e-b988-a50e9a6f1c14 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80543) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 22 16:39:46.817162 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG passlib.handlers.bcrypt [None req-3adbf824-85e9-444e-b988-a50e9a6f1c14 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80543) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 22 16:39:46.827915 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:39:46.850985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3788f9b-25ab-4443-9a66-6d76f52be61f None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:46.862530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-3adbf824-85e9-444e-b988-a50e9a6f1c14 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:39:46.864123 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-3adbf824-85e9-444e-b988-a50e9a6f1c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:39:46.874087 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:46.952622 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3788f9b-25ab-4443-9a66-6d76f52be61f None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:46.961868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:39:46.984205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbf824-85e9-444e-b988-a50e9a6f1c14 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:46.985018 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc314318-2298-482f-ac3f-1831101d72ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:46.985802 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc314318-2298-482f-ac3f-1831101d72ac None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:46.986253 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc314318-2298-482f-ac3f-1831101d72ac None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:46.986531 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc314318-2298-482f-ac3f-1831101d72ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:46.997419 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc314318-2298-482f-ac3f-1831101d72ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:39:47.008532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-fc314318-2298-482f-ac3f-1831101d72ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:39:47.008532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:39:47.008532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:39:47.008532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:39:47.008532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:39:47.008532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:39:47.008532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:39:47.008532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:39:47.008532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:39:47.008532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:39:47.008532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:39:47.008532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:39:47.008532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:39:47.008532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:39:47.008532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:39:47.008532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:39:47.009963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:39:47.009963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:39:47.009963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:39:47.009963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:39:47.009963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:39:47.009963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:39:47.009963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:39:47.009963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:39:47.009963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:39:47.009963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:39:47.009963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:39:47.009963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:39:47.009963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:39:47.009963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:39:47.009963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:39:47.009963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:39:47.010805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:39:47.010805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:39:47.010805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:39:47.010805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:39:47.010805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:39:47.010805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:39:47.010805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:39:47.010805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:39:47.010805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:39:47.010805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:39:47.010805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:39:47.010805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:39:47.010805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:39:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:39:47.016329 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc314318-2298-482f-ac3f-1831101d72ac None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:47.086624 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adbf824-85e9-444e-b988-a50e9a6f1c14 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:47.088875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:47.097285 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:47.115434 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc314318-2298-482f-ac3f-1831101d72ac None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:47.122971 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d434f8-4db2-4d2c-8ca0-88f395f89f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:47.123871 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d434f8-4db2-4d2c-8ca0-88f395f89f4b None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:47.124191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d434f8-4db2-4d2c-8ca0-88f395f89f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:47.124472 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d434f8-4db2-4d2c-8ca0-88f395f89f4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:47.150554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e29445-b9fa-4f64-a113-0bc3b74bdbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:47.151207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e29445-b9fa-4f64-a113-0bc3b74bdbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:47.151492 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e29445-b9fa-4f64-a113-0bc3b74bdbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:47.151767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e29445-b9fa-4f64-a113-0bc3b74bdbc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:47.152565 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e29445-b9fa-4f64-a113-0bc3b74bdbc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:39:47.152871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e29445-b9fa-4f64-a113-0bc3b74bdbc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:47.154252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e29445-b9fa-4f64-a113-0bc3b74bdbc9 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:47.165678 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:39:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:39:47.171048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e29445-b9fa-4f64-a113-0bc3b74bdbc9 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:47.191305 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d434f8-4db2-4d2c-8ca0-88f395f89f4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:47.192992 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d434f8-4db2-4d2c-8ca0-88f395f89f4b None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:47.270520 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e29445-b9fa-4f64-a113-0bc3b74bdbc9 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:47.293697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:39:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 16:39:47.299504 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d434f8-4db2-4d2c-8ca0-88f395f89f4b None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:47.302420 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:47.304817 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9716c7a-68ab-45f3-a8e7-8216de5170d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:47.305683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9716c7a-68ab-45f3-a8e7-8216de5170d1 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:47.305968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9716c7a-68ab-45f3-a8e7-8216de5170d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:47.306276 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9716c7a-68ab-45f3-a8e7-8216de5170d1 None admin] PATH_INFO: `/v3/users/2ba6ed129dc941f49c2206f6d2b62dfd` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:47.307476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9716c7a-68ab-45f3-a8e7-8216de5170d1 None admin] RBAC: Authorizing `identity:get_user(user_id=2ba6ed129dc941f49c2206f6d2b62dfd)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:47.308965 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9716c7a-68ab-45f3-a8e7-8216de5170d1 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:47.310581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:39:47 2022] GET /identity/v3/users/2ba6ed129dc941f49c2206f6d2b62dfd => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:39:47.321914 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9716c7a-68ab-45f3-a8e7-8216de5170d1 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:47.329798 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:47.394745 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d434f8-4db2-4d2c-8ca0-88f395f89f4b None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:47.412724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9716c7a-68ab-45f3-a8e7-8216de5170d1 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:47.428506 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0004f-ce76-4bcb-8485-c4497d31e16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:47.429299 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0004f-ce76-4bcb-8485-c4497d31e16c None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:47.429585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0004f-ce76-4bcb-8485-c4497d31e16c None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:47.429865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0004f-ce76-4bcb-8485-c4497d31e16c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:47.448539 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0004f-ce76-4bcb-8485-c4497d31e16c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:47.448688 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c7c21-aa8a-4ad3-bfdd-89c753fee350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:47.449357 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c7c21-aa8a-4ad3-bfdd-89c753fee350 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:47.449642 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c7c21-aa8a-4ad3-bfdd-89c753fee350 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:47.449917 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c7c21-aa8a-4ad3-bfdd-89c753fee350 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:47.450001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0004f-ce76-4bcb-8485-c4497d31e16c None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:47.451079 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c7c21-aa8a-4ad3-bfdd-89c753fee350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:47.452543 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c7c21-aa8a-4ad3-bfdd-89c753fee350 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:47.454124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 10/18] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:39:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:39:47.459688 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c7c21-aa8a-4ad3-bfdd-89c753fee350 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:47.473275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-b9f0004f-ce76-4bcb-8485-c4497d31e16c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:39:47.473275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:39:47.473275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:39:47.473275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:39:47.473275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:39:47.473275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:39:47.473275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:39:47.473275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:39:47.473275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:39:47.473275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:39:47.473275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:39:47.473275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:39:47.473275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:39:47.473275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:39:47.473275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:39:47.474120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:39:47.474120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:39:47.474120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:39:47.474120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:39:47.474120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:39:47.474120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:39:47.474120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:39:47.474120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:39:47.474120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:39:47.474120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:39:47.474120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:39:47.474120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:39:47.474120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:39:47.474120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:39:47.474120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:39:47.474120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:39:47.474120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:39:47.474942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:39:47.474942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:39:47.474942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:39:47.474942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:39:47.474942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 9/19] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:39:47.480127 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0004f-ce76-4bcb-8485-c4497d31e16c None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:47.535936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:47.538190 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:47.555901 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c7c21-aa8a-4ad3-bfdd-89c753fee350 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:47.578035 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0004f-ce76-4bcb-8485-c4497d31e16c None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:47.588297 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b59c4-21a3-4605-a022-53031faf65df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:47.588940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b59c4-21a3-4605-a022-53031faf65df None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:47.589227 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b59c4-21a3-4605-a022-53031faf65df None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:47.589499 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b59c4-21a3-4605-a022-53031faf65df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:47.590329 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b59c4-21a3-4605-a022-53031faf65df None admin] RBAC: Adding query filter params (role.id=459b0e5c21c94fb1b81f76c65780fdb5, scope.domain.id=default, user.id=2ba6ed129dc941f49c2206f6d2b62dfd) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:39:47.590636 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b59c4-21a3-4605-a022-53031faf65df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:47.592071 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b59c4-21a3-4605-a022-53031faf65df None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:47.598529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Wed Jun 22 16:39:47 2022] GET /identity/v3/role_assignments?user.id=2ba6ed129dc941f49c2206f6d2b62dfd&scope.domain.id=default&role.id=459b0e5c21c94fb1b81f76c65780fdb5 => generated 233 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:39:47.611861 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f463fd-69cf-4761-a125-667f6067b9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:47.612581 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f463fd-69cf-4761-a125-667f6067b9cc None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:47.612869 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f463fd-69cf-4761-a125-667f6067b9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:47.613150 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f463fd-69cf-4761-a125-667f6067b9cc None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:47.613914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f463fd-69cf-4761-a125-667f6067b9cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:39:47.614357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f463fd-69cf-4761-a125-667f6067b9cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:47.615824 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f463fd-69cf-4761-a125-667f6067b9cc None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:47.636004 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:39:49.790947 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d5e0a-4f51-4695-bce6-dfc5c79b9739 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:49.791996 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d5e0a-4f51-4695-bce6-dfc5c79b9739 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:49.792613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d5e0a-4f51-4695-bce6-dfc5c79b9739 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:49.794465 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:39:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:39:49.799590 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce7a51-3239-4590-949f-394321bb3936 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:49.800452 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce7a51-3239-4590-949f-394321bb3936 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:49.800944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce7a51-3239-4590-949f-394321bb3936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:49.825157 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-4cce7a51-3239-4590-949f-394321bb3936 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:39:49.826693 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-4cce7a51-3239-4590-949f-394321bb3936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:39:49.910232 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 11/23] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:39:49.944785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d5e0a-4f51-4695-bce6-dfc5c79b9739 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:50.062137 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d5e0a-4f51-4695-bce6-dfc5c79b9739 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:50.098421 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a58b8-3cc9-4246-8aea-fd4a291f3186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:50.099559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a58b8-3cc9-4246-8aea-fd4a291f3186 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:50.100058 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a58b8-3cc9-4246-8aea-fd4a291f3186 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:50.100576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a58b8-3cc9-4246-8aea-fd4a291f3186 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:50.111902 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a58b8-3cc9-4246-8aea-fd4a291f3186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:39:50.119784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-c06a58b8-3cc9-4246-8aea-fd4a291f3186 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:39:50.119784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:39:50.119784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:39:50.119784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:39:50.119784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:39:50.119784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:39:50.119784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:39:50.119784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:39:50.119784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:39:50.119784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:39:50.119784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:39:50.119784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:39:50.119784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:39:50.119784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:39:50.119784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:39:50.119784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:39:50.120832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:39:50.120832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:39:50.120832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:39:50.120832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:39:50.120832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:39:50.120832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:39:50.120832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:39:50.120832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:39:50.120832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:39:50.120832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:39:50.120832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:39:50.120832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:39:50.120832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:39:50.120832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:39:50.120832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:39:50.120832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:39:50.121584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:39:50.121584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:39:50.121584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:39:50.121584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:39:50.121584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:39:50.121584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:39:50.121584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:39:50.121584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:39:50.121584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:39:50.121584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:39:50.121584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:39:50.121584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:39:50.124150 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 13/24] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:39:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:39:50.133412 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce7a51-3239-4590-949f-394321bb3936 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:50.193329 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:50.212993 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034484c7-864b-43d4-a985-a418c4a3acf6 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:50.224736 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034484c7-864b-43d4-a985-a418c4a3acf6 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:50.224736 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034484c7-864b-43d4-a985-a418c4a3acf6 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:50.224736 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 14/25] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:39:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:39:50.227115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb4f7f-8478-4dbf-8910-0f6d0d33bdd5 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:50.227400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb4f7f-8478-4dbf-8910-0f6d0d33bdd5 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:50.227672 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb4f7f-8478-4dbf-8910-0f6d0d33bdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:50.244488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:50.253351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-5deb4f7f-8478-4dbf-8910-0f6d0d33bdd5 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:39:50.254549 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-5deb4f7f-8478-4dbf-8910-0f6d0d33bdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:39:50.290066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce7a51-3239-4590-949f-394321bb3936 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:50.350870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6caac7-d82f-42e2-814e-1cd7849f39c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:50.351917 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6caac7-d82f-42e2-814e-1cd7849f39c8 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:50.352428 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6caac7-d82f-42e2-814e-1cd7849f39c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:50.353453 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6caac7-d82f-42e2-814e-1cd7849f39c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:50.354411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6caac7-d82f-42e2-814e-1cd7849f39c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:39:50.355814 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6caac7-d82f-42e2-814e-1cd7849f39c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:50.357464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6caac7-d82f-42e2-814e-1cd7849f39c8 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:50.384935 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 12/26] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:39:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:39:50.386550 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb1ded-3739-49e4-8e8a-dc4e1f376306 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:50.389179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb1ded-3739-49e4-8e8a-dc4e1f376306 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:50.389662 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb1ded-3739-49e4-8e8a-dc4e1f376306 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:50.393690 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:39:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:39:50.394634 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb1ded-3739-49e4-8e8a-dc4e1f376306 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:50.395060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 15/28] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 22 16:39:50.401167 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28fbc4-b542-41e3-b4d0-4d39717edc69 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:50.402053 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28fbc4-b542-41e3-b4d0-4d39717edc69 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:50.404393 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28fbc4-b542-41e3-b4d0-4d39717edc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:50.441507 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-ae28fbc4-b542-41e3-b4d0-4d39717edc69 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:39:50.443221 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-ae28fbc4-b542-41e3-b4d0-4d39717edc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:39:50.538611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb1ded-3739-49e4-8e8a-dc4e1f376306 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:50.549386 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:50.578780 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771eca9-341c-4dd5-8fe3-b958f9ab6cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:50.581236 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771eca9-341c-4dd5-8fe3-b958f9ab6cce None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:50.581751 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771eca9-341c-4dd5-8fe3-b958f9ab6cce None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:50.582225 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771eca9-341c-4dd5-8fe3-b958f9ab6cce None admin] PATH_INFO: `/v3/users/2ba6ed129dc941f49c2206f6d2b62dfd` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:50.584003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771eca9-341c-4dd5-8fe3-b958f9ab6cce None admin] RBAC: Authorizing `identity:get_user(user_id=2ba6ed129dc941f49c2206f6d2b62dfd)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:50.585714 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771eca9-341c-4dd5-8fe3-b958f9ab6cce None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:50.588271 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 14/29] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:39:50 2022] GET /identity/v3/users/2ba6ed129dc941f49c2206f6d2b62dfd => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:39:50.590802 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771eca9-341c-4dd5-8fe3-b958f9ab6cce None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:50.594816 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 16/30] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:39:50.596425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56198ec4-a0ef-47a7-8f87-afbcefb11515 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:50.596899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56198ec4-a0ef-47a7-8f87-afbcefb11515 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:50.597331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56198ec4-a0ef-47a7-8f87-afbcefb11515 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:50.598824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 17/31] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:39:50.599697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56198ec4-a0ef-47a7-8f87-afbcefb11515 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:50.671414 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:50.715410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56198ec4-a0ef-47a7-8f87-afbcefb11515 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:50.729043 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771eca9-341c-4dd5-8fe3-b958f9ab6cce None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:50.751907 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27085454-dcff-4ce7-ad8b-3d872d7a528c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:50.753005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27085454-dcff-4ce7-ad8b-3d872d7a528c None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:50.753609 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27085454-dcff-4ce7-ad8b-3d872d7a528c None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:50.753901 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27085454-dcff-4ce7-ad8b-3d872d7a528c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:50.755255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27085454-dcff-4ce7-ad8b-3d872d7a528c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:50.756774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27085454-dcff-4ce7-ad8b-3d872d7a528c None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:50.758579 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 18/32] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:39:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:39:50.760294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ab5c2-61a0-49f5-bc3b-10da37216501 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:50.760587 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ab5c2-61a0-49f5-bc3b-10da37216501 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:50.760872 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ab5c2-61a0-49f5-bc3b-10da37216501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:50.769072 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f52ae-821d-406e-905a-e34ac8d441e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:50.770082 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f52ae-821d-406e-905a-e34ac8d441e7 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:50.770535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f52ae-821d-406e-905a-e34ac8d441e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:50.770976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f52ae-821d-406e-905a-e34ac8d441e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:50.779581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-be9ab5c2-61a0-49f5-bc3b-10da37216501 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:39:50.780975 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-be9ab5c2-61a0-49f5-bc3b-10da37216501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:39:50.784648 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f52ae-821d-406e-905a-e34ac8d441e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:50.788186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f52ae-821d-406e-905a-e34ac8d441e7 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:50.807538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-427f52ae-821d-406e-905a-e34ac8d441e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:39:50.807538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:39:50.807538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:39:50.807538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:39:50.807538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:39:50.807538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:39:50.807538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:39:50.807538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:39:50.807538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:39:50.807538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:39:50.807538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:39:50.807538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:39:50.807538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:39:50.807538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:39:50.807538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:39:50.808791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:39:50.808791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:39:50.808791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:39:50.808791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:39:50.808791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:39:50.808791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:39:50.808791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:39:50.808791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:39:50.808791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:39:50.808791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:39:50.808791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:39:50.808791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:39:50.808791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:39:50.808791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:39:50.808791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:39:50.808791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:39:50.808791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:39:50.809587 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:39:50.809587 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:39:50.809587 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:39:50.809587 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:39:50.813653 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 15/33] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:39:50.815093 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f52ae-821d-406e-905a-e34ac8d441e7 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:50.850380 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:50.865534 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 19/34] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:39:50.867483 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ab5c2-61a0-49f5-bc3b-10da37216501 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:50.939290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:50.941226 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f52ae-821d-406e-905a-e34ac8d441e7 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:50.981940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ab5c2-61a0-49f5-bc3b-10da37216501 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:50.982783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06016b82-bf2c-49d4-90ee-8dc17dc8372a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:50.983655 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06016b82-bf2c-49d4-90ee-8dc17dc8372a None admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:50.984263 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06016b82-bf2c-49d4-90ee-8dc17dc8372a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:50.984681 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06016b82-bf2c-49d4-90ee-8dc17dc8372a None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:50.986363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06016b82-bf2c-49d4-90ee-8dc17dc8372a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:50.987892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06016b82-bf2c-49d4-90ee-8dc17dc8372a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:51.029814 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1d472-ad83-4d74-80d7-753b6ee0a655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:51.030706 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1d472-ad83-4d74-80d7-753b6ee0a655 None admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:51.030992 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1d472-ad83-4d74-80d7-753b6ee0a655 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:51.031347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1d472-ad83-4d74-80d7-753b6ee0a655 None admin] PATH_INFO: `/v3/domains/default/users/2ba6ed129dc941f49c2206f6d2b62dfd/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:51.033736 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1d472-ad83-4d74-80d7-753b6ee0a655 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2ba6ed129dc941f49c2206f6d2b62dfd, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:51.035211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1d472-ad83-4d74-80d7-753b6ee0a655 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:51.206414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 16/35] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Jun 22 16:39:50 2022] POST /identity/v3/roles => generated 219 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:39:51.207733 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06016b82-bf2c-49d4-90ee-8dc17dc8372a None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:51.276658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 20/36] 10.222.0.18 () {58 vars in 1361 bytes} [Wed Jun 22 16:39:50 2022] PUT /identity/v3/domains/default/users/2ba6ed129dc941f49c2206f6d2b62dfd/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:39:51.278367 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1d472-ad83-4d74-80d7-753b6ee0a655 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:51.309168 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:51.323356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06016b82-bf2c-49d4-90ee-8dc17dc8372a None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:51.367548 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f4485-9386-4d9d-b95e-effeed36f513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:51.370445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f4485-9386-4d9d-b95e-effeed36f513 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:51.371364 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f4485-9386-4d9d-b95e-effeed36f513 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:51.372013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f4485-9386-4d9d-b95e-effeed36f513 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:51.374480 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f4485-9386-4d9d-b95e-effeed36f513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:39:51.375049 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f4485-9386-4d9d-b95e-effeed36f513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:51.377916 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f4485-9386-4d9d-b95e-effeed36f513 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:51.404717 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 17/37] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:39:51.417852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f4485-9386-4d9d-b95e-effeed36f513 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:51.502183 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1d472-ad83-4d74-80d7-753b6ee0a655 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:51.528374 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:51.544153 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d8e9c-db02-4071-b7f5-9f8748564127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:51.544854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d8e9c-db02-4071-b7f5-9f8748564127 None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:51.545372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d8e9c-db02-4071-b7f5-9f8748564127 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:51.545372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d8e9c-db02-4071-b7f5-9f8748564127 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:51.546176 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d8e9c-db02-4071-b7f5-9f8748564127 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:51.547798 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d8e9c-db02-4071-b7f5-9f8748564127 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:51.572212 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f4485-9386-4d9d-b95e-effeed36f513 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:51.611398 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02285ad6-5fba-4b1f-b83a-4efab6e0ed8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:51.612062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02285ad6-5fba-4b1f-b83a-4efab6e0ed8c None admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:51.612405 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02285ad6-5fba-4b1f-b83a-4efab6e0ed8c None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:51.612682 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02285ad6-5fba-4b1f-b83a-4efab6e0ed8c None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:51.613488 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02285ad6-5fba-4b1f-b83a-4efab6e0ed8c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:51.614944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02285ad6-5fba-4b1f-b83a-4efab6e0ed8c None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:51.640479 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 21/38] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Jun 22 16:39:51 2022] POST /identity/v3/roles => generated 225 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:39:51.641930 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151c011-0e86-4d30-80a2-ec4a4522357b None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:51.642230 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151c011-0e86-4d30-80a2-ec4a4522357b None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:51.642513 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151c011-0e86-4d30-80a2-ec4a4522357b None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:51.643776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 22/39] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:39:51.649513 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b47660-9ee1-4f71-8b9a-d25bcf4583f2 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:51.650363 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b47660-9ee1-4f71-8b9a-d25bcf4583f2 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:51.650630 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b47660-9ee1-4f71-8b9a-d25bcf4583f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:51.670186 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-a2b47660-9ee1-4f71-8b9a-d25bcf4583f2 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:39:51.671966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-a2b47660-9ee1-4f71-8b9a-d25bcf4583f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:39:51.725875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:51.734523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 18/40] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 16:39:51 2022] POST /identity/v3/projects => generated 301 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:39:51.766988 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 23/41] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:39:51.788081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1700c5-f3f8-488f-a4ca-65d6f284c214 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:51.788581 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1700c5-f3f8-488f-a4ca-65d6f284c214 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:51.789096 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1700c5-f3f8-488f-a4ca-65d6f284c214 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:51.791718 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 19/42] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:39:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:39:51.794279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b47660-9ee1-4f71-8b9a-d25bcf4583f2 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:51.797237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d930b-11c0-411c-b533-297a5202bb6c None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:51.797526 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d930b-11c0-411c-b533-297a5202bb6c None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:51.797811 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d930b-11c0-411c-b533-297a5202bb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:51.826894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-998d930b-11c0-411c-b533-297a5202bb6c None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:39:51.828548 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-998d930b-11c0-411c-b533-297a5202bb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:39:51.929191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 20/43] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:39:51.955452 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d930b-11c0-411c-b533-297a5202bb6c None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:51.975060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b47660-9ee1-4f71-8b9a-d25bcf4583f2 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:52.099141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:52.102414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d930b-11c0-411c-b533-297a5202bb6c None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:52.122026 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b61423a-6318-4a00-a754-06e1bea12e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:52.122701 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61423a-6318-4a00-a754-06e1bea12e31 None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:52.122993 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61423a-6318-4a00-a754-06e1bea12e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:52.123486 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b61423a-6318-4a00-a754-06e1bea12e31 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:52.124046 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61423a-6318-4a00-a754-06e1bea12e31 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:52.125484 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b61423a-6318-4a00-a754-06e1bea12e31 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:52.136946 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:52.142884 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9d120-eb28-478c-a85a-72dca50acf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:52.143678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9d120-eb28-478c-a85a-72dca50acf6a None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:52.143995 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9d120-eb28-478c-a85a-72dca50acf6a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:52.144302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9d120-eb28-478c-a85a-72dca50acf6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:52.145521 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9d120-eb28-478c-a85a-72dca50acf6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:52.146993 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9d120-eb28-478c-a85a-72dca50acf6a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:52.148705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 21/44] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:39:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:39:52.154603 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9d120-eb28-478c-a85a-72dca50acf6a None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:52.209915 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 24/45] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Jun 22 16:39:51 2022] POST /identity/v3/roles => generated 223 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:39:52.268864 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9d120-eb28-478c-a85a-72dca50acf6a None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:52.305229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab2639-1ad6-4acf-bfa4-b8a2ac19b9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:52.306352 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab2639-1ad6-4acf-bfa4-b8a2ac19b9b3 None admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:52.306651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab2639-1ad6-4acf-bfa4-b8a2ac19b9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:52.306932 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab2639-1ad6-4acf-bfa4-b8a2ac19b9b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:52.307671 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab2639-1ad6-4acf-bfa4-b8a2ac19b9b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:52.309205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab2639-1ad6-4acf-bfa4-b8a2ac19b9b3 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:52.394224 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 22/46] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 16:39:52 2022] POST /identity/v3/projects => generated 312 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 16:39:53.466044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84e17d-7cfd-4956-98e3-30e754aa7968 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:53.466575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84e17d-7cfd-4956-98e3-30e754aa7968 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:53.466659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84e17d-7cfd-4956-98e3-30e754aa7968 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:53.468001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 25/47] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:39:53.473377 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05cd7f-3d60-43d7-86db-f2463cb9094a None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:53.473768 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05cd7f-3d60-43d7-86db-f2463cb9094a None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:53.473952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05cd7f-3d60-43d7-86db-f2463cb9094a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:53.492542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-5e05cd7f-3d60-43d7-86db-f2463cb9094a None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:39:53.494514 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-5e05cd7f-3d60-43d7-86db-f2463cb9094a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:39:53.543178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:53.562067 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 23/48] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:39:53.585269 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84e17d-7cfd-4956-98e3-30e754aa7968 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:53.683682 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84e17d-7cfd-4956-98e3-30e754aa7968 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:53.715892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc0a23-a852-4640-9cb4-e5132203b6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:53.716746 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc0a23-a852-4640-9cb4-e5132203b6ed None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:53.716980 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc0a23-a852-4640-9cb4-e5132203b6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:53.717253 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc0a23-a852-4640-9cb4-e5132203b6ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:53.726862 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc0a23-a852-4640-9cb4-e5132203b6ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:39:53.734397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-52dc0a23-a852-4640-9cb4-e5132203b6ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:39:53.734397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:39:53.734397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:39:53.734397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:39:53.734397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:39:53.734397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:39:53.734397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:39:53.734397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:39:53.734397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:39:53.734397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:39:53.734397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:39:53.734397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:39:53.734397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:39:53.734397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:39:53.734397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:39:53.734397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:39:53.735410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:39:53.735410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:39:53.735410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:39:53.735410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:39:53.735410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:39:53.735410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:39:53.735410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:39:53.735410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:39:53.735410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:39:53.735410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:39:53.735410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:39:53.735410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:39:53.735410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:39:53.735410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:39:53.735410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:39:53.735410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:39:53.736444 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:39:53.736444 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:39:53.736444 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:39:53.736444 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:39:53.736444 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:39:53.736444 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:39:53.736444 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:39:53.736444 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:39:53.736444 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:39:53.736444 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:39:53.736444 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:39:53.736444 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:39:53.736444 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 26/49] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:39:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:39:53.741193 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05cd7f-3d60-43d7-86db-f2463cb9094a None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:53.939664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05cd7f-3d60-43d7-86db-f2463cb9094a None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:53.972008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd37e0-9b53-4b63-b74d-e88ebb3e4333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:53.972627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd37e0-9b53-4b63-b74d-e88ebb3e4333 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:53.972912 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd37e0-9b53-4b63-b74d-e88ebb3e4333 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:53.973193 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd37e0-9b53-4b63-b74d-e88ebb3e4333 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:53.973950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd37e0-9b53-4b63-b74d-e88ebb3e4333 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:39:53.974258 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd37e0-9b53-4b63-b74d-e88ebb3e4333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:53.975637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd37e0-9b53-4b63-b74d-e88ebb3e4333 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:53.983603 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 24/50] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:39:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:39:53.989158 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc0a23-a852-4640-9cb4-e5132203b6ed None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:54.024365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:54.091317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc0a23-a852-4640-9cb4-e5132203b6ed None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:54.123994 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79d92f-44b3-4538-825f-a04ff254422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:54.124888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79d92f-44b3-4538-825f-a04ff254422f None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:54.125174 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79d92f-44b3-4538-825f-a04ff254422f None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:54.125449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79d92f-44b3-4538-825f-a04ff254422f None admin] PATH_INFO: `/v3/users/2ba6ed129dc941f49c2206f6d2b62dfd` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:54.126641 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79d92f-44b3-4538-825f-a04ff254422f None admin] RBAC: Authorizing `identity:get_user(user_id=2ba6ed129dc941f49c2206f6d2b62dfd)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:54.128090 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79d92f-44b3-4538-825f-a04ff254422f None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:54.129765 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 27/51] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:39:53 2022] GET /identity/v3/users/2ba6ed129dc941f49c2206f6d2b62dfd => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:39:54.135762 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd37e0-9b53-4b63-b74d-e88ebb3e4333 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:54.177326 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:54.231944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd37e0-9b53-4b63-b74d-e88ebb3e4333 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:54.263831 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea6acb-e287-45a3-9cab-850672d02c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:54.264641 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea6acb-e287-45a3-9cab-850672d02c85 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:54.264927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea6acb-e287-45a3-9cab-850672d02c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:54.265201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea6acb-e287-45a3-9cab-850672d02c85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:54.266365 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea6acb-e287-45a3-9cab-850672d02c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:54.267794 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea6acb-e287-45a3-9cab-850672d02c85 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:54.269426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 25/52] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:39:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:39:54.275051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79d92f-44b3-4538-825f-a04ff254422f None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:54.367145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:54.370734 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79d92f-44b3-4538-825f-a04ff254422f None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:54.403002 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee407b-9563-4624-ac4a-0a25495bc009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:54.403659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee407b-9563-4624-ac4a-0a25495bc009 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:54.403943 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee407b-9563-4624-ac4a-0a25495bc009 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:54.404256 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee407b-9563-4624-ac4a-0a25495bc009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:54.405424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee407b-9563-4624-ac4a-0a25495bc009 None admin] RBAC: Adding query filter params (role.id=459b0e5c21c94fb1b81f76c65780fdb5, scope.domain.id=default, user.id=2ba6ed129dc941f49c2206f6d2b62dfd) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:39:54.405740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee407b-9563-4624-ac4a-0a25495bc009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:54.407192 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee407b-9563-4624-ac4a-0a25495bc009 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:54.414024 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 28/53] 10.222.0.18 () {56 vars in 1322 bytes} [Wed Jun 22 16:39:54 2022] GET /identity/v3/role_assignments?user.id=2ba6ed129dc941f49c2206f6d2b62dfd&scope.domain.id=default&role.id=459b0e5c21c94fb1b81f76c65780fdb5 => generated 530 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:39:54.429432 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a46801-4bb6-4caa-9aaf-aa497cef96e0 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:54.429819 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a46801-4bb6-4caa-9aaf-aa497cef96e0 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:54.430192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a46801-4bb6-4caa-9aaf-aa497cef96e0 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:54.432392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 26/54] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:39:54.438243 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e294e-576f-4850-bf69-a9b4ede995a8 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:54.438539 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e294e-576f-4850-bf69-a9b4ede995a8 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:54.438825 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e294e-576f-4850-bf69-a9b4ede995a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:54.456576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-682e294e-576f-4850-bf69-a9b4ede995a8 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:39:54.457799 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-682e294e-576f-4850-bf69-a9b4ede995a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:39:54.532798 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 29/55] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:39:54.556919 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a46801-4bb6-4caa-9aaf-aa497cef96e0 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:54.661931 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a46801-4bb6-4caa-9aaf-aa497cef96e0 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:54.672365 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:54.694231 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef07242-b122-42c1-9140-01f40fc77fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:54.695012 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef07242-b122-42c1-9140-01f40fc77fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:54.695302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef07242-b122-42c1-9140-01f40fc77fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:54.695583 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef07242-b122-42c1-9140-01f40fc77fc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:54.696810 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef07242-b122-42c1-9140-01f40fc77fc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:54.698321 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef07242-b122-42c1-9140-01f40fc77fc0 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:54.699941 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 27/56] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:39:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:39:54.705549 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e294e-576f-4850-bf69-a9b4ede995a8 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:54.800786 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:54.807166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e294e-576f-4850-bf69-a9b4ede995a8 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:54.841041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf99509-7441-4288-a18c-5221430fba70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:54.841694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf99509-7441-4288-a18c-5221430fba70 None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:54.841984 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf99509-7441-4288-a18c-5221430fba70 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:54.842265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf99509-7441-4288-a18c-5221430fba70 None admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:54.842992 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf99509-7441-4288-a18c-5221430fba70 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:54.844471 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf99509-7441-4288-a18c-5221430fba70 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:54.923504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 30/57] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Jun 22 16:39:54 2022] POST /identity/v3/projects => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:39:56.923210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de1588-c46a-48e0-982a-d56b1cb77b89 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:56.923722 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de1588-c46a-48e0-982a-d56b1cb77b89 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:56.923840 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de1588-c46a-48e0-982a-d56b1cb77b89 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:56.925173 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 28/58] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:39:56.930197 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0da82a-f13d-4ae1-9bf1-a658b34ef3cf None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:56.930577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0da82a-f13d-4ae1-9bf1-a658b34ef3cf None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:56.931271 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0da82a-f13d-4ae1-9bf1-a658b34ef3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:56.948261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-8b0da82a-f13d-4ae1-9bf1-a658b34ef3cf None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:39:56.949451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-8b0da82a-f13d-4ae1-9bf1-a658b34ef3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:39:57.013896 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 31/59] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:39:57.037617 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de1588-c46a-48e0-982a-d56b1cb77b89 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:57.136719 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de1588-c46a-48e0-982a-d56b1cb77b89 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:57.169293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c184940-bf11-4772-bc4a-98b108fbefa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:57.170065 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c184940-bf11-4772-bc4a-98b108fbefa7 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:57.170351 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c184940-bf11-4772-bc4a-98b108fbefa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:57.170633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c184940-bf11-4772-bc4a-98b108fbefa7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:57.171800 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c184940-bf11-4772-bc4a-98b108fbefa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:57.173307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c184940-bf11-4772-bc4a-98b108fbefa7 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:57.174840 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 29/60] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:39:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:39:57.180202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0da82a-f13d-4ae1-9bf1-a658b34ef3cf None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:39:57.253239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:39:57.275081 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0da82a-f13d-4ae1-9bf1-a658b34ef3cf None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:39:57.308789 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e70a2-f87c-4d4a-8f6d-e080995ef937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:39:57.309446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e70a2-f87c-4d4a-8f6d-e080995ef937 None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:39:57.309733 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e70a2-f87c-4d4a-8f6d-e080995ef937 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:39:57.310013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e70a2-f87c-4d4a-8f6d-e080995ef937 None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:39:57.310735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e70a2-f87c-4d4a-8f6d-e080995ef937 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:39:57.312189 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e70a2-f87c-4d4a-8f6d-e080995ef937 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:39:57.401793 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 32/61] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 16:39:57 2022] POST /identity/v3/users => generated 275 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:40:00.479946 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4d569-165e-4051-9dfa-a80bd4bfcda3 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:00.480980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4d569-165e-4051-9dfa-a80bd4bfcda3 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:00.481475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4d569-165e-4051-9dfa-a80bd4bfcda3 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:00.483361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 30/62] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:00.488391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79182c46-96fa-4fc7-8ba5-57c39216e04b None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:00.489202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79182c46-96fa-4fc7-8ba5-57c39216e04b None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:00.489703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79182c46-96fa-4fc7-8ba5-57c39216e04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:00.513986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-79182c46-96fa-4fc7-8ba5-57c39216e04b None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:00.515508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-79182c46-96fa-4fc7-8ba5-57c39216e04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:00.572042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56307113-9aa9-4f3a-a243-d5a0e469abb4 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:00.572679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56307113-9aa9-4f3a-a243-d5a0e469abb4 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:00.573159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56307113-9aa9-4f3a-a243-d5a0e469abb4 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:00.574996 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:00.579893 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058913d-bb5a-4ae3-ad23-ce9949e3e6f4 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:00.580426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058913d-bb5a-4ae3-ad23-ce9949e3e6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:00.581003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058913d-bb5a-4ae3-ad23-ce9949e3e6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:00.608381 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 33/64] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:00.608556 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-3058913d-bb5a-4ae3-ad23-ce9949e3e6f4 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:00.609182 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-3058913d-bb5a-4ae3-ad23-ce9949e3e6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:00.657002 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79182c46-96fa-4fc7-8ba5-57c39216e04b None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:00.688242 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:00.732050 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 32/65] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:00.737697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfefb0-0236-4d7e-95ce-f50f9da92a4e None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:00.738146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfefb0-0236-4d7e-95ce-f50f9da92a4e None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:00.738597 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfefb0-0236-4d7e-95ce-f50f9da92a4e None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:00.740053 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 33/66] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:00.745486 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:00.753584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78622164-8bff-4e1c-9555-cd859fcb9a4c None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:00.753941 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78622164-8bff-4e1c-9555-cd859fcb9a4c None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:00.754236 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78622164-8bff-4e1c-9555-cd859fcb9a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:00.778565 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-78622164-8bff-4e1c-9555-cd859fcb9a4c None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:00.780053 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-78622164-8bff-4e1c-9555-cd859fcb9a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:00.789550 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79182c46-96fa-4fc7-8ba5-57c39216e04b None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:00.832337 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742f91b-ba23-40ed-b6b0-7c321abaa9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:00.833764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742f91b-ba23-40ed-b6b0-7c321abaa9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:00.834069 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742f91b-ba23-40ed-b6b0-7c321abaa9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:00.834355 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742f91b-ba23-40ed-b6b0-7c321abaa9c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:00.849070 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742f91b-ba23-40ed-b6b0-7c321abaa9c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:00.856321 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 34/67] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:00.857441 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78622164-8bff-4e1c-9555-cd859fcb9a4c None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:00.862899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-2742f91b-ba23-40ed-b6b0-7c321abaa9c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:00.862899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:00.862899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:00.862899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:00.862899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:00.862899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:00.862899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:00.862899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:00.862899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:00.862899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:00.862899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:00.862899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:00.862899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:00.862899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:00.862899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:00.862899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:00.863759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:00.863759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:00.863759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:00.863759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:00.863759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:00.863759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:00.863759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:00.863759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:00.863759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:00.863759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:00.863759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:00.863759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:00.863759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:00.863759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:00.863759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:00.863759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:00.864554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:00.864554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:00.864554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:00.864554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:00.864554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:00.864554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:00.864554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:00.864554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:00.864554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:00.864554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:00.864554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:00.864554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:00.867693 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 34/68] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:40:00.876892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742f91b-ba23-40ed-b6b0-7c321abaa9c0 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:01.001795 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78622164-8bff-4e1c-9555-cd859fcb9a4c None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:01.009281 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742f91b-ba23-40ed-b6b0-7c321abaa9c0 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:01.011324 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:01.040580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:01.044207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a73599-0d46-4420-b9a0-1651ad19bb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:01.045233 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a73599-0d46-4420-b9a0-1651ad19bb79 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:01.045714 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a73599-0d46-4420-b9a0-1651ad19bb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:01.046260 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a73599-0d46-4420-b9a0-1651ad19bb79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:01.053930 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034c297-01ef-48f3-9949-d966dd3659f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:01.054608 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034c297-01ef-48f3-9949-d966dd3659f1 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:01.054898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034c297-01ef-48f3-9949-d966dd3659f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:01.055181 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034c297-01ef-48f3-9949-d966dd3659f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:01.056169 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034c297-01ef-48f3-9949-d966dd3659f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:01.056495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034c297-01ef-48f3-9949-d966dd3659f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:01.057903 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034c297-01ef-48f3-9949-d966dd3659f1 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:01.058921 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a73599-0d46-4420-b9a0-1651ad19bb79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:01.066476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 35/69] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:01.067212 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034c297-01ef-48f3-9949-d966dd3659f1 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:01.067849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-c8a73599-0d46-4420-b9a0-1651ad19bb79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:40:01.067849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:01.067849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:01.067849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:01.067849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:01.067849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:01.067849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:01.067849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:01.067849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:01.067849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:01.067849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:01.067849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:01.067849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:01.067849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:01.067849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:01.067849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:01.068783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:01.068783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:01.068783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:01.068783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:01.068783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:01.068783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:01.068783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:01.068783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:01.068783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:01.068783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:01.068783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:01.068783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:01.068783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:01.068783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:01.068783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:01.068783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:01.069586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:01.069586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:01.069586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:01.069586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:01.069586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:01.069586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:01.069586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:01.069586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:01.069586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:01.069586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:01.069586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:40:01.069586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:01.069586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 35/70] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:40:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:01.071875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6abbd-614a-4e35-9b59-5eac07abcaf2 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:01.072192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6abbd-614a-4e35-9b59-5eac07abcaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:01.072480 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6abbd-614a-4e35-9b59-5eac07abcaf2 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:01.074078 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 36/71] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:01.078377 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6abbd-614a-4e35-9b59-5eac07abcaf2 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:01.174820 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034c297-01ef-48f3-9949-d966dd3659f1 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:01.186184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6abbd-614a-4e35-9b59-5eac07abcaf2 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:01.210365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff3992-3374-423d-8c25-70b484fb47c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:01.211168 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff3992-3374-423d-8c25-70b484fb47c3 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:01.211458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff3992-3374-423d-8c25-70b484fb47c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:01.211738 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff3992-3374-423d-8c25-70b484fb47c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:01.222666 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff3992-3374-423d-8c25-70b484fb47c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:01.222805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef6783-c307-4709-ac59-e2ac037eaba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:01.223543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef6783-c307-4709-ac59-e2ac037eaba8 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:01.223831 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef6783-c307-4709-ac59-e2ac037eaba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:01.224270 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef6783-c307-4709-ac59-e2ac037eaba8 None admin] PATH_INFO: `/v3/users/bb405bf4f38249d1957087830723f0ea` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:01.230769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-25ff3992-3374-423d-8c25-70b484fb47c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:01.230769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:01.230769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:01.230769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:01.230769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:01.230769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:01.230769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:01.230769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:01.230769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:01.230769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:01.230769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:01.230769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:01.230769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:01.230769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:01.230769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:01.230769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:01.231616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:01.231616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:01.231616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:01.231616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:01.231616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:01.231616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:01.231616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:01.231616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:01.231616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:01.231616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:01.231616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:01.231616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:01.231616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:01.231616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:01.231616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:01.231616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:01.232892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:01.232892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:01.232892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:01.232892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:01.232892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:01.232892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:01.232892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:01.232892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:01.232892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:01.232892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:01.232892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:01.232892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:01.236456 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 36/72] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:40:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:01.237770 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff3992-3374-423d-8c25-70b484fb47c3 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:01.242400 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef6783-c307-4709-ac59-e2ac037eaba8 None admin] RBAC: Authorizing `identity:get_user(user_id=bb405bf4f38249d1957087830723f0ea)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:01.243926 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef6783-c307-4709-ac59-e2ac037eaba8 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:01.245939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 37/73] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:01 2022] GET /identity/v3/users/bb405bf4f38249d1957087830723f0ea => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:01.246950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693d7fb-4d01-41f6-bcfa-552f8256a109 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:01.247242 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693d7fb-4d01-41f6-bcfa-552f8256a109 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:01.247525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693d7fb-4d01-41f6-bcfa-552f8256a109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:01.265290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-c693d7fb-4d01-41f6-bcfa-552f8256a109 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:01.266417 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-c693d7fb-4d01-41f6-bcfa-552f8256a109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:01.283670 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:01.287825 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:01.331494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 38/74] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:01.332454 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693d7fb-4d01-41f6-bcfa-552f8256a109 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:01.342665 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff3992-3374-423d-8c25-70b484fb47c3 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:01.377714 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5520d75-fe69-4fb7-a6bc-c8a2cc2f627f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:01.378381 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5520d75-fe69-4fb7-a6bc-c8a2cc2f627f None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:01.378677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5520d75-fe69-4fb7-a6bc-c8a2cc2f627f None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:01.378959 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5520d75-fe69-4fb7-a6bc-c8a2cc2f627f None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:01.379770 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5520d75-fe69-4fb7-a6bc-c8a2cc2f627f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:01.380024 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5520d75-fe69-4fb7-a6bc-c8a2cc2f627f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:01.381439 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5520d75-fe69-4fb7-a6bc-c8a2cc2f627f None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:01.390216 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:01.391044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5520d75-fe69-4fb7-a6bc-c8a2cc2f627f None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:01.429811 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693d7fb-4d01-41f6-bcfa-552f8256a109 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:01.463190 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b00efc-29fa-4d99-80bc-a5fd1c4a6e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:01.463852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b00efc-29fa-4d99-80bc-a5fd1c4a6e01 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:01.464163 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b00efc-29fa-4d99-80bc-a5fd1c4a6e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:01.464449 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b00efc-29fa-4d99-80bc-a5fd1c4a6e01 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:01.465203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b00efc-29fa-4d99-80bc-a5fd1c4a6e01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:01.465517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b00efc-29fa-4d99-80bc-a5fd1c4a6e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:01.466902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b00efc-29fa-4d99-80bc-a5fd1c4a6e01 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:01.474921 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 39/76] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:40:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:01.476213 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b6513-5118-49fa-ad22-ee8d83c4e4b4 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:01.476507 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b6513-5118-49fa-ad22-ee8d83c4e4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:01.476797 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b6513-5118-49fa-ad22-ee8d83c4e4b4 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:01.478212 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 40/77] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:01.478827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b6513-5118-49fa-ad22-ee8d83c4e4b4 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:01.486415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5520d75-fe69-4fb7-a6bc-c8a2cc2f627f None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:01.493752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:01.497709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:01.519462 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3694f-b62c-40d1-a99f-dcf185333345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:01.520047 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3694f-b62c-40d1-a99f-dcf185333345 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:01.520384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3694f-b62c-40d1-a99f-dcf185333345 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:01.520697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3694f-b62c-40d1-a99f-dcf185333345 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:01.578677 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b6513-5118-49fa-ad22-ee8d83c4e4b4 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:01.586849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3694f-b62c-40d1-a99f-dcf185333345 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:01.588372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3694f-b62c-40d1-a99f-dcf185333345 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:01.611652 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b36c2-4c35-4ab8-a0a4-0ecb3a69e62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:01.612461 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b36c2-4c35-4ab8-a0a4-0ecb3a69e62d None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:01.612751 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b36c2-4c35-4ab8-a0a4-0ecb3a69e62d None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:01.613031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b36c2-4c35-4ab8-a0a4-0ecb3a69e62d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:01.623418 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b36c2-4c35-4ab8-a0a4-0ecb3a69e62d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:01.631059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-ac4b36c2-4c35-4ab8-a0a4-0ecb3a69e62d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:01.631059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:01.631059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:01.631059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:01.631059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:01.631059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:01.631059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:01.631059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:01.631059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:01.631059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:01.631059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:01.631059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:01.631059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:01.631059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:01.631059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:01.631059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:01.632089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:01.632089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:01.632089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:01.632089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:01.632089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:01.632089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:01.632089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:01.632089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:01.632089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:01.632089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:01.632089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:01.632089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:01.632089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:01.632089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:01.632089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:01.632089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:01.633036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:01.633036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:01.633036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:01.633036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:01.633036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:01.633036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:01.633036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:01.633036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:01.633036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:01.633036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:01.633036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:01.633036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:01.633036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 41/78] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:01.633036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b36c2-4c35-4ab8-a0a4-0ecb3a69e62d None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:01.686643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 38/79] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:01.687989 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e21da-a275-4500-859b-24e061e348de None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:01.688321 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e21da-a275-4500-859b-24e061e348de None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:01.688606 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e21da-a275-4500-859b-24e061e348de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:01.698847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:01.704722 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-344e21da-a275-4500-859b-24e061e348de None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:01.705943 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-344e21da-a275-4500-859b-24e061e348de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:01.715084 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:01.737501 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b36c2-4c35-4ab8-a0a4-0ecb3a69e62d None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:01.770910 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 39/80] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:01.771684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e21da-a275-4500-859b-24e061e348de None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:01.772803 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d97ae5-b043-4e35-81c6-d46dc476b51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:01.773878 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d97ae5-b043-4e35-81c6-d46dc476b51e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:01.774175 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d97ae5-b043-4e35-81c6-d46dc476b51e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:01.775193 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d97ae5-b043-4e35-81c6-d46dc476b51e None admin] PATH_INFO: `/v3/users/2ba6ed129dc941f49c2206f6d2b62dfd` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:01.776483 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d97ae5-b043-4e35-81c6-d46dc476b51e None admin] RBAC: Authorizing `identity:get_user(user_id=2ba6ed129dc941f49c2206f6d2b62dfd)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:01.777954 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d97ae5-b043-4e35-81c6-d46dc476b51e None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:01.784719 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 42/81] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:01 2022] GET /identity/v3/users/2ba6ed129dc941f49c2206f6d2b62dfd => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:01.784719 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d97ae5-b043-4e35-81c6-d46dc476b51e None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:01.876432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e21da-a275-4500-859b-24e061e348de None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:01.879761 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d97ae5-b043-4e35-81c6-d46dc476b51e None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:01.909090 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ec61a-c9af-426f-af22-98a500d0779f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:01.909945 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ec61a-c9af-426f-af22-98a500d0779f None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:01.910227 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ec61a-c9af-426f-af22-98a500d0779f None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:01.910500 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ec61a-c9af-426f-af22-98a500d0779f None admin] PATH_INFO: `/v3/users/bb405bf4f38249d1957087830723f0ea` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:01.911669 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ec61a-c9af-426f-af22-98a500d0779f None admin] RBAC: Authorizing `identity:get_user(user_id=bb405bf4f38249d1957087830723f0ea)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:01.912695 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa76850-5b7c-42cc-9411-d1a8b82ab2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:01.913144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ec61a-c9af-426f-af22-98a500d0779f None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:01.913358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa76850-5b7c-42cc-9411-d1a8b82ab2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:01.913651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa76850-5b7c-42cc-9411-d1a8b82ab2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:01.913939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa76850-5b7c-42cc-9411-d1a8b82ab2c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:01.914704 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa76850-5b7c-42cc-9411-d1a8b82ab2c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:01.914830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 40/82] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:01 2022] GET /identity/v3/users/bb405bf4f38249d1957087830723f0ea => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:01.915612 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa76850-5b7c-42cc-9411-d1a8b82ab2c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:01.916890 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ec61a-c9af-426f-af22-98a500d0779f None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:01.917104 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa76850-5b7c-42cc-9411-d1a8b82ab2c0 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:01.921031 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:01.925527 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 43/83] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:01.926334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa76850-5b7c-42cc-9411-d1a8b82ab2c0 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:01.942319 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:02.025167 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ec61a-c9af-426f-af22-98a500d0779f None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:02.030945 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa76850-5b7c-42cc-9411-d1a8b82ab2c0 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:02.058381 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae07b1-7c5b-4f36-b0a4-283d09da6974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:02.059238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae07b1-7c5b-4f36-b0a4-283d09da6974 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:02.059526 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae07b1-7c5b-4f36-b0a4-283d09da6974 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:02.059812 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae07b1-7c5b-4f36-b0a4-283d09da6974 None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:02.061067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae07b1-7c5b-4f36-b0a4-283d09da6974 None admin] RBAC: Authorizing `identity:get_project(project_id=d81536229a89416692cd909ecd4bd4ec)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:02.062525 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae07b1-7c5b-4f36-b0a4-283d09da6974 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:02.064267 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 41/84] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:01 2022] GET /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:02.065033 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae07b1-7c5b-4f36-b0a4-283d09da6974 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:02.074243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1693c-d504-463a-95b6-d0508eefc220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:02.074910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1693c-d504-463a-95b6-d0508eefc220 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:02.075202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1693c-d504-463a-95b6-d0508eefc220 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:02.075485 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1693c-d504-463a-95b6-d0508eefc220 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:02.137023 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:02.149143 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1693c-d504-463a-95b6-d0508eefc220 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:02.151199 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1693c-d504-463a-95b6-d0508eefc220 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:02.158625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:02.166137 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae07b1-7c5b-4f36-b0a4-283d09da6974 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:02.198551 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5c5b0-9f29-4f1f-8c15-f2b407564bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:02.199329 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5c5b0-9f29-4f1f-8c15-f2b407564bda None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:02.199616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5c5b0-9f29-4f1f-8c15-f2b407564bda None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:02.199891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5c5b0-9f29-4f1f-8c15-f2b407564bda None admin] PATH_INFO: `/v3/domains/default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:02.201088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5c5b0-9f29-4f1f-8c15-f2b407564bda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:02.202506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5c5b0-9f29-4f1f-8c15-f2b407564bda None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:02.204170 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 42/85] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:40:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:02.204907 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5c5b0-9f29-4f1f-8c15-f2b407564bda None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:02.255203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 44/86] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:02.256283 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1693c-d504-463a-95b6-d0508eefc220 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:02.324079 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5c5b0-9f29-4f1f-8c15-f2b407564bda None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:02.342580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3158d-024e-48a8-bb2b-4a75864a5cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:02.343227 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3158d-024e-48a8-bb2b-4a75864a5cba None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:02.343517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3158d-024e-48a8-bb2b-4a75864a5cba None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:02.343795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3158d-024e-48a8-bb2b-4a75864a5cba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:02.355261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:02.357341 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1693c-d504-463a-95b6-d0508eefc220 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:02.364495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:02.389847 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219b196-f1b5-4521-a103-b6f6a55bb40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:02.390702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219b196-f1b5-4521-a103-b6f6a55bb40a None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:02.390983 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219b196-f1b5-4521-a103-b6f6a55bb40a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:02.391260 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219b196-f1b5-4521-a103-b6f6a55bb40a None admin] PATH_INFO: `/v3/users/bb405bf4f38249d1957087830723f0ea` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:02.392581 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219b196-f1b5-4521-a103-b6f6a55bb40a None admin] RBAC: Authorizing `identity:get_user(user_id=bb405bf4f38249d1957087830723f0ea)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:02.394029 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219b196-f1b5-4521-a103-b6f6a55bb40a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:02.395638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 45/87] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:02 2022] GET /identity/v3/users/bb405bf4f38249d1957087830723f0ea => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:02.396598 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219b196-f1b5-4521-a103-b6f6a55bb40a None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:02.411208 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3158d-024e-48a8-bb2b-4a75864a5cba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:02.412709 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3158d-024e-48a8-bb2b-4a75864a5cba None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:02.494902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219b196-f1b5-4521-a103-b6f6a55bb40a None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:02.508201 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 43/88] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:02.509514 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3158d-024e-48a8-bb2b-4a75864a5cba None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:02.534090 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661f328-0241-4517-bbb9-89c13970b155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:02.534742 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661f328-0241-4517-bbb9-89c13970b155 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:02.535033 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661f328-0241-4517-bbb9-89c13970b155 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:02.535320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661f328-0241-4517-bbb9-89c13970b155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:02.536263 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661f328-0241-4517-bbb9-89c13970b155 None admin] RBAC: Adding query filter params (role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2, scope.project.id=d81536229a89416692cd909ecd4bd4ec, user.id=bb405bf4f38249d1957087830723f0ea) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:02.536582 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661f328-0241-4517-bbb9-89c13970b155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:02.538027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661f328-0241-4517-bbb9-89c13970b155 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:02.546200 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 46/89] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:40:02 2022] GET /identity/v3/role_assignments?user.id=bb405bf4f38249d1957087830723f0ea&scope.project.id=d81536229a89416692cd909ecd4bd4ec&role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:02.546986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661f328-0241-4517-bbb9-89c13970b155 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:02.558100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:02.590785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:02.626008 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3158d-024e-48a8-bb2b-4a75864a5cba None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:02.659759 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661f328-0241-4517-bbb9-89c13970b155 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:02.667242 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beead6bd-7d53-44e2-916d-3c7995818932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:02.667931 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beead6bd-7d53-44e2-916d-3c7995818932 None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:02.668251 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beead6bd-7d53-44e2-916d-3c7995818932 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:02.668663 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beead6bd-7d53-44e2-916d-3c7995818932 None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:02.669415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beead6bd-7d53-44e2-916d-3c7995818932 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:02.670906 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beead6bd-7d53-44e2-916d-3c7995818932 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:02.697915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fec3a9-26f8-472d-a257-f2daff81c6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:02.698778 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fec3a9-26f8-472d-a257-f2daff81c6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:02.699064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fec3a9-26f8-472d-a257-f2daff81c6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:02.699349 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fec3a9-26f8-472d-a257-f2daff81c6d6 None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:02.700597 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fec3a9-26f8-472d-a257-f2daff81c6d6 None admin] RBAC: Authorizing `identity:get_project(project_id=d81536229a89416692cd909ecd4bd4ec)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:02.702038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fec3a9-26f8-472d-a257-f2daff81c6d6 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:02.703745 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 47/90] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:02 2022] GET /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:02.704549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fec3a9-26f8-472d-a257-f2daff81c6d6 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:02.730646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 44/91] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 16:40:02 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:40:02.731480 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beead6bd-7d53-44e2-916d-3c7995818932 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:02.850249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:02.858472 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fec3a9-26f8-472d-a257-f2daff81c6d6 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:02.861141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beead6bd-7d53-44e2-916d-3c7995818932 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:02.867771 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:02.898242 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd5a36-1e96-4e6f-821b-b670dd5000a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:02.899216 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd5a36-1e96-4e6f-821b-b670dd5000a2 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:02.900127 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd5a36-1e96-4e6f-821b-b670dd5000a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:02.900481 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd5a36-1e96-4e6f-821b-b670dd5000a2 None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:02.901835 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd5a36-1e96-4e6f-821b-b670dd5000a2 None admin] RBAC: Authorizing `identity:get_project(project_id=d81536229a89416692cd909ecd4bd4ec)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:02.903390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd5a36-1e96-4e6f-821b-b670dd5000a2 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:02.905550 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 45/92] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:02 2022] GET /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:02.906433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd5a36-1e96-4e6f-821b-b670dd5000a2 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:02.908330 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4f9be-1290-4555-a341-b7298905fce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:02.909205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4f9be-1290-4555-a341-b7298905fce4 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:02.909986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4f9be-1290-4555-a341-b7298905fce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:02.910477 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4f9be-1290-4555-a341-b7298905fce4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:02.998021 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4f9be-1290-4555-a341-b7298905fce4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:02.999515 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4f9be-1290-4555-a341-b7298905fce4 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:03.046677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd5a36-1e96-4e6f-821b-b670dd5000a2 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:03.090389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a38cc5-103a-4d07-8ff2-e33de324db0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:03.091065 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a38cc5-103a-4d07-8ff2-e33de324db0e None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:03.091347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a38cc5-103a-4d07-8ff2-e33de324db0e None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:03.091628 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a38cc5-103a-4d07-8ff2-e33de324db0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:03.092695 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a38cc5-103a-4d07-8ff2-e33de324db0e None admin] RBAC: Adding query filter params (role.id=459b0e5c21c94fb1b81f76c65780fdb5, scope.project.id=d81536229a89416692cd909ecd4bd4ec, user.id=2ba6ed129dc941f49c2206f6d2b62dfd) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:03.093573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a38cc5-103a-4d07-8ff2-e33de324db0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:03.095480 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a38cc5-103a-4d07-8ff2-e33de324db0e None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:03.103873 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 46/93] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:40:02 2022] GET /identity/v3/role_assignments?user.id=2ba6ed129dc941f49c2206f6d2b62dfd&scope.project.id=d81536229a89416692cd909ecd4bd4ec&role.id=459b0e5c21c94fb1b81f76c65780fdb5 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:03.104683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a38cc5-103a-4d07-8ff2-e33de324db0e None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:03.132422 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 48/94] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:03.139386 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4f9be-1290-4555-a341-b7298905fce4 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:03.152738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:03.153970 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:03.236504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a38cc5-103a-4d07-8ff2-e33de324db0e None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:03.264313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4f9be-1290-4555-a341-b7298905fce4 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:03.297057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d3fb4-d38f-447b-86e9-9b5fe1e705d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:03.298085 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d3fb4-d38f-447b-86e9-9b5fe1e705d0 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:03.298569 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d3fb4-d38f-447b-86e9-9b5fe1e705d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:03.299052 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d3fb4-d38f-447b-86e9-9b5fe1e705d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:03.300168 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d3fb4-d38f-447b-86e9-9b5fe1e705d0 None admin] RBAC: Adding query filter params (role.id=885a05785a714822b2012deb56880a73, scope.project.id=d81536229a89416692cd909ecd4bd4ec, user.id=bb405bf4f38249d1957087830723f0ea) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:03.300735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d3fb4-d38f-447b-86e9-9b5fe1e705d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:03.302398 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d3fb4-d38f-447b-86e9-9b5fe1e705d0 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:03.309209 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 47/95] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:40:03 2022] GET /identity/v3/role_assignments?user.id=bb405bf4f38249d1957087830723f0ea&scope.project.id=d81536229a89416692cd909ecd4bd4ec&role.id=885a05785a714822b2012deb56880a73 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:03.317618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380598ad-ec48-4d57-9b2d-5e209eb7e6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:03.318516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380598ad-ec48-4d57-9b2d-5e209eb7e6fe None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:03.318806 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380598ad-ec48-4d57-9b2d-5e209eb7e6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:03.319090 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380598ad-ec48-4d57-9b2d-5e209eb7e6fe None admin] PATH_INFO: `/v3/projects/135ff8cf5499444bb1f57bbb375a6d82` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:03.320575 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380598ad-ec48-4d57-9b2d-5e209eb7e6fe None admin] RBAC: Authorizing `identity:get_project(project_id=135ff8cf5499444bb1f57bbb375a6d82)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:03.322669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380598ad-ec48-4d57-9b2d-5e209eb7e6fe None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:03.324537 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 49/96] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:03 2022] GET /identity/v3/projects/135ff8cf5499444bb1f57bbb375a6d82 => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:03.330802 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d3fb4-d38f-447b-86e9-9b5fe1e705d0 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:03.474206 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:03.489217 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d3fb4-d38f-447b-86e9-9b5fe1e705d0 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:03.530891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52595ebb-c719-49b0-bbef-b2de28b8445f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:03.531537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52595ebb-c719-49b0-bbef-b2de28b8445f None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:03.531830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52595ebb-c719-49b0-bbef-b2de28b8445f None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:03.532128 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52595ebb-c719-49b0-bbef-b2de28b8445f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:03.533191 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52595ebb-c719-49b0-bbef-b2de28b8445f None admin] RBAC: Adding query filter params (role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2, scope.project.id=135ff8cf5499444bb1f57bbb375a6d82, user.id=bb405bf4f38249d1957087830723f0ea) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:03.533511 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52595ebb-c719-49b0-bbef-b2de28b8445f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:03.534972 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52595ebb-c719-49b0-bbef-b2de28b8445f None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:03.541220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 48/97] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:40:03 2022] GET /identity/v3/role_assignments?user.id=bb405bf4f38249d1957087830723f0ea&scope.project.id=135ff8cf5499444bb1f57bbb375a6d82&role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:05.502281 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c5159-5c3e-4a45-b88f-e10b0e7a2073 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:05.502828 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c5159-5c3e-4a45-b88f-e10b0e7a2073 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:05.503137 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c5159-5c3e-4a45-b88f-e10b0e7a2073 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:05.504695 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 50/98] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:05.510127 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d9b80-5c45-4769-8c8e-834fa0fee946 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:05.510549 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d9b80-5c45-4769-8c8e-834fa0fee946 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:05.510884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d9b80-5c45-4769-8c8e-834fa0fee946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:05.537548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-851d9b80-5c45-4769-8c8e-834fa0fee946 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:05.538772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-851d9b80-5c45-4769-8c8e-834fa0fee946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:05.638738 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 49/99] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:05.673834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c5159-5c3e-4a45-b88f-e10b0e7a2073 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:05.716654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bdf3f-f847-421e-ba43-25a993327314 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:05.716963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bdf3f-f847-421e-ba43-25a993327314 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:05.717230 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bdf3f-f847-421e-ba43-25a993327314 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:05.718632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 50/100] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:40:05.723862 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef974e-5d16-4ae4-bc62-f1eb572bfc80 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:05.724185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef974e-5d16-4ae4-bc62-f1eb572bfc80 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:05.724467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef974e-5d16-4ae4-bc62-f1eb572bfc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:05.753231 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-07ef974e-5d16-4ae4-bc62-f1eb572bfc80 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:05.754377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-07ef974e-5d16-4ae4-bc62-f1eb572bfc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:05.793141 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:05.836504 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c5159-5c3e-4a45-b88f-e10b0e7a2073 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:05.910522 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108e775-5433-4634-8de3-c41ac9119dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:05.911325 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108e775-5433-4634-8de3-c41ac9119dfe None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:05.911617 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108e775-5433-4634-8de3-c41ac9119dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:05.911896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108e775-5433-4634-8de3-c41ac9119dfe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:05.918699 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 51/101] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:05.940317 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108e775-5433-4634-8de3-c41ac9119dfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:05.952892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-e108e775-5433-4634-8de3-c41ac9119dfe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:05.952892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:05.952892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:05.952892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:05.952892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:05.952892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:05.952892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:05.952892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:05.952892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:05.952892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:05.952892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:05.952892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:05.952892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:05.952892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:05.952892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:05.952892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:05.953744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:05.953744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:05.953744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:05.953744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:05.953744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:05.953744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:05.953744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:05.953744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:05.953744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:05.953744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:05.953744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:05.953744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:05.953744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:05.953744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:05.953744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:05.953744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:05.954509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:05.954509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:05.954509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:05.954509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:05.954509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:05.954509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:05.954509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:05.954509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:05.954509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:05.954509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:05.954509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:05.954509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:05.954509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 51/102] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:05.960326 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef974e-5d16-4ae4-bc62-f1eb572bfc80 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:05.972400 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108e775-5433-4634-8de3-c41ac9119dfe None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:05.996734 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:06.190220 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108e775-5433-4634-8de3-c41ac9119dfe None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:06.195440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef974e-5d16-4ae4-bc62-f1eb572bfc80 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:06.231906 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d961f4-1a8b-4953-a4df-dd5d97969fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:06.232622 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d961f4-1a8b-4953-a4df-dd5d97969fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:06.233064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d961f4-1a8b-4953-a4df-dd5d97969fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:06.233488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d961f4-1a8b-4953-a4df-dd5d97969fd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:06.234389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d961f4-1a8b-4953-a4df-dd5d97969fd3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:06.234829 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d961f4-1a8b-4953-a4df-dd5d97969fd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:06.236406 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d961f4-1a8b-4953-a4df-dd5d97969fd3 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:06.238232 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c313ca-856c-47f3-93c3-2853fd7ac4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:06.239352 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c313ca-856c-47f3-93c3-2853fd7ac4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:06.239839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c313ca-856c-47f3-93c3-2853fd7ac4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:06.240385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c313ca-856c-47f3-93c3-2853fd7ac4b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:06.242525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:06.245012 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 52/103] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:06.246271 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a4041-bb7f-413c-b2d0-8bcaccbb549a None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:06.246564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a4041-bb7f-413c-b2d0-8bcaccbb549a None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:06.246844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a4041-bb7f-413c-b2d0-8bcaccbb549a None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:06.252702 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 53/104] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:06.253921 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d3656-5e52-4018-9446-5f2553008aba None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:06.254216 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d3656-5e52-4018-9446-5f2553008aba None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:06.254501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d3656-5e52-4018-9446-5f2553008aba None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:06.254970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c313ca-856c-47f3-93c3-2853fd7ac4b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:06.260628 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 54/105] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:06.261529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d3656-5e52-4018-9446-5f2553008aba None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:06.264988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-b5c313ca-856c-47f3-93c3-2853fd7ac4b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:40:06.264988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:06.264988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:06.264988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:06.264988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:06.264988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:06.264988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:06.264988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:06.264988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:06.264988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:06.264988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:06.264988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:06.264988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:06.264988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:06.264988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:06.264988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:06.269429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:06.269429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:06.269429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:06.269429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:06.269429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:06.269429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:06.269429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:06.269429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:06.269429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:06.269429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:06.269429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:06.269429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:06.269429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:06.269429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:06.269429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:06.269429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:06.270186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:06.270186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:06.270186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:06.270186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:06.270186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:06.270186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:06.270186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:06.270186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:06.270186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:06.270186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:06.270186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:40:06.270186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:06.270186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 52/106] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:40:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:06.270186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356b9fe-3a95-43a5-b9dc-fc74047595b9 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:06.270865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356b9fe-3a95-43a5-b9dc-fc74047595b9 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:06.270865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356b9fe-3a95-43a5-b9dc-fc74047595b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:06.287076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-3356b9fe-3a95-43a5-b9dc-fc74047595b9 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:06.289582 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-3356b9fe-3a95-43a5-b9dc-fc74047595b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:06.346302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:06.364363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 53/107] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:06.365634 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0382811-de7a-4f97-988d-881cb18e2860 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:06.365937 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0382811-de7a-4f97-988d-881cb18e2860 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:06.366371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0382811-de7a-4f97-988d-881cb18e2860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:06.371297 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d3656-5e52-4018-9446-5f2553008aba None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:06.387029 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-b0382811-de7a-4f97-988d-881cb18e2860 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:06.388794 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b0382811-de7a-4f97-988d-881cb18e2860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:06.411350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c9638-8d98-40dd-be10-d50c5cfff935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:06.412258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c9638-8d98-40dd-be10-d50c5cfff935 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:06.412549 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c9638-8d98-40dd-be10-d50c5cfff935 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:06.412827 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c9638-8d98-40dd-be10-d50c5cfff935 None admin] PATH_INFO: `/v3/users/bb405bf4f38249d1957087830723f0ea` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:06.414384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c9638-8d98-40dd-be10-d50c5cfff935 None admin] RBAC: Authorizing `identity:get_user(user_id=bb405bf4f38249d1957087830723f0ea)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:06.416037 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c9638-8d98-40dd-be10-d50c5cfff935 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:06.417737 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 55/108] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:06 2022] GET /identity/v3/users/bb405bf4f38249d1957087830723f0ea => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:06.418500 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c9638-8d98-40dd-be10-d50c5cfff935 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:06.463470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 54/109] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:06.464651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83de9c-55c3-43df-b258-df9260a90ae2 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:06.464944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83de9c-55c3-43df-b258-df9260a90ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:06.465227 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83de9c-55c3-43df-b258-df9260a90ae2 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:06.466575 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 55/110] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:06.467192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83de9c-55c3-43df-b258-df9260a90ae2 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:06.529960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:06.531326 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c9638-8d98-40dd-be10-d50c5cfff935 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:06.570267 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7b916-8587-4a46-9101-17158adbb2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:06.571620 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7b916-8587-4a46-9101-17158adbb2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:06.571911 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7b916-8587-4a46-9101-17158adbb2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:06.572223 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7b916-8587-4a46-9101-17158adbb2c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:06.572982 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7b916-8587-4a46-9101-17158adbb2c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:06.573298 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7b916-8587-4a46-9101-17158adbb2c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:06.574679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7b916-8587-4a46-9101-17158adbb2c0 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:06.579928 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83de9c-55c3-43df-b258-df9260a90ae2 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:06.583103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 56/111] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:06.583923 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7b916-8587-4a46-9101-17158adbb2c0 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:06.594644 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:06.621006 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8fe3b-69f1-49d5-9150-6bb15f1a793b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:06.621801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8fe3b-69f1-49d5-9150-6bb15f1a793b None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:06.622083 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8fe3b-69f1-49d5-9150-6bb15f1a793b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:06.622363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8fe3b-69f1-49d5-9150-6bb15f1a793b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:06.632896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8fe3b-69f1-49d5-9150-6bb15f1a793b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:06.641426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-0ec8fe3b-69f1-49d5-9150-6bb15f1a793b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 16:40:06.641426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:06.641426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:06.641426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:06.641426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:06.641426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:06.641426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:06.641426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:06.641426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:06.641426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:06.641426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:06.641426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:06.641426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:06.641426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:06.641426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:06.641426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:06.642495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:06.642495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:06.642495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:06.642495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:06.642495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:06.642495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:06.642495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:06.642495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:06.642495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:06.642495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:06.642495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:06.642495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:06.642495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:06.642495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:06.642495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:06.642495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:06.643283 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:06.643283 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:06.643283 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:06.643283 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:06.643283 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:06.643283 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:06.643283 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:06.643283 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:06.643283 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:06.643283 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:06.643283 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 16:40:06.643283 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:06.643283 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 56/112] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:06.643925 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44be27-7e0a-499a-a045-d20291582210 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:06.644044 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44be27-7e0a-499a-a045-d20291582210 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:06.644350 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44be27-7e0a-499a-a045-d20291582210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:06.660534 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-8d44be27-7e0a-499a-a045-d20291582210 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:06.661696 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-8d44be27-7e0a-499a-a045-d20291582210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:06.692620 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7b916-8587-4a46-9101-17158adbb2c0 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:06.727158 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 57/113] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:06.728303 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44be27-7e0a-499a-a045-d20291582210 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:06.732407 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0594d-a8e4-4dcc-a10c-c7f96e67ab42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:06.733312 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0594d-a8e4-4dcc-a10c-c7f96e67ab42 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:06.733609 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0594d-a8e4-4dcc-a10c-c7f96e67ab42 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:06.733898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0594d-a8e4-4dcc-a10c-c7f96e67ab42 None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:06.735155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0594d-a8e4-4dcc-a10c-c7f96e67ab42 None admin] RBAC: Authorizing `identity:get_project(project_id=d81536229a89416692cd909ecd4bd4ec)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:06.737083 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0594d-a8e4-4dcc-a10c-c7f96e67ab42 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:06.744660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 57/114] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:06 2022] GET /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:06.744660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0594d-a8e4-4dcc-a10c-c7f96e67ab42 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:06.773684 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:06.818328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:06.827616 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44be27-7e0a-499a-a045-d20291582210 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:06.844641 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0594d-a8e4-4dcc-a10c-c7f96e67ab42 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:06.866051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc09d31-43a4-4086-9eb8-3ad3d9b7ed79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:06.866939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc09d31-43a4-4086-9eb8-3ad3d9b7ed79 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:06.867221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc09d31-43a4-4086-9eb8-3ad3d9b7ed79 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:06.867497 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc09d31-43a4-4086-9eb8-3ad3d9b7ed79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:06.878208 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc09d31-43a4-4086-9eb8-3ad3d9b7ed79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:06.880781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba65714-d31d-4633-8619-0b978e5b07f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:06.881665 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba65714-d31d-4633-8619-0b978e5b07f6 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:06.881954 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba65714-d31d-4633-8619-0b978e5b07f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:06.882239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba65714-d31d-4633-8619-0b978e5b07f6 None admin] PATH_INFO: `/v3/users/2ba6ed129dc941f49c2206f6d2b62dfd` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:06.883475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba65714-d31d-4633-8619-0b978e5b07f6 None admin] RBAC: Authorizing `identity:get_user(user_id=2ba6ed129dc941f49c2206f6d2b62dfd)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:06.885597 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba65714-d31d-4633-8619-0b978e5b07f6 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:06.886799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-6dc09d31-43a4-4086-9eb8-3ad3d9b7ed79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:06.886799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:06.886799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:06.886799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:06.886799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:06.886799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:06.886799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:06.886799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:06.886799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:06.886799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:06.886799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:06.886799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:06.886799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:06.886799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:06.886799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:06.886799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:06.887938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:06.887938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:06.887938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:06.887938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:06.887938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:06.887938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:06.887938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:06.887938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:06.887938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:06.887938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:06.887938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:06.887938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:06.887938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:06.887938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:06.887938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:06.887938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:06.888762 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:06.888762 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:06.888762 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:06.888762 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:06.888762 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:06.888762 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:06.888762 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:06.888762 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:06.888762 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:06.888762 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:06.888762 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:06.888762 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:06.889339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 58/115] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:06 2022] GET /identity/v3/users/2ba6ed129dc941f49c2206f6d2b62dfd => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:06.889339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba65714-d31d-4633-8619-0b978e5b07f6 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:06.889463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 58/116] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:40:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:06.893675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198d5cd-910c-4703-969a-964059437f85 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:06.893806 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198d5cd-910c-4703-969a-964059437f85 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:06.894017 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198d5cd-910c-4703-969a-964059437f85 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:06.895450 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 59/117] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:06.899191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198d5cd-910c-4703-969a-964059437f85 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:06.990570 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba65714-d31d-4633-8619-0b978e5b07f6 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:06.997139 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198d5cd-910c-4703-969a-964059437f85 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:06.999794 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:07.027044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86217f81-2d3a-4b63-8948-5821b2bd0952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:07.027782 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86217f81-2d3a-4b63-8948-5821b2bd0952 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:07.028160 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86217f81-2d3a-4b63-8948-5821b2bd0952 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:07.028450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86217f81-2d3a-4b63-8948-5821b2bd0952 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:07.029237 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86217f81-2d3a-4b63-8948-5821b2bd0952 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:07.029546 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86217f81-2d3a-4b63-8948-5821b2bd0952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:07.031022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86217f81-2d3a-4b63-8948-5821b2bd0952 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:07.031590 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc8a0d-dc16-47bf-a643-f56d3f50b441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:07.032701 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc8a0d-dc16-47bf-a643-f56d3f50b441 None admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:07.033372 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc8a0d-dc16-47bf-a643-f56d3f50b441 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:07.033653 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc8a0d-dc16-47bf-a643-f56d3f50b441 None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec/users/bb405bf4f38249d1957087830723f0ea/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:07.035689 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc8a0d-dc16-47bf-a643-f56d3f50b441 None admin] RBAC: Authorizing `identity:create_grant(project_id=d81536229a89416692cd909ecd4bd4ec, user_id=bb405bf4f38249d1957087830723f0ea, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:07.037158 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc8a0d-dc16-47bf-a643-f56d3f50b441 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:07.041007 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 59/118] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:07.041796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86217f81-2d3a-4b63-8948-5821b2bd0952 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:07.050537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:07.135339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86217f81-2d3a-4b63-8948-5821b2bd0952 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:07.140251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 60/119] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:40:06 2022] PUT /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec/users/bb405bf4f38249d1957087830723f0ea/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:40:07.152394 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc8a0d-dc16-47bf-a643-f56d3f50b441 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:07.172957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22064b84-2032-4e81-993e-331ade50fc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:07.173743 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22064b84-2032-4e81-993e-331ade50fc32 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:07.174038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22064b84-2032-4e81-993e-331ade50fc32 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:07.174317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22064b84-2032-4e81-993e-331ade50fc32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:07.175578 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22064b84-2032-4e81-993e-331ade50fc32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:07.177143 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22064b84-2032-4e81-993e-331ade50fc32 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:07.179022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 60/120] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:40:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:07.179642 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22064b84-2032-4e81-993e-331ade50fc32 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:07.268276 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:07.271722 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc8a0d-dc16-47bf-a643-f56d3f50b441 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:07.301622 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22064b84-2032-4e81-993e-331ade50fc32 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:07.312618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67464c7d-9b9d-4687-b669-c780c18be50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:07.313716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67464c7d-9b9d-4687-b669-c780c18be50c None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:07.314146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67464c7d-9b9d-4687-b669-c780c18be50c None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:07.314601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67464c7d-9b9d-4687-b669-c780c18be50c None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:07.315986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67464c7d-9b9d-4687-b669-c780c18be50c None admin] RBAC: Authorizing `identity:get_project(project_id=d81536229a89416692cd909ecd4bd4ec)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:07.317690 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67464c7d-9b9d-4687-b669-c780c18be50c None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:07.319562 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 61/121] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:07 2022] GET /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:07.321025 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f346aa-a9b5-43f8-aa9b-c96ba60bd889 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:07.321450 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f346aa-a9b5-43f8-aa9b-c96ba60bd889 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:07.321852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f346aa-a9b5-43f8-aa9b-c96ba60bd889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:07.337816 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987d1b4-d75b-424e-aace-5081eb8f5307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:07.338573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987d1b4-d75b-424e-aace-5081eb8f5307 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:07.338861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987d1b4-d75b-424e-aace-5081eb8f5307 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:07.338957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-65f346aa-a9b5-43f8-aa9b-c96ba60bd889 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:07.339143 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987d1b4-d75b-424e-aace-5081eb8f5307 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:07.339905 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987d1b4-d75b-424e-aace-5081eb8f5307 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:07.340200 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-65f346aa-a9b5-43f8-aa9b-c96ba60bd889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:07.340293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987d1b4-d75b-424e-aace-5081eb8f5307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:07.341619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987d1b4-d75b-424e-aace-5081eb8f5307 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:07.351111 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 61/122] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:40:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:07.352023 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987d1b4-d75b-424e-aace-5081eb8f5307 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:07.367882 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:07.410877 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 62/123] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:07.411650 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f346aa-a9b5-43f8-aa9b-c96ba60bd889 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:07.463599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987d1b4-d75b-424e-aace-5081eb8f5307 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:07.499831 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c483b-baea-4102-af50-57d0cc3431e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:07.500829 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c483b-baea-4102-af50-57d0cc3431e4 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:07.501127 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c483b-baea-4102-af50-57d0cc3431e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:07.501490 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c483b-baea-4102-af50-57d0cc3431e4 None admin] PATH_INFO: `/v3/users/c6ffc54f342f412f97331b94a3c786cf` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:07.505299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:07.516687 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c483b-baea-4102-af50-57d0cc3431e4 None admin] RBAC: Authorizing `identity:get_user(user_id=c6ffc54f342f412f97331b94a3c786cf)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:07.518244 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c483b-baea-4102-af50-57d0cc3431e4 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:07.519862 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 62/124] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:07 2022] GET /identity/v3/users/c6ffc54f342f412f97331b94a3c786cf => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:07.524616 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f346aa-a9b5-43f8-aa9b-c96ba60bd889 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:07.525437 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c483b-baea-4102-af50-57d0cc3431e4 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:07.559210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a64ce-aa91-41c0-b975-15d177ba33f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:07.559869 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a64ce-aa91-41c0-b975-15d177ba33f8 None admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:07.560216 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a64ce-aa91-41c0-b975-15d177ba33f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:07.560466 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a64ce-aa91-41c0-b975-15d177ba33f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:07.561188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a64ce-aa91-41c0-b975-15d177ba33f8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:07.562723 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a64ce-aa91-41c0-b975-15d177ba33f8 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:07.624410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c483b-baea-4102-af50-57d0cc3431e4 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:07.652142 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 63/125] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 16:40:07 2022] POST /identity/v3/projects => generated 302 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:40:07.652142 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a64ce-aa91-41c0-b975-15d177ba33f8 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:07.660164 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61614a3-7a66-434b-8883-f60902225e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:07.661241 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61614a3-7a66-434b-8883-f60902225e32 None admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:07.661481 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61614a3-7a66-434b-8883-f60902225e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:07.661762 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61614a3-7a66-434b-8883-f60902225e32 None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec/users/2ba6ed129dc941f49c2206f6d2b62dfd/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:07.664034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61614a3-7a66-434b-8883-f60902225e32 None admin] RBAC: Authorizing `identity:create_grant(project_id=d81536229a89416692cd909ecd4bd4ec, user_id=2ba6ed129dc941f49c2206f6d2b62dfd, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:07.666422 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61614a3-7a66-434b-8883-f60902225e32 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:07.674441 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:07.755723 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 63/126] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:40:07 2022] PUT /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec/users/2ba6ed129dc941f49c2206f6d2b62dfd/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:40:07.755723 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61614a3-7a66-434b-8883-f60902225e32 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:07.804347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a64ce-aa91-41c0-b975-15d177ba33f8 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:07.857019 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:07.860996 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873f148-3e81-4b24-9ed4-792be22ff447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:07.863701 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873f148-3e81-4b24-9ed4-792be22ff447 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:07.864382 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873f148-3e81-4b24-9ed4-792be22ff447 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:07.864827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873f148-3e81-4b24-9ed4-792be22ff447 None admin] PATH_INFO: `/v3/users/bb405bf4f38249d1957087830723f0ea` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:07.867839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873f148-3e81-4b24-9ed4-792be22ff447 None admin] RBAC: Authorizing `identity:get_user(user_id=bb405bf4f38249d1957087830723f0ea)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:07.869609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873f148-3e81-4b24-9ed4-792be22ff447 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:07.872365 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 64/127] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:07 2022] GET /identity/v3/users/bb405bf4f38249d1957087830723f0ea => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:07.874125 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873f148-3e81-4b24-9ed4-792be22ff447 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:07.923007 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61614a3-7a66-434b-8883-f60902225e32 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:07.970708 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a92493-26f5-4682-a347-ae77fe78a4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:07.971507 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a92493-26f5-4682-a347-ae77fe78a4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:07.971793 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a92493-26f5-4682-a347-ae77fe78a4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:07.972072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a92493-26f5-4682-a347-ae77fe78a4c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:07.983512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a92493-26f5-4682-a347-ae77fe78a4c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:07.991433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-b7a92493-26f5-4682-a347-ae77fe78a4c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:07.991433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:07.991433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:07.991433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:07.991433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:07.991433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:07.991433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:07.991433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:07.991433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:07.991433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:07.991433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:07.991433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:07.991433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:07.991433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:07.991433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:07.991433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:07.992378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:07.992378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:07.992378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:07.992378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:07.992378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:07.992378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:07.992378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:07.992378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:07.992378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:07.992378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:07.992378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:07.992378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:07.992378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:07.992378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:07.992378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:07.992378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:07.993198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:07.993198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:07.993198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:07.993198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:07.993198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:07.993198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:07.993198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:07.993198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:07.993198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:07.993198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:07.993198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:07.993198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:07.993198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 64/128] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:07.993846 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a92493-26f5-4682-a347-ae77fe78a4c7 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:07.995480 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:08.020439 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873f148-3e81-4b24-9ed4-792be22ff447 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:08.068915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7f04a-e2e4-4644-bc4f-75df9bc4f521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:08.069815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7f04a-e2e4-4644-bc4f-75df9bc4f521 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:08.070249 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7f04a-e2e4-4644-bc4f-75df9bc4f521 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:08.070694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7f04a-e2e4-4644-bc4f-75df9bc4f521 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:08.119728 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a92493-26f5-4682-a347-ae77fe78a4c7 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:08.140221 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:08.170879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7f04a-e2e4-4644-bc4f-75df9bc4f521 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:08.171074 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb658b-aca7-46c2-bdad-9e948318fa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:08.172080 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb658b-aca7-46c2-bdad-9e948318fa5b None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:08.172559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb658b-aca7-46c2-bdad-9e948318fa5b None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:08.172857 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7f04a-e2e4-4644-bc4f-75df9bc4f521 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:08.173184 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb658b-aca7-46c2-bdad-9e948318fa5b None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:08.174554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb658b-aca7-46c2-bdad-9e948318fa5b None admin] RBAC: Authorizing `identity:get_project(project_id=d81536229a89416692cd909ecd4bd4ec)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:08.177413 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb658b-aca7-46c2-bdad-9e948318fa5b None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:08.179508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 65/129] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:07 2022] GET /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:08.181035 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb658b-aca7-46c2-bdad-9e948318fa5b None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:08.268571 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:08.282045 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 65/130] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:08.283008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7f04a-e2e4-4644-bc4f-75df9bc4f521 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:08.382097 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb658b-aca7-46c2-bdad-9e948318fa5b None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:08.391853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7f04a-e2e4-4644-bc4f-75df9bc4f521 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:08.431030 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc260b4-e754-4d5d-8a61-54f20aa0a7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:08.432295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc260b4-e754-4d5d-8a61-54f20aa0a7b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:08.432679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc260b4-e754-4d5d-8a61-54f20aa0a7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:08.433061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc260b4-e754-4d5d-8a61-54f20aa0a7b6 None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec/users/bb405bf4f38249d1957087830723f0ea/roles/885a05785a714822b2012deb56880a73` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:08.436081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc260b4-e754-4d5d-8a61-54f20aa0a7b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d81536229a89416692cd909ecd4bd4ec, user_id=bb405bf4f38249d1957087830723f0ea, role_id=885a05785a714822b2012deb56880a73)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:08.444129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc260b4-e754-4d5d-8a61-54f20aa0a7b6 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:08.448445 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d446db3-2742-41bd-88ad-3166588dbd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:08.449123 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d446db3-2742-41bd-88ad-3166588dbd84 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:08.449408 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d446db3-2742-41bd-88ad-3166588dbd84 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:08.449757 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d446db3-2742-41bd-88ad-3166588dbd84 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:08.450528 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d446db3-2742-41bd-88ad-3166588dbd84 None admin] RBAC: Adding query filter params (name=member) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:08.450836 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d446db3-2742-41bd-88ad-3166588dbd84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:08.452327 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d446db3-2742-41bd-88ad-3166588dbd84 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:08.461328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 66/131] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:08.462169 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d446db3-2742-41bd-88ad-3166588dbd84 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:08.509765 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:08.535472 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 66/132] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:40:08 2022] PUT /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec/users/bb405bf4f38249d1957087830723f0ea/roles/885a05785a714822b2012deb56880a73 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:40:08.536401 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc260b4-e754-4d5d-8a61-54f20aa0a7b6 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:08.626005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d446db3-2742-41bd-88ad-3166588dbd84 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:08.630506 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:08.690348 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcc528-7b3b-4fd3-96b9-a4cc45b1a632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:08.691145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcc528-7b3b-4fd3-96b9-a4cc45b1a632 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:08.691501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcc528-7b3b-4fd3-96b9-a4cc45b1a632 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:08.691793 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcc528-7b3b-4fd3-96b9-a4cc45b1a632 None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:08.693125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcc528-7b3b-4fd3-96b9-a4cc45b1a632 None admin] RBAC: Authorizing `identity:get_project(project_id=d81536229a89416692cd909ecd4bd4ec)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:08.694599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcc528-7b3b-4fd3-96b9-a4cc45b1a632 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:08.700135 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 67/133] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:08 2022] GET /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:08.702434 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcc528-7b3b-4fd3-96b9-a4cc45b1a632 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:08.740925 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc260b4-e754-4d5d-8a61-54f20aa0a7b6 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:08.778316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bee20b-45fc-42e0-8483-a8ca27c27458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:08.779253 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bee20b-45fc-42e0-8483-a8ca27c27458 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:08.779544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bee20b-45fc-42e0-8483-a8ca27c27458 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:08.779824 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bee20b-45fc-42e0-8483-a8ca27c27458 None admin] PATH_INFO: `/v3/users/bb405bf4f38249d1957087830723f0ea` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:08.781127 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bee20b-45fc-42e0-8483-a8ca27c27458 None admin] RBAC: Authorizing `identity:get_user(user_id=bb405bf4f38249d1957087830723f0ea)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:08.782746 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bee20b-45fc-42e0-8483-a8ca27c27458 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:08.785226 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 67/134] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:08 2022] GET /identity/v3/users/bb405bf4f38249d1957087830723f0ea => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:08.792838 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bee20b-45fc-42e0-8483-a8ca27c27458 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:08.870277 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcc528-7b3b-4fd3-96b9-a4cc45b1a632 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:08.887744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:08.920708 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfa7bc-4efd-4c5d-bdce-7247caca6510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:08.921478 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfa7bc-4efd-4c5d-bdce-7247caca6510 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:08.921859 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfa7bc-4efd-4c5d-bdce-7247caca6510 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:08.922160 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfa7bc-4efd-4c5d-bdce-7247caca6510 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:08.923017 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bfa7bc-4efd-4c5d-bdce-7247caca6510 None admin] RBAC: Adding query filter params (role.id=434b9e3fd1f6417689c6bd184fbdb7e6, scope.project.id=d81536229a89416692cd909ecd4bd4ec, user.id=c6ffc54f342f412f97331b94a3c786cf) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:08.923337 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bfa7bc-4efd-4c5d-bdce-7247caca6510 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:08.924916 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bfa7bc-4efd-4c5d-bdce-7247caca6510 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:08.935572 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 68/135] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:40:08 2022] GET /identity/v3/role_assignments?user.id=c6ffc54f342f412f97331b94a3c786cf&scope.project.id=d81536229a89416692cd909ecd4bd4ec&role.id=434b9e3fd1f6417689c6bd184fbdb7e6 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:08.936944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bee20b-45fc-42e0-8483-a8ca27c27458 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:08.949506 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:08.979565 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd90686-15ad-4ee6-85f8-cbdd14d860a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:08.980486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd90686-15ad-4ee6-85f8-cbdd14d860a6 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:08.980912 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd90686-15ad-4ee6-85f8-cbdd14d860a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:08.981200 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd90686-15ad-4ee6-85f8-cbdd14d860a6 None admin] PATH_INFO: `/v3/projects/135ff8cf5499444bb1f57bbb375a6d82` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:08.982766 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd90686-15ad-4ee6-85f8-cbdd14d860a6 None admin] RBAC: Authorizing `identity:get_project(project_id=135ff8cf5499444bb1f57bbb375a6d82)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:08.984314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd90686-15ad-4ee6-85f8-cbdd14d860a6 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:08.986685 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 68/136] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:08 2022] GET /identity/v3/projects/135ff8cf5499444bb1f57bbb375a6d82 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:08.991908 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfa7bc-4efd-4c5d-bdce-7247caca6510 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:09.134309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfa7bc-4efd-4c5d-bdce-7247caca6510 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:09.171996 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7abfa-94d8-496d-97df-b03a1d59ddc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:09.172922 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7abfa-94d8-496d-97df-b03a1d59ddc9 None admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:09.173210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7abfa-94d8-496d-97df-b03a1d59ddc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:09.173498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7abfa-94d8-496d-97df-b03a1d59ddc9 None admin] PATH_INFO: `/v3/projects/135ff8cf5499444bb1f57bbb375a6d82/users/bb405bf4f38249d1957087830723f0ea/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:09.175516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7abfa-94d8-496d-97df-b03a1d59ddc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=135ff8cf5499444bb1f57bbb375a6d82, user_id=bb405bf4f38249d1957087830723f0ea, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:09.177015 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7abfa-94d8-496d-97df-b03a1d59ddc9 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:09.262846 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 69/137] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:40:08 2022] PUT /identity/v3/projects/135ff8cf5499444bb1f57bbb375a6d82/users/bb405bf4f38249d1957087830723f0ea/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:40:09.681865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aafd8-c93a-466c-93d8-2398adad87c0 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:09.682358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aafd8-c93a-466c-93d8-2398adad87c0 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:09.682430 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aafd8-c93a-466c-93d8-2398adad87c0 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:09.683793 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 69/138] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:09.689122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c9e60-579a-41b4-a714-8b08fa9bfc18 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:09.689502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c9e60-579a-41b4-a714-8b08fa9bfc18 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:09.689691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c9e60-579a-41b4-a714-8b08fa9bfc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:09.710223 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-c04c9e60-579a-41b4-a714-8b08fa9bfc18 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:09.711511 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c04c9e60-579a-41b4-a714-8b08fa9bfc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:09.746277 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:09.791717 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 70/139] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:09.840495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4aafd8-c93a-466c-93d8-2398adad87c0 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:09.956916 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4aafd8-c93a-466c-93d8-2398adad87c0 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:09.991555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba08dda-b04b-4391-9b8c-973b009fe936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:09.992377 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba08dda-b04b-4391-9b8c-973b009fe936 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:09.992665 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba08dda-b04b-4391-9b8c-973b009fe936 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:09.993504 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba08dda-b04b-4391-9b8c-973b009fe936 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:10.003621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba08dda-b04b-4391-9b8c-973b009fe936 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:10.015314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-bba08dda-b04b-4391-9b8c-973b009fe936 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:10.015314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:10.015314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:10.015314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:10.015314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:10.015314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:10.015314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:10.015314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:10.015314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:10.015314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:10.015314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:10.015314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:10.015314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:10.015314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:10.015314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:10.015314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:10.016202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:10.016202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:10.016202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:10.016202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:10.016202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:10.016202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:10.016202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:10.016202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:10.016202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:10.016202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:10.016202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:10.016202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:10.016202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:10.016202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:10.016202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:10.016202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:10.016974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:10.016974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:10.016974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:10.016974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:10.016974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:10.016974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:10.016974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:10.016974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:10.016974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:10.016974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:10.016974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:10.016974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:10.016974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 70/140] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:10.022427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c9e60-579a-41b4-a714-8b08fa9bfc18 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:10.140968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c9e60-579a-41b4-a714-8b08fa9bfc18 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:10.192075 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b64faf-4388-4767-a395-e3e6f00bb1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:10.192791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b64faf-4388-4767-a395-e3e6f00bb1ea None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:10.193082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b64faf-4388-4767-a395-e3e6f00bb1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:10.193363 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b64faf-4388-4767-a395-e3e6f00bb1ea None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:10.194146 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b64faf-4388-4767-a395-e3e6f00bb1ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:10.194464 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b64faf-4388-4767-a395-e3e6f00bb1ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:10.196082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b64faf-4388-4767-a395-e3e6f00bb1ea None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:10.205011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 71/141] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:10.210734 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba08dda-b04b-4391-9b8c-973b009fe936 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:10.252979 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:10.314679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba08dda-b04b-4391-9b8c-973b009fe936 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:10.350162 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309ed1c-d1c5-4e09-a8f1-02b954704365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:10.351045 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309ed1c-d1c5-4e09-a8f1-02b954704365 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:10.351335 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309ed1c-d1c5-4e09-a8f1-02b954704365 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:10.351618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309ed1c-d1c5-4e09-a8f1-02b954704365 None admin] PATH_INFO: `/v3/users/bb405bf4f38249d1957087830723f0ea` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:10.353414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309ed1c-d1c5-4e09-a8f1-02b954704365 None admin] RBAC: Authorizing `identity:get_user(user_id=bb405bf4f38249d1957087830723f0ea)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:10.355044 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309ed1c-d1c5-4e09-a8f1-02b954704365 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:10.356734 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 71/142] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:10 2022] GET /identity/v3/users/bb405bf4f38249d1957087830723f0ea => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:10.362562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b64faf-4388-4767-a395-e3e6f00bb1ea None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:10.400984 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:10.494143 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b64faf-4388-4767-a395-e3e6f00bb1ea None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:10.533781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892240e-6271-4338-b833-e4aa7b3bf5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:10.534438 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892240e-6271-4338-b833-e4aa7b3bf5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:10.534725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892240e-6271-4338-b833-e4aa7b3bf5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:10.535006 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892240e-6271-4338-b833-e4aa7b3bf5a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:10.553712 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0865f7b-a5ce-4785-879e-cb6ae238c9a1 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:10.554002 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0865f7b-a5ce-4785-879e-cb6ae238c9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:10.554294 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0865f7b-a5ce-4785-879e-cb6ae238c9a1 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:10.555705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 72/143] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:10.561388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4000ae-5976-4cd8-bde6-b50b21a58156 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:10.561684 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4000ae-5976-4cd8-bde6-b50b21a58156 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:10.561976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4000ae-5976-4cd8-bde6-b50b21a58156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:10.609182 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-5d4000ae-5976-4cd8-bde6-b50b21a58156 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:10.612427 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-5d4000ae-5976-4cd8-bde6-b50b21a58156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:10.641773 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892240e-6271-4338-b833-e4aa7b3bf5a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:10.643625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892240e-6271-4338-b833-e4aa7b3bf5a9 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:10.697573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:10.745849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 73/144] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:10.761030 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb8133-c8bd-44b1-9542-a1938f9eb93d None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:10.761332 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb8133-c8bd-44b1-9542-a1938f9eb93d None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:10.761675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb8133-c8bd-44b1-9542-a1938f9eb93d None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:10.763303 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 74/145] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:40:10.769383 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886c03e-8af1-4c50-a21e-44739a04eda2 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:10.769710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886c03e-8af1-4c50-a21e-44739a04eda2 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:10.770279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886c03e-8af1-4c50-a21e-44739a04eda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:10.805114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-8886c03e-8af1-4c50-a21e-44739a04eda2 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:10.806365 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-8886c03e-8af1-4c50-a21e-44739a04eda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:10.822528 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 72/146] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:10.823378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892240e-6271-4338-b833-e4aa7b3bf5a9 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:10.862280 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:10.943054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 75/147] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:10.943929 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886c03e-8af1-4c50-a21e-44739a04eda2 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:10.968276 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892240e-6271-4338-b833-e4aa7b3bf5a9 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:10.996759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:11.005004 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528395e6-8333-4254-afb3-46a43db2c5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:11.006020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528395e6-8333-4254-afb3-46a43db2c5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:11.006566 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528395e6-8333-4254-afb3-46a43db2c5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:11.007044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528395e6-8333-4254-afb3-46a43db2c5b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:11.008999 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528395e6-8333-4254-afb3-46a43db2c5b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:11.010648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528395e6-8333-4254-afb3-46a43db2c5b5 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:11.012832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 73/148] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:40:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:11.013824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528395e6-8333-4254-afb3-46a43db2c5b5 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:11.117111 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528395e6-8333-4254-afb3-46a43db2c5b5 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:11.152858 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf71aad-6c7c-47fd-b234-c470e72ee001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:11.154120 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf71aad-6c7c-47fd-b234-c470e72ee001 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:11.154689 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf71aad-6c7c-47fd-b234-c470e72ee001 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:11.155181 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf71aad-6c7c-47fd-b234-c470e72ee001 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:11.165937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf71aad-6c7c-47fd-b234-c470e72ee001 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:11.174029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-ccf71aad-6c7c-47fd-b234-c470e72ee001 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:40:11.174029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:11.174029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:11.174029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:11.174029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:11.174029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:11.174029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:11.174029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:11.174029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:11.174029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:11.174029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:11.174029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:11.174029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:11.174029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:11.174029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:11.174029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:11.174952 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:11.174952 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:11.174952 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:11.174952 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:11.174952 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:11.174952 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:11.174952 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:11.174952 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:11.174952 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:11.174952 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:11.174952 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:11.174952 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:11.174952 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:11.174952 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:11.174952 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:11.174952 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:11.175716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:11.175716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:11.175716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:11.175716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:11.175716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:11.175716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:11.175716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:11.175716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:11.175716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:11.175716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:11.175716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:40:11.175716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:11.178095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 74/149] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:40:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:11.179088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf71aad-6c7c-47fd-b234-c470e72ee001 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:11.218957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886c03e-8af1-4c50-a21e-44739a04eda2 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:11.276601 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:11.288828 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf71aad-6c7c-47fd-b234-c470e72ee001 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:11.290216 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7336a-be98-4e3a-baa5-f1460cd2a158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:11.291094 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7336a-be98-4e3a-baa5-f1460cd2a158 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:11.291381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7336a-be98-4e3a-baa5-f1460cd2a158 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:11.300494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7336a-be98-4e3a-baa5-f1460cd2a158 None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:11.300494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7336a-be98-4e3a-baa5-f1460cd2a158 None admin] RBAC: Authorizing `identity:get_project(project_id=d81536229a89416692cd909ecd4bd4ec)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:11.300494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7336a-be98-4e3a-baa5-f1460cd2a158 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:11.300494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 76/150] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:10 2022] GET /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec => generated 298 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:11.300918 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7336a-be98-4e3a-baa5-f1460cd2a158 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:11.326151 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5268c3-4e7f-40ae-93c4-dfe173dd3c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:11.327234 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5268c3-4e7f-40ae-93c4-dfe173dd3c54 None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:11.327720 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5268c3-4e7f-40ae-93c4-dfe173dd3c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:11.328242 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5268c3-4e7f-40ae-93c4-dfe173dd3c54 None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:11.329151 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5268c3-4e7f-40ae-93c4-dfe173dd3c54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:11.330854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5268c3-4e7f-40ae-93c4-dfe173dd3c54 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:11.363272 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:11.433221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7336a-be98-4e3a-baa5-f1460cd2a158 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:11.448762 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 75/151] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 16:40:11 2022] POST /identity/v3/users => generated 283 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:40:11.450224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5268c3-4e7f-40ae-93c4-dfe173dd3c54 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:11.469970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ade28-002b-41e0-a5e0-2e7a23923949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:11.470654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ade28-002b-41e0-a5e0-2e7a23923949 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:11.470950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ade28-002b-41e0-a5e0-2e7a23923949 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:11.471324 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ade28-002b-41e0-a5e0-2e7a23923949 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:11.472042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ade28-002b-41e0-a5e0-2e7a23923949 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:11.472385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ade28-002b-41e0-a5e0-2e7a23923949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:11.473828 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ade28-002b-41e0-a5e0-2e7a23923949 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:11.488150 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 77/152] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:11.490097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ade28-002b-41e0-a5e0-2e7a23923949 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:11.632496 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:11.636986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ade28-002b-41e0-a5e0-2e7a23923949 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:11.675210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b197b2-f046-4eeb-8567-90ec233e87da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:11.676096 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b197b2-f046-4eeb-8567-90ec233e87da None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:11.676522 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b197b2-f046-4eeb-8567-90ec233e87da None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:11.677304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b197b2-f046-4eeb-8567-90ec233e87da None admin] PATH_INFO: `/v3/users/2ba6ed129dc941f49c2206f6d2b62dfd` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:11.678631 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b197b2-f046-4eeb-8567-90ec233e87da None admin] RBAC: Authorizing `identity:get_user(user_id=2ba6ed129dc941f49c2206f6d2b62dfd)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:11.680130 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b197b2-f046-4eeb-8567-90ec233e87da None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:11.682993 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 78/153] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:11 2022] GET /identity/v3/users/2ba6ed129dc941f49c2206f6d2b62dfd => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:11.684886 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fdb6b-f1c6-4eac-97dd-d72687f0041d None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:11.685244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fdb6b-f1c6-4eac-97dd-d72687f0041d None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:11.685590 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fdb6b-f1c6-4eac-97dd-d72687f0041d None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:11.687054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 79/154] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:11.687159 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5268c3-4e7f-40ae-93c4-dfe173dd3c54 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:11.691944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fdb6b-f1c6-4eac-97dd-d72687f0041d None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:11.719207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:11.751997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781e1aa-c2c5-4d26-bc48-ba4aa201ad95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:11.753085 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781e1aa-c2c5-4d26-bc48-ba4aa201ad95 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:11.753656 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781e1aa-c2c5-4d26-bc48-ba4aa201ad95 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:11.754131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781e1aa-c2c5-4d26-bc48-ba4aa201ad95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:11.755179 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781e1aa-c2c5-4d26-bc48-ba4aa201ad95 None admin] RBAC: Adding query filter params (role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2, scope.project.id=d81536229a89416692cd909ecd4bd4ec, user.id=bb405bf4f38249d1957087830723f0ea) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:11.755694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781e1aa-c2c5-4d26-bc48-ba4aa201ad95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:11.757530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781e1aa-c2c5-4d26-bc48-ba4aa201ad95 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:11.772311 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 76/155] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:40:11 2022] GET /identity/v3/role_assignments?user.id=bb405bf4f38249d1957087830723f0ea&scope.project.id=d81536229a89416692cd909ecd4bd4ec&role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 608 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:11.777883 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb1685-ca50-465e-9ae1-eabfb4bc41f9 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:11.777883 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb1685-ca50-465e-9ae1-eabfb4bc41f9 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:11.777883 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb1685-ca50-465e-9ae1-eabfb4bc41f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:11.809974 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-f7cb1685-ca50-465e-9ae1-eabfb4bc41f9 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:11.811775 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f7cb1685-ca50-465e-9ae1-eabfb4bc41f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:11.812623 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fdb6b-f1c6-4eac-97dd-d72687f0041d None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:11.854332 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8011628-77b6-447b-95ad-0d34476fda50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:11.855001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8011628-77b6-447b-95ad-0d34476fda50 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:11.855295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8011628-77b6-447b-95ad-0d34476fda50 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:11.855576 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8011628-77b6-447b-95ad-0d34476fda50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:11.892572 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:11.946952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8011628-77b6-447b-95ad-0d34476fda50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:11.947879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8011628-77b6-447b-95ad-0d34476fda50 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:11.957476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 77/156] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:11.959137 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8835c-02ee-485e-acc8-23b093793d6b None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:11.959607 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8835c-02ee-485e-acc8-23b093793d6b None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:11.960084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8835c-02ee-485e-acc8-23b093793d6b None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:11.962336 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 78/157] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:11.968334 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989942a-992d-4e3b-81e8-b8153110ded6 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:11.968906 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989942a-992d-4e3b-81e8-b8153110ded6 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:11.969383 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989942a-992d-4e3b-81e8-b8153110ded6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:11.990663 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-2989942a-992d-4e3b-81e8-b8153110ded6 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:11.992305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2989942a-992d-4e3b-81e8-b8153110ded6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:12.092508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 79/158] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:40:12.093373 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989942a-992d-4e3b-81e8-b8153110ded6 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:12.112944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 80/159] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 16:40:12.119243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8011628-77b6-447b-95ad-0d34476fda50 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:12.158442 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:12.213722 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:12.256776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8011628-77b6-447b-95ad-0d34476fda50 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:12.257678 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989942a-992d-4e3b-81e8-b8153110ded6 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:12.302299 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee185cf-8b3f-47c8-8d55-aa95628a9d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:12.303151 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee185cf-8b3f-47c8-8d55-aa95628a9d37 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:12.303442 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee185cf-8b3f-47c8-8d55-aa95628a9d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:12.303708 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee185cf-8b3f-47c8-8d55-aa95628a9d37 None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:12.305005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee185cf-8b3f-47c8-8d55-aa95628a9d37 None admin] RBAC: Authorizing `identity:get_project(project_id=d81536229a89416692cd909ecd4bd4ec)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:12.305236 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8d7f7-6671-4f20-9858-8eba8beee80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:12.306208 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8d7f7-6671-4f20-9858-8eba8beee80b None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:12.306572 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee185cf-8b3f-47c8-8d55-aa95628a9d37 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:12.306781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8d7f7-6671-4f20-9858-8eba8beee80b None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:12.307365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8d7f7-6671-4f20-9858-8eba8beee80b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:12.312219 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 81/160] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:12 2022] GET /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:12.313165 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee185cf-8b3f-47c8-8d55-aa95628a9d37 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:12.319786 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8d7f7-6671-4f20-9858-8eba8beee80b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:12.330405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-23d8d7f7-6671-4f20-9858-8eba8beee80b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:12.330405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:12.330405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:12.330405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:12.330405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:12.330405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:12.330405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:12.330405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:12.330405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:12.330405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:12.330405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:12.330405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:12.330405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:12.330405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:12.330405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:12.330405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:12.331482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:12.331482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:12.331482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:12.331482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:12.331482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:12.331482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:12.331482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:12.331482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:12.331482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:12.331482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:12.331482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:12.331482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:12.331482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:12.331482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:12.331482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:12.331482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:12.332497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:12.332497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:12.332497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:12.332497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:12.332497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:12.332497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:12.332497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:12.332497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:12.332497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:12.332497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:12.332497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:12.332497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:12.333663 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 80/161] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:40:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:12.339409 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8d7f7-6671-4f20-9858-8eba8beee80b None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:12.443129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee185cf-8b3f-47c8-8d55-aa95628a9d37 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:12.451480 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:12.458399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8d7f7-6671-4f20-9858-8eba8beee80b None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:12.481703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:12.488409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d6b8b-e99f-4de2-bf58-a0e1a5f593ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:12.490426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d6b8b-e99f-4de2-bf58-a0e1a5f593ac None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:12.491577 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d6b8b-e99f-4de2-bf58-a0e1a5f593ac None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:12.492004 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d6b8b-e99f-4de2-bf58-a0e1a5f593ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:12.507773 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5a564-6399-4e21-bdc1-bfcba552e219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:12.507773 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5a564-6399-4e21-bdc1-bfcba552e219 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:12.507773 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5a564-6399-4e21-bdc1-bfcba552e219 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:12.507773 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5a564-6399-4e21-bdc1-bfcba552e219 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:12.511202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5a564-6399-4e21-bdc1-bfcba552e219 None admin] RBAC: Adding query filter params (role.id=459b0e5c21c94fb1b81f76c65780fdb5, scope.project.id=d81536229a89416692cd909ecd4bd4ec, user.id=2ba6ed129dc941f49c2206f6d2b62dfd) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:12.511202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5a564-6399-4e21-bdc1-bfcba552e219 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:12.511392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d6b8b-e99f-4de2-bf58-a0e1a5f593ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:12.511868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5a564-6399-4e21-bdc1-bfcba552e219 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:12.518937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 81/162] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:40:12 2022] GET /identity/v3/role_assignments?user.id=2ba6ed129dc941f49c2206f6d2b62dfd&scope.project.id=d81536229a89416692cd909ecd4bd4ec&role.id=459b0e5c21c94fb1b81f76c65780fdb5 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:12.524031 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5a564-6399-4e21-bdc1-bfcba552e219 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:12.527042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-2e8d6b8b-e99f-4de2-bf58-a0e1a5f593ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 16:40:12.527042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:12.527042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:12.527042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:12.527042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:12.527042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:12.527042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:12.527042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:12.527042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:12.527042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:12.527042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:12.527042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:12.527042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:12.527042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:12.527042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:12.527042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:12.528197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:12.528197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:12.528197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:12.528197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:12.528197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:12.528197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:12.528197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:12.528197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:12.528197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:12.528197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:12.528197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:12.528197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:12.528197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:12.528197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:12.528197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:12.528197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:12.529189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:12.529189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:12.529189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:12.529189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:12.529189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:12.529189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:12.529189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:12.529189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:12.529189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:12.529189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:12.529189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 16:40:12.529189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:12.531967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 82/163] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:12.537122 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d6b8b-e99f-4de2-bf58-a0e1a5f593ac None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:12.653918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5a564-6399-4e21-bdc1-bfcba552e219 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:12.697291 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d6b8b-e99f-4de2-bf58-a0e1a5f593ac None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:12.707402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e24ef-3c80-44f4-bca7-1d1b594f7d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:12.708079 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e24ef-3c80-44f4-bca7-1d1b594f7d3d None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:12.708472 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e24ef-3c80-44f4-bca7-1d1b594f7d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:12.708751 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e24ef-3c80-44f4-bca7-1d1b594f7d3d None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:12.709525 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e24ef-3c80-44f4-bca7-1d1b594f7d3d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:12.709836 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e24ef-3c80-44f4-bca7-1d1b594f7d3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:12.711274 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e24ef-3c80-44f4-bca7-1d1b594f7d3d None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:12.720384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 82/164] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:40:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:12.721767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b095eb-4b8e-4f72-93ae-b57cbf010a2d None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:12.722106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b095eb-4b8e-4f72-93ae-b57cbf010a2d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:12.722389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b095eb-4b8e-4f72-93ae-b57cbf010a2d None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:12.724006 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 83/165] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:12.728309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b095eb-4b8e-4f72-93ae-b57cbf010a2d None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:12.746210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60575a-081d-4be4-807f-02ca51d948d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:12.746993 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60575a-081d-4be4-807f-02ca51d948d4 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:12.747283 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60575a-081d-4be4-807f-02ca51d948d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:12.747604 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60575a-081d-4be4-807f-02ca51d948d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:12.748494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60575a-081d-4be4-807f-02ca51d948d4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:12.748812 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60575a-081d-4be4-807f-02ca51d948d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:12.750718 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60575a-081d-4be4-807f-02ca51d948d4 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:12.757486 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:12.763589 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 83/166] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:12.765367 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daaf3c3-b03b-472c-ad41-26d8c44ebde1 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:12.770789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daaf3c3-b03b-472c-ad41-26d8c44ebde1 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:12.770789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daaf3c3-b03b-472c-ad41-26d8c44ebde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:12.787137 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-2daaf3c3-b03b-472c-ad41-26d8c44ebde1 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:12.788821 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-2daaf3c3-b03b-472c-ad41-26d8c44ebde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:12.847708 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:12.848342 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b095eb-4b8e-4f72-93ae-b57cbf010a2d None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:12.869885 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 84/167] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:12.876255 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daaf3c3-b03b-472c-ad41-26d8c44ebde1 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:12.886134 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9de2b-4e10-4eae-889a-3beeea9812e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:12.887064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9de2b-4e10-4eae-889a-3beeea9812e8 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:12.889712 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9de2b-4e10-4eae-889a-3beeea9812e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:12.889712 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9de2b-4e10-4eae-889a-3beeea9812e8 None admin] PATH_INFO: `/v3/users/bb405bf4f38249d1957087830723f0ea` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:12.890815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9de2b-4e10-4eae-889a-3beeea9812e8 None admin] RBAC: Authorizing `identity:get_user(user_id=bb405bf4f38249d1957087830723f0ea)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:12.892432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9de2b-4e10-4eae-889a-3beeea9812e8 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:12.895091 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 84/168] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:12 2022] GET /identity/v3/users/bb405bf4f38249d1957087830723f0ea => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:12.900850 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9de2b-4e10-4eae-889a-3beeea9812e8 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:12.998722 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:13.016177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9de2b-4e10-4eae-889a-3beeea9812e8 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:13.018802 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daaf3c3-b03b-472c-ad41-26d8c44ebde1 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:13.050617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebc3e6-f243-4b66-a498-42a411f85cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:13.051266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebc3e6-f243-4b66-a498-42a411f85cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:13.051548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebc3e6-f243-4b66-a498-42a411f85cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:13.052062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebc3e6-f243-4b66-a498-42a411f85cc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:13.112842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6062f-53b2-4f79-b04c-960715f2bee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:13.113738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6062f-53b2-4f79-b04c-960715f2bee4 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:13.114026 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6062f-53b2-4f79-b04c-960715f2bee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:13.114306 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6062f-53b2-4f79-b04c-960715f2bee4 None admin] PATH_INFO: `/v3/users/c6ffc54f342f412f97331b94a3c786cf` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:13.115564 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6062f-53b2-4f79-b04c-960715f2bee4 None admin] RBAC: Authorizing `identity:get_user(user_id=c6ffc54f342f412f97331b94a3c786cf)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:13.117092 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6062f-53b2-4f79-b04c-960715f2bee4 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:13.119312 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 85/169] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:12 2022] GET /identity/v3/users/c6ffc54f342f412f97331b94a3c786cf => generated 289 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:13.120084 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6062f-53b2-4f79-b04c-960715f2bee4 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:13.148838 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebc3e6-f243-4b66-a498-42a411f85cc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:13.150348 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebc3e6-f243-4b66-a498-42a411f85cc0 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:13.242501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:13.261477 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 85/170] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 16:40:13.261477 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebc3e6-f243-4b66-a498-42a411f85cc0 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:13.264560 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:13.354438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6062f-53b2-4f79-b04c-960715f2bee4 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:13.363243 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebc3e6-f243-4b66-a498-42a411f85cc0 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:13.399131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd87af-441b-4c85-a0b4-0f480dfd1d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:13.399980 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd87af-441b-4c85-a0b4-0f480dfd1d95 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:13.400297 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd87af-441b-4c85-a0b4-0f480dfd1d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:13.400574 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd87af-441b-4c85-a0b4-0f480dfd1d95 None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:13.404124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd87af-441b-4c85-a0b4-0f480dfd1d95 None admin] RBAC: Authorizing `identity:get_project(project_id=d81536229a89416692cd909ecd4bd4ec)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:13.404124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd87af-441b-4c85-a0b4-0f480dfd1d95 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:13.405135 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 86/171] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:13 2022] GET /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:13.405809 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd87af-441b-4c85-a0b4-0f480dfd1d95 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:13.422430 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb9218-af07-4e7f-868f-1612ddaae7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:13.423664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb9218-af07-4e7f-868f-1612ddaae7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:13.424249 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb9218-af07-4e7f-868f-1612ddaae7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:13.424825 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb9218-af07-4e7f-868f-1612ddaae7a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:13.453027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb9218-af07-4e7f-868f-1612ddaae7a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:13.468458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:13.468835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-74eb9218-af07-4e7f-868f-1612ddaae7a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:13.468835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:13.468835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:13.468835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:13.468835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:13.468835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:13.468835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:13.468835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:13.468835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:13.468835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:13.468835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:13.468835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:13.468835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:13.468835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:13.468835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:13.468835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:13.469679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:13.469679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:13.469679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:13.469679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:13.469679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:13.469679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:13.469679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:13.469679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:13.469679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:13.469679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:13.469679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:13.469679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:13.469679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:13.469679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:13.469679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:13.469679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:13.470484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:13.470484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:13.470484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:13.470484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:13.470484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:13.470484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:13.470484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:13.470484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:13.470484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:13.470484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:13.470484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:13.470484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:13.470484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 86/172] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:13.471152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb9218-af07-4e7f-868f-1612ddaae7a4 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:13.506143 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd87af-441b-4c85-a0b4-0f480dfd1d95 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:13.541975 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f066e7d-cf9d-457b-9761-be1bc13b2865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:13.542758 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f066e7d-cf9d-457b-9761-be1bc13b2865 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:13.543041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f066e7d-cf9d-457b-9761-be1bc13b2865 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:13.543316 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f066e7d-cf9d-457b-9761-be1bc13b2865 None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:13.544550 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f066e7d-cf9d-457b-9761-be1bc13b2865 None admin] RBAC: Authorizing `identity:get_project(project_id=d81536229a89416692cd909ecd4bd4ec)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:13.546020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f066e7d-cf9d-457b-9761-be1bc13b2865 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:13.547888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 87/173] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:13 2022] GET /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:13.548594 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f066e7d-cf9d-457b-9761-be1bc13b2865 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:13.650327 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f066e7d-cf9d-457b-9761-be1bc13b2865 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:13.677696 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:13.685740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199b688-bf8c-4c9b-af17-b246249efbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:13.686412 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199b688-bf8c-4c9b-af17-b246249efbcb None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:13.686699 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199b688-bf8c-4c9b-af17-b246249efbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:13.686978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199b688-bf8c-4c9b-af17-b246249efbcb None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:13.687739 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199b688-bf8c-4c9b-af17-b246249efbcb None admin] RBAC: Adding query filter params (name=member) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:13.688051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199b688-bf8c-4c9b-af17-b246249efbcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:13.689578 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199b688-bf8c-4c9b-af17-b246249efbcb None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:13.697972 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 88/174] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:13.702926 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199b688-bf8c-4c9b-af17-b246249efbcb None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:13.743609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb9218-af07-4e7f-868f-1612ddaae7a4 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:13.774713 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:13.800128 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199b688-bf8c-4c9b-af17-b246249efbcb None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:13.833801 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4f738-146b-4bee-9804-68c241c8b444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:13.834438 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4f738-146b-4bee-9804-68c241c8b444 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:13.834787 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4f738-146b-4bee-9804-68c241c8b444 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:13.835061 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4f738-146b-4bee-9804-68c241c8b444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:13.835965 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4f738-146b-4bee-9804-68c241c8b444 None admin] RBAC: Adding query filter params (role.id=885a05785a714822b2012deb56880a73, scope.project.id=d81536229a89416692cd909ecd4bd4ec, user.id=bb405bf4f38249d1957087830723f0ea) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:13.836301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4f738-146b-4bee-9804-68c241c8b444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:13.838010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4f738-146b-4bee-9804-68c241c8b444 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:13.845127 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 89/175] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:40:13 2022] GET /identity/v3/role_assignments?user.id=bb405bf4f38249d1957087830723f0ea&scope.project.id=d81536229a89416692cd909ecd4bd4ec&role.id=885a05785a714822b2012deb56880a73 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:13.845941 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4f738-146b-4bee-9804-68c241c8b444 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:13.846929 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337978c-40c9-4986-b576-60eb55eae3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:13.848051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337978c-40c9-4986-b576-60eb55eae3f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:13.849011 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337978c-40c9-4986-b576-60eb55eae3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:13.849505 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337978c-40c9-4986-b576-60eb55eae3f0 None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec/users/c6ffc54f342f412f97331b94a3c786cf/roles/434b9e3fd1f6417689c6bd184fbdb7e6` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:13.861209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337978c-40c9-4986-b576-60eb55eae3f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d81536229a89416692cd909ecd4bd4ec, user_id=c6ffc54f342f412f97331b94a3c786cf, role_id=434b9e3fd1f6417689c6bd184fbdb7e6)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:13.863027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337978c-40c9-4986-b576-60eb55eae3f0 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:13.906554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:13.958565 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4f738-146b-4bee-9804-68c241c8b444 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:13.959547 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 87/176] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:40:13 2022] PUT /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec/users/c6ffc54f342f412f97331b94a3c786cf/roles/434b9e3fd1f6417689c6bd184fbdb7e6 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:40:13.999211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26da240-44a3-4d14-bfa4-0d4e4d7f2a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:14.000212 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26da240-44a3-4d14-bfa4-0d4e4d7f2a22 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:14.000540 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26da240-44a3-4d14-bfa4-0d4e4d7f2a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:14.000793 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26da240-44a3-4d14-bfa4-0d4e4d7f2a22 None admin] PATH_INFO: `/v3/users/bb405bf4f38249d1957087830723f0ea` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:14.002173 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26da240-44a3-4d14-bfa4-0d4e4d7f2a22 None admin] RBAC: Authorizing `identity:get_user(user_id=bb405bf4f38249d1957087830723f0ea)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:14.003746 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26da240-44a3-4d14-bfa4-0d4e4d7f2a22 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:14.007379 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 90/177] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:13 2022] GET /identity/v3/users/bb405bf4f38249d1957087830723f0ea => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:14.013492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337978c-40c9-4986-b576-60eb55eae3f0 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:14.161855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337978c-40c9-4986-b576-60eb55eae3f0 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:14.228274 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2102f1-44d7-451a-817c-c62c3268b326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:14.229412 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2102f1-44d7-451a-817c-c62c3268b326 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:14.229931 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2102f1-44d7-451a-817c-c62c3268b326 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:14.230441 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2102f1-44d7-451a-817c-c62c3268b326 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:14.285263 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:14.313993 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2102f1-44d7-451a-817c-c62c3268b326 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:14.316269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2102f1-44d7-451a-817c-c62c3268b326 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:14.430009 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 88/178] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:14.435583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26da240-44a3-4d14-bfa4-0d4e4d7f2a22 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:14.579029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26da240-44a3-4d14-bfa4-0d4e4d7f2a22 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:14.599627 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:14.615213 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e341a-c7af-41df-bce9-dd4f05697400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:14.616081 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e341a-c7af-41df-bce9-dd4f05697400 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:14.616394 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e341a-c7af-41df-bce9-dd4f05697400 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:14.616675 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e341a-c7af-41df-bce9-dd4f05697400 None admin] PATH_INFO: `/v3/projects/135ff8cf5499444bb1f57bbb375a6d82` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:14.617950 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e341a-c7af-41df-bce9-dd4f05697400 None admin] RBAC: Authorizing `identity:get_project(project_id=135ff8cf5499444bb1f57bbb375a6d82)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:14.619407 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e341a-c7af-41df-bce9-dd4f05697400 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:14.621172 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 91/179] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:14 2022] GET /identity/v3/projects/135ff8cf5499444bb1f57bbb375a6d82 => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:14.627670 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2102f1-44d7-451a-817c-c62c3268b326 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:14.665070 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a56f7e-2e16-488c-82bf-488e23da7620 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:14.667455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a56f7e-2e16-488c-82bf-488e23da7620 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:14.667455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a56f7e-2e16-488c-82bf-488e23da7620 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:14.667455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 92/180] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:40:14.672445 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa6929-9725-4750-8814-4f560b9f62e9 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:14.672738 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa6929-9725-4750-8814-4f560b9f62e9 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:14.673022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa6929-9725-4750-8814-4f560b9f62e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:14.690876 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-c8aa6929-9725-4750-8814-4f560b9f62e9 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:14.692000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c8aa6929-9725-4750-8814-4f560b9f62e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:14.762736 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 93/181] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:40:14.775278 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:14.787040 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa6929-9725-4750-8814-4f560b9f62e9 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:14.840144 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2102f1-44d7-451a-817c-c62c3268b326 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:14.892996 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa6929-9725-4750-8814-4f560b9f62e9 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:14.911220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:14.924833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b41cf-91c6-421b-a281-b7e02a05de58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:14.925487 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b41cf-91c6-421b-a281-b7e02a05de58 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:14.929115 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b41cf-91c6-421b-a281-b7e02a05de58 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:14.929115 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b41cf-91c6-421b-a281-b7e02a05de58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:14.929115 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b41cf-91c6-421b-a281-b7e02a05de58 None admin] RBAC: Adding query filter params (role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2, scope.project.id=135ff8cf5499444bb1f57bbb375a6d82, user.id=bb405bf4f38249d1957087830723f0ea) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:14.929115 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b41cf-91c6-421b-a281-b7e02a05de58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:14.929115 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b41cf-91c6-421b-a281-b7e02a05de58 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:14.929452 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb128570-1588-4f77-80fa-e9e0fe017709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:14.929550 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb128570-1588-4f77-80fa-e9e0fe017709 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:14.929827 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb128570-1588-4f77-80fa-e9e0fe017709 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:14.930649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb128570-1588-4f77-80fa-e9e0fe017709 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:14.941341 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb128570-1588-4f77-80fa-e9e0fe017709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:14.943354 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 89/182] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:40:14 2022] GET /identity/v3/role_assignments?user.id=bb405bf4f38249d1957087830723f0ea&scope.project.id=135ff8cf5499444bb1f57bbb375a6d82&role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 608 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:14.954516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-cb128570-1588-4f77-80fa-e9e0fe017709 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:40:14.954516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:14.954516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:14.954516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:14.954516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:14.954516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:14.954516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:14.954516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:14.954516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:14.954516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:14.954516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:14.954516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:14.954516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:14.954516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:14.954516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:14.954516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:14.955450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:14.955450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:14.955450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:14.955450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:14.955450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:14.955450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:14.955450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:14.955450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:14.955450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:14.955450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:14.955450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:14.955450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:14.955450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:14.955450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:14.955450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:14.955450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:14.956282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:14.956282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:14.956282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:14.956282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:14.956282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:14.956282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:14.956282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:14.956282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:14.956282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:14.956282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:14.956282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:40:14.956282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:14.960221 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 94/183] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:40:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:14.973094 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b41cf-91c6-421b-a281-b7e02a05de58 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:15.158060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b41cf-91c6-421b-a281-b7e02a05de58 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:15.196945 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a43ca3-26ee-4517-b9c5-33c06797ffd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:15.197960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a43ca3-26ee-4517-b9c5-33c06797ffd7 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:15.198441 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a43ca3-26ee-4517-b9c5-33c06797ffd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:15.198962 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a43ca3-26ee-4517-b9c5-33c06797ffd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:15.199918 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a43ca3-26ee-4517-b9c5-33c06797ffd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:15.200450 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a43ca3-26ee-4517-b9c5-33c06797ffd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:15.202048 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a43ca3-26ee-4517-b9c5-33c06797ffd7 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:15.204772 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:15.212725 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 90/184] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:15.218894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb128570-1588-4f77-80fa-e9e0fe017709 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:15.247861 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8383ef1-5f48-457a-847d-24323e506fb0 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:15.249393 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8383ef1-5f48-457a-847d-24323e506fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:15.249874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8383ef1-5f48-457a-847d-24323e506fb0 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:15.251888 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 91/185] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:15.257744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d163f-aaae-4766-a75e-696b77f6caf5 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:15.258394 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d163f-aaae-4766-a75e-696b77f6caf5 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:15.258975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d163f-aaae-4766-a75e-696b77f6caf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:15.276932 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-990d163f-aaae-4766-a75e-696b77f6caf5 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:15.278559 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-990d163f-aaae-4766-a75e-696b77f6caf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:15.332089 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb128570-1588-4f77-80fa-e9e0fe017709 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:15.355000 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 92/186] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:40:15.366883 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ad786-a924-407e-8ce8-2f23cf9abec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:15.368394 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ad786-a924-407e-8ce8-2f23cf9abec1 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:15.368684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ad786-a924-407e-8ce8-2f23cf9abec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:15.368962 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ad786-a924-407e-8ce8-2f23cf9abec1 None admin] PATH_INFO: `/v3/users/db2257787898445a9acbf032349530b8` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:15.380935 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0150d7-753d-484c-be1f-75bd21ca4008 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:15.381554 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0150d7-753d-484c-be1f-75bd21ca4008 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:15.382263 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0150d7-753d-484c-be1f-75bd21ca4008 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:15.387830 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 93/187] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:40:15.388226 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ad786-a924-407e-8ce8-2f23cf9abec1 None admin] RBAC: Authorizing `identity:get_user(user_id=db2257787898445a9acbf032349530b8)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:15.388692 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0150d7-753d-484c-be1f-75bd21ca4008 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:15.389786 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ad786-a924-407e-8ce8-2f23cf9abec1 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:15.396016 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 95/188] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:15 2022] GET /identity/v3/users/db2257787898445a9acbf032349530b8 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:15.397465 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f984ee8-c51e-4399-9430-8fde67571ca2 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:15.397662 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f984ee8-c51e-4399-9430-8fde67571ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:15.397949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f984ee8-c51e-4399-9430-8fde67571ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:15.415142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-2f984ee8-c51e-4399-9430-8fde67571ca2 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:15.417168 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2f984ee8-c51e-4399-9430-8fde67571ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:15.448510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:15.489103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 96/189] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:15.497164 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f984ee8-c51e-4399-9430-8fde67571ca2 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:15.509354 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0150d7-753d-484c-be1f-75bd21ca4008 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:15.538232 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:15.547672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9d1be-472b-4fed-a7a7-7e714c4d40fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:15.548525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9d1be-472b-4fed-a7a7-7e714c4d40fb None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:15.548815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9d1be-472b-4fed-a7a7-7e714c4d40fb None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:15.549096 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9d1be-472b-4fed-a7a7-7e714c4d40fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:15.550543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9d1be-472b-4fed-a7a7-7e714c4d40fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:15.552045 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9d1be-472b-4fed-a7a7-7e714c4d40fb None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:15.553996 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 94/190] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:40:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:15.554792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9d1be-472b-4fed-a7a7-7e714c4d40fb None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:15.618659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f984ee8-c51e-4399-9430-8fde67571ca2 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:15.654819 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c15136-e45b-4307-b767-8ab27a490f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:15.655475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c15136-e45b-4307-b767-8ab27a490f06 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:15.655763 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c15136-e45b-4307-b767-8ab27a490f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:15.656042 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c15136-e45b-4307-b767-8ab27a490f06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:15.656456 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9d1be-472b-4fed-a7a7-7e714c4d40fb None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:15.690145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3d2e6-e1ae-4d70-92f6-d6c89c30ff1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:15.690951 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3d2e6-e1ae-4d70-92f6-d6c89c30ff1e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:15.691237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3d2e6-e1ae-4d70-92f6-d6c89c30ff1e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:15.691513 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3d2e6-e1ae-4d70-92f6-d6c89c30ff1e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:15.691942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:15.704771 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3d2e6-e1ae-4d70-92f6-d6c89c30ff1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:15.710584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-cfc3d2e6-e1ae-4d70-92f6-d6c89c30ff1e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:15.710584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:15.710584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:15.710584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:15.710584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:15.710584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:15.710584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:15.710584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:15.710584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:15.710584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:15.710584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:15.710584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:15.710584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:15.710584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:15.710584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:15.710584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:15.712207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:15.712207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:15.712207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:15.712207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:15.712207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:15.712207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:15.712207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:15.712207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:15.712207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:15.712207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:15.712207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:15.712207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:15.712207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:15.712207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:15.712207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:15.712207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:15.713217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:15.713217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:15.713217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:15.713217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:15.713217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:15.713217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:15.713217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:15.713217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:15.713217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:15.713217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:15.713217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:15.713217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:15.713217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 95/191] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:40:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:15.713217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3d2e6-e1ae-4d70-92f6-d6c89c30ff1e None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:15.737829 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c15136-e45b-4307-b767-8ab27a490f06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:15.740029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c15136-e45b-4307-b767-8ab27a490f06 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:15.772920 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:15.817541 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3d2e6-e1ae-4d70-92f6-d6c89c30ff1e None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:15.844838 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 97/192] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:15.845516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c15136-e45b-4307-b767-8ab27a490f06 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:15.857292 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0152da-511f-4909-bc48-6ee88ad18d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:15.857960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0152da-511f-4909-bc48-6ee88ad18d93 None admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:15.858243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0152da-511f-4909-bc48-6ee88ad18d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:15.858513 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0152da-511f-4909-bc48-6ee88ad18d93 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:15.859226 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0152da-511f-4909-bc48-6ee88ad18d93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:15.860721 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0152da-511f-4909-bc48-6ee88ad18d93 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:15.911583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:15.945080 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c15136-e45b-4307-b767-8ab27a490f06 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:15.952395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 96/193] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 16:40:15 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:40:15.958297 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0152da-511f-4909-bc48-6ee88ad18d93 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:15.992405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b258a-5f54-4c1e-8948-75015e52a892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:15.993267 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b258a-5f54-4c1e-8948-75015e52a892 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:15.993549 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b258a-5f54-4c1e-8948-75015e52a892 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:15.993844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b258a-5f54-4c1e-8948-75015e52a892 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:15.994676 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b258a-5f54-4c1e-8948-75015e52a892 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:15.994992 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b258a-5f54-4c1e-8948-75015e52a892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:15.996998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b258a-5f54-4c1e-8948-75015e52a892 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:16.011977 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 98/194] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:40:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:16.013778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b258a-5f54-4c1e-8948-75015e52a892 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:16.101323 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0152da-511f-4909-bc48-6ee88ad18d93 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:16.116468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:16.138191 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b258a-5f54-4c1e-8948-75015e52a892 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:16.145530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b2bad-885a-4673-a1af-3f0cd6ce3597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:16.146437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b2bad-885a-4673-a1af-3f0cd6ce3597 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:16.146719 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b2bad-885a-4673-a1af-3f0cd6ce3597 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:16.147061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b2bad-885a-4673-a1af-3f0cd6ce3597 None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:16.150107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b2bad-885a-4673-a1af-3f0cd6ce3597 None admin] RBAC: Authorizing `identity:get_project(project_id=1d92be9a7941425d9b66dc77739c5443)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:16.151064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b2bad-885a-4673-a1af-3f0cd6ce3597 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:16.153128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 97/195] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:15 2022] GET /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:16.159227 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b2bad-885a-4673-a1af-3f0cd6ce3597 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:16.181374 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:16.193487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea845e-2da8-4ae3-bfc5-8b05f7fb9447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:16.194374 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea845e-2da8-4ae3-bfc5-8b05f7fb9447 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:16.194664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea845e-2da8-4ae3-bfc5-8b05f7fb9447 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:16.194946 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea845e-2da8-4ae3-bfc5-8b05f7fb9447 None admin] PATH_INFO: `/v3/users/db2257787898445a9acbf032349530b8` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:16.199280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea845e-2da8-4ae3-bfc5-8b05f7fb9447 None admin] RBAC: Authorizing `identity:get_user(user_id=db2257787898445a9acbf032349530b8)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:16.203028 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea845e-2da8-4ae3-bfc5-8b05f7fb9447 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:16.204960 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 99/196] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:16 2022] GET /identity/v3/users/db2257787898445a9acbf032349530b8 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:16.212621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea845e-2da8-4ae3-bfc5-8b05f7fb9447 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:16.294406 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b2bad-885a-4673-a1af-3f0cd6ce3597 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:16.348601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745d85b-f060-48df-bac0-c0f1622a8599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:16.349626 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745d85b-f060-48df-bac0-c0f1622a8599 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:16.349892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745d85b-f060-48df-bac0-c0f1622a8599 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:16.350172 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745d85b-f060-48df-bac0-c0f1622a8599 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:16.351177 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745d85b-f060-48df-bac0-c0f1622a8599 None admin] RBAC: Adding query filter params (role.id=459b0e5c21c94fb1b81f76c65780fdb5, scope.project.id=1d92be9a7941425d9b66dc77739c5443, user.id=db2257787898445a9acbf032349530b8) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:16.351492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745d85b-f060-48df-bac0-c0f1622a8599 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:16.353067 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745d85b-f060-48df-bac0-c0f1622a8599 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:16.359041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 98/197] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:40:16 2022] GET /identity/v3/role_assignments?user.id=db2257787898445a9acbf032349530b8&scope.project.id=1d92be9a7941425d9b66dc77739c5443&role.id=459b0e5c21c94fb1b81f76c65780fdb5 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:16.363601 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea845e-2da8-4ae3-bfc5-8b05f7fb9447 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:16.410540 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9a25b-9efe-4166-a5ec-c302769601f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:16.411202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9a25b-9efe-4166-a5ec-c302769601f5 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:16.411490 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9a25b-9efe-4166-a5ec-c302769601f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:16.411773 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9a25b-9efe-4166-a5ec-c302769601f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:16.487227 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:16.495862 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9a25b-9efe-4166-a5ec-c302769601f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:16.497436 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9a25b-9efe-4166-a5ec-c302769601f5 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:16.535529 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb36a9d-7385-4ac5-9702-b5ef9bb9326c None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:16.535861 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb36a9d-7385-4ac5-9702-b5ef9bb9326c None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:16.536090 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb36a9d-7385-4ac5-9702-b5ef9bb9326c None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:16.537694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 99/198] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:40:16.545567 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122fe45-17bd-47ff-8b3a-efd7209d7641 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:16.545860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122fe45-17bd-47ff-8b3a-efd7209d7641 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:16.546154 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122fe45-17bd-47ff-8b3a-efd7209d7641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:16.569835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-9122fe45-17bd-47ff-8b3a-efd7209d7641 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:16.571781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-9122fe45-17bd-47ff-8b3a-efd7209d7641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:16.616793 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 100/199] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:16.622569 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9a25b-9efe-4166-a5ec-c302769601f5 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:16.647062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:16.693916 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 100/200] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:16.733993 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122fe45-17bd-47ff-8b3a-efd7209d7641 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:16.753966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:16.760364 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9a25b-9efe-4166-a5ec-c302769601f5 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:16.796953 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345bf0c-35a0-49a7-a5ba-7a497236bf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:16.797924 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345bf0c-35a0-49a7-a5ba-7a497236bf52 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:16.798216 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345bf0c-35a0-49a7-a5ba-7a497236bf52 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:16.798500 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345bf0c-35a0-49a7-a5ba-7a497236bf52 None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:16.799728 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345bf0c-35a0-49a7-a5ba-7a497236bf52 None admin] RBAC: Authorizing `identity:get_project(project_id=1d92be9a7941425d9b66dc77739c5443)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:16.801251 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345bf0c-35a0-49a7-a5ba-7a497236bf52 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:16.803160 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 101/201] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:16 2022] GET /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:16.808830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345bf0c-35a0-49a7-a5ba-7a497236bf52 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:16.914821 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345bf0c-35a0-49a7-a5ba-7a497236bf52 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:16.946490 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122fe45-17bd-47ff-8b3a-efd7209d7641 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:16.969515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2112b25-23b8-4b41-ab51-2ba1f1fbd0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:16.970178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2112b25-23b8-4b41-ab51-2ba1f1fbd0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:16.970468 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2112b25-23b8-4b41-ab51-2ba1f1fbd0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:16.970748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2112b25-23b8-4b41-ab51-2ba1f1fbd0d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:16.971602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2112b25-23b8-4b41-ab51-2ba1f1fbd0d5 None admin] RBAC: Adding query filter params (role.id=885a05785a714822b2012deb56880a73, scope.project.id=1d92be9a7941425d9b66dc77739c5443, user.id=db2257787898445a9acbf032349530b8) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:16.971918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2112b25-23b8-4b41-ab51-2ba1f1fbd0d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:16.973417 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2112b25-23b8-4b41-ab51-2ba1f1fbd0d5 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:16.980735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 102/202] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:40:16 2022] GET /identity/v3/role_assignments?user.id=db2257787898445a9acbf032349530b8&scope.project.id=1d92be9a7941425d9b66dc77739c5443&role.id=885a05785a714822b2012deb56880a73 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:17.054404 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798c0d7-ab49-4aa0-9232-001cabad1951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:17.055821 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798c0d7-ab49-4aa0-9232-001cabad1951 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:17.056134 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798c0d7-ab49-4aa0-9232-001cabad1951 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:17.056484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798c0d7-ab49-4aa0-9232-001cabad1951 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:17.084767 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798c0d7-ab49-4aa0-9232-001cabad1951 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:17.092646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-6798c0d7-ab49-4aa0-9232-001cabad1951 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 16:40:17.092646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:17.092646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:17.092646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:17.092646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:17.092646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:17.092646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:17.092646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:17.092646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:17.092646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:17.092646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:17.092646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:17.092646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:17.092646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:17.092646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:17.092646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:17.093516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:17.093516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:17.093516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:17.093516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:17.093516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:17.093516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:17.093516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:17.093516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:17.093516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:17.093516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:17.093516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:17.093516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:17.093516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:17.093516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:17.093516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:17.093516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:17.094866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:17.094866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:17.094866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:17.094866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:17.094866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:17.094866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:17.094866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:17.094866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:17.094866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:17.094866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:17.094866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 16:40:17.094866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:17.094866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 101/203] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:40:17.102327 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2112b25-23b8-4b41-ab51-2ba1f1fbd0d5 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:17.159598 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:17.247989 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2112b25-23b8-4b41-ab51-2ba1f1fbd0d5 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:17.291922 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1409a5-c54d-4548-a82f-e830bbbcbfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:17.292553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1409a5-c54d-4548-a82f-e830bbbcbfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:17.296124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1409a5-c54d-4548-a82f-e830bbbcbfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:17.296124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1409a5-c54d-4548-a82f-e830bbbcbfa1 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:17.296124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1409a5-c54d-4548-a82f-e830bbbcbfa1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:17.296124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1409a5-c54d-4548-a82f-e830bbbcbfa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:17.296124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1409a5-c54d-4548-a82f-e830bbbcbfa1 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:17.314396 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 103/204] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:17.315654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798c0d7-ab49-4aa0-9232-001cabad1951 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:17.407224 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:17.558315 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798c0d7-ab49-4aa0-9232-001cabad1951 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:17.620829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c182a-f1c1-4df8-8cac-bd241387e063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:17.621717 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c182a-f1c1-4df8-8cac-bd241387e063 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:17.622003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c182a-f1c1-4df8-8cac-bd241387e063 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:17.622281 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c182a-f1c1-4df8-8cac-bd241387e063 None admin] PATH_INFO: `/v3/users/c6ffc54f342f412f97331b94a3c786cf` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:17.625994 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c182a-f1c1-4df8-8cac-bd241387e063 None admin] RBAC: Authorizing `identity:get_user(user_id=c6ffc54f342f412f97331b94a3c786cf)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:17.627584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c182a-f1c1-4df8-8cac-bd241387e063 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:17.629507 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 102/205] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:17 2022] GET /identity/v3/users/c6ffc54f342f412f97331b94a3c786cf => generated 289 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:17.641295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1409a5-c54d-4548-a82f-e830bbbcbfa1 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:17.787083 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:17.798848 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1409a5-c54d-4548-a82f-e830bbbcbfa1 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:17.853936 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6edcd-0707-4389-924f-ff910fa28450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:17.854618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6edcd-0707-4389-924f-ff910fa28450 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:17.854905 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6edcd-0707-4389-924f-ff910fa28450 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:17.855187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6edcd-0707-4389-924f-ff910fa28450 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:18.002177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6edcd-0707-4389-924f-ff910fa28450 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:18.004902 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6edcd-0707-4389-924f-ff910fa28450 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:18.174749 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:18.191678 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 104/206] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:18.199381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c182a-f1c1-4df8-8cac-bd241387e063 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:18.384581 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c182a-f1c1-4df8-8cac-bd241387e063 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:18.388413 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:18.459427 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240762a-756c-4916-91ac-020ff1586fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:18.460237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240762a-756c-4916-91ac-020ff1586fac None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:18.460527 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240762a-756c-4916-91ac-020ff1586fac None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:18.460806 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240762a-756c-4916-91ac-020ff1586fac None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:18.464895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240762a-756c-4916-91ac-020ff1586fac None admin] RBAC: Authorizing `identity:get_project(project_id=d81536229a89416692cd909ecd4bd4ec)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:18.466353 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240762a-756c-4916-91ac-020ff1586fac None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:18.472867 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 103/207] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:18 2022] GET /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:18.473877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6edcd-0707-4389-924f-ff910fa28450 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:18.589554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6edcd-0707-4389-924f-ff910fa28450 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:18.631590 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b325c-72ea-42d5-8041-a0f4dd0d9fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:18.632284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b325c-72ea-42d5-8041-a0f4dd0d9fce None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:18.632572 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b325c-72ea-42d5-8041-a0f4dd0d9fce None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:18.632852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b325c-72ea-42d5-8041-a0f4dd0d9fce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:18.633739 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b325c-72ea-42d5-8041-a0f4dd0d9fce None admin] RBAC: Adding query filter params (role.id=434b9e3fd1f6417689c6bd184fbdb7e6, scope.project.id=d81536229a89416692cd909ecd4bd4ec, user.id=c6ffc54f342f412f97331b94a3c786cf) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:18.634059 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b325c-72ea-42d5-8041-a0f4dd0d9fce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:18.635524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b325c-72ea-42d5-8041-a0f4dd0d9fce None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:18.642414 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 105/208] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:40:18 2022] GET /identity/v3/role_assignments?user.id=c6ffc54f342f412f97331b94a3c786cf&scope.project.id=d81536229a89416692cd909ecd4bd4ec&role.id=434b9e3fd1f6417689c6bd184fbdb7e6 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:18.723714 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e3ea8-8ec6-4f65-af02-232d5f29d867 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:18.724013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e3ea8-8ec6-4f65-af02-232d5f29d867 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:18.724243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e3ea8-8ec6-4f65-af02-232d5f29d867 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:18.725999 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 104/209] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:18.731910 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953d8cb-9457-4c5a-956a-54db6642e686 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:18.732326 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953d8cb-9457-4c5a-956a-54db6642e686 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:18.732497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953d8cb-9457-4c5a-956a-54db6642e686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:18.755255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-e953d8cb-9457-4c5a-956a-54db6642e686 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:18.756523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e953d8cb-9457-4c5a-956a-54db6642e686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:18.827706 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:18.854861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 106/210] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:18.878633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e3ea8-8ec6-4f65-af02-232d5f29d867 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:18.984515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1a63b-b517-46f3-8ed6-46bb2d8f73f0 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:18.985154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1a63b-b517-46f3-8ed6-46bb2d8f73f0 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:18.985625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1a63b-b517-46f3-8ed6-46bb2d8f73f0 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:18.985977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e3ea8-8ec6-4f65-af02-232d5f29d867 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:18.987445 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 107/211] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:18.997722 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da001d1-5010-4691-8ca9-158c7e8427f5 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:18.998335 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da001d1-5010-4691-8ca9-158c7e8427f5 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:18.998812 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da001d1-5010-4691-8ca9-158c7e8427f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:19.028397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be118f22-58fd-4d5d-ac22-5959263e663a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:19.028397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be118f22-58fd-4d5d-ac22-5959263e663a None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:19.028704 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be118f22-58fd-4d5d-ac22-5959263e663a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:19.029020 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be118f22-58fd-4d5d-ac22-5959263e663a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:19.036290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-5da001d1-5010-4691-8ca9-158c7e8427f5 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:19.038472 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-5da001d1-5010-4691-8ca9-158c7e8427f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:19.042714 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be118f22-58fd-4d5d-ac22-5959263e663a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:19.052914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-be118f22-58fd-4d5d-ac22-5959263e663a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:19.052914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:19.052914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:19.052914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:19.052914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:19.052914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:19.052914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:19.052914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:19.052914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:19.052914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:19.052914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:19.052914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:19.052914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:19.052914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:19.052914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:19.052914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:19.053868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:19.053868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:19.053868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:19.053868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:19.053868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:19.053868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:19.053868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:19.053868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:19.053868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:19.053868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:19.053868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:19.053868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:19.053868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:19.053868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:19.053868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:19.053868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:19.054664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:19.054664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:19.054664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:19.054664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:19.054664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:19.054664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:19.054664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:19.054664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:19.054664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:19.054664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:19.054664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:19.054664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:19.058614 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 105/212] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:19.058614 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd258d-25e4-4abd-bd45-0691e7094f03 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:19.058614 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd258d-25e4-4abd-bd45-0691e7094f03 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:19.058614 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd258d-25e4-4abd-bd45-0691e7094f03 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:19.058614 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 106/213] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:19.061147 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd258d-25e4-4abd-bd45-0691e7094f03 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:19.098203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:19.119063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 108/214] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:19.120752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4f7a8-6e13-42d7-b6da-52552faea2af None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:19.121046 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4f7a8-6e13-42d7-b6da-52552faea2af None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:19.121327 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4f7a8-6e13-42d7-b6da-52552faea2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:19.145509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-4ef4f7a8-6e13-42d7-b6da-52552faea2af None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:19.146904 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-4ef4f7a8-6e13-42d7-b6da-52552faea2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:19.185779 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd258d-25e4-4abd-bd45-0691e7094f03 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:19.217126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 109/215] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:19.218177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4f7a8-6e13-42d7-b6da-52552faea2af None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:19.220916 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7a18b-dbf5-4859-a780-dae9a067e5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:19.221580 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7a18b-dbf5-4859-a780-dae9a067e5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:19.221867 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7a18b-dbf5-4859-a780-dae9a067e5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:19.222147 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7a18b-dbf5-4859-a780-dae9a067e5f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:19.222904 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7a18b-dbf5-4859-a780-dae9a067e5f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:19.223219 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7a18b-dbf5-4859-a780-dae9a067e5f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:19.224631 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7a18b-dbf5-4859-a780-dae9a067e5f0 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:19.235114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 107/216] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:19.240140 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7a18b-dbf5-4859-a780-dae9a067e5f0 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:19.283976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:19.337435 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:19.343645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4f7a8-6e13-42d7-b6da-52552faea2af None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:19.346268 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7a18b-dbf5-4859-a780-dae9a067e5f0 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:19.381029 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68dd236-92d4-4222-b29d-371cc811550b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:19.381890 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68dd236-92d4-4222-b29d-371cc811550b None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:19.382170 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68dd236-92d4-4222-b29d-371cc811550b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:19.382439 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68dd236-92d4-4222-b29d-371cc811550b None admin] PATH_INFO: `/v3/users/bdcd9d3876dd435bb1291403d56249c0` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:19.384452 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255c7ab-d8d2-4dc0-9f98-9bde03422fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:19.385407 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255c7ab-d8d2-4dc0-9f98-9bde03422fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:19.386462 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255c7ab-d8d2-4dc0-9f98-9bde03422fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:19.386752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255c7ab-d8d2-4dc0-9f98-9bde03422fa3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:19.396323 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68dd236-92d4-4222-b29d-371cc811550b None admin] RBAC: Authorizing `identity:get_user(user_id=bdcd9d3876dd435bb1291403d56249c0)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:19.397768 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68dd236-92d4-4222-b29d-371cc811550b None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:19.398834 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255c7ab-d8d2-4dc0-9f98-9bde03422fa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:19.399631 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 108/217] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:19 2022] GET /identity/v3/users/bdcd9d3876dd435bb1291403d56249c0 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:19.400956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68dd236-92d4-4222-b29d-371cc811550b None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:19.407691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-9255c7ab-d8d2-4dc0-9f98-9bde03422fa3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:40:19.407691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:19.407691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:19.407691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:19.407691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:19.407691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:19.407691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:19.407691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:19.407691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:19.407691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:19.407691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:19.407691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:19.407691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:19.407691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:19.407691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:19.407691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:19.408815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:19.408815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:19.408815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:19.408815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:19.408815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:19.408815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:19.408815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:19.408815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:19.408815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:19.408815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:19.408815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:19.408815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:19.408815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:19.408815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:19.408815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:19.408815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:19.414694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:19.414694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:19.414694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:19.414694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:19.414694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:19.414694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:19.414694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:19.414694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:19.414694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:19.414694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:19.414694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:40:19.414694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:19.414694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 110/218] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:40:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:19.414694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255c7ab-d8d2-4dc0-9f98-9bde03422fa3 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:19.507512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68dd236-92d4-4222-b29d-371cc811550b None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:19.519955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255c7ab-d8d2-4dc0-9f98-9bde03422fa3 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:19.523583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:19.541982 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03571352-784f-4569-8495-e4199361af62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:19.542816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03571352-784f-4569-8495-e4199361af62 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:19.543096 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03571352-784f-4569-8495-e4199361af62 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:19.543364 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03571352-784f-4569-8495-e4199361af62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:19.544556 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03571352-784f-4569-8495-e4199361af62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:19.546004 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03571352-784f-4569-8495-e4199361af62 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:19.547603 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 109/219] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:40:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:19.548382 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03571352-784f-4569-8495-e4199361af62 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:19.566365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce574456-59f3-4cbe-8209-a237393f8a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:19.567177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce574456-59f3-4cbe-8209-a237393f8a46 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:19.567483 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce574456-59f3-4cbe-8209-a237393f8a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:19.567812 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce574456-59f3-4cbe-8209-a237393f8a46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:19.568505 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:19.647361 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce574456-59f3-4cbe-8209-a237393f8a46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:19.648882 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce574456-59f3-4cbe-8209-a237393f8a46 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:19.651677 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03571352-784f-4569-8495-e4199361af62 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:19.685615 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b00bb-b922-4f2b-a0b9-2a40e67fa26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:19.686277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b00bb-b922-4f2b-a0b9-2a40e67fa26d None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:19.686564 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b00bb-b922-4f2b-a0b9-2a40e67fa26d None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:19.686843 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b00bb-b922-4f2b-a0b9-2a40e67fa26d None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:19.687593 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b00bb-b922-4f2b-a0b9-2a40e67fa26d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:19.687900 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b00bb-b922-4f2b-a0b9-2a40e67fa26d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:19.689321 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b00bb-b922-4f2b-a0b9-2a40e67fa26d None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:19.697096 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 110/220] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:19.697876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b00bb-b922-4f2b-a0b9-2a40e67fa26d None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:19.744367 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 111/221] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:19.745881 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74dd4b-35dc-4af9-8bd8-f6aa72aa798b None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:19.746170 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74dd4b-35dc-4af9-8bd8-f6aa72aa798b None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:19.746447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74dd4b-35dc-4af9-8bd8-f6aa72aa798b None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:19.747838 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 112/222] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:19.752333 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74dd4b-35dc-4af9-8bd8-f6aa72aa798b None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:19.755799 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:19.782939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:19.801346 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b00bb-b922-4f2b-a0b9-2a40e67fa26d None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:19.833906 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c044d-94d9-48dd-b25b-387926d5249d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:19.834564 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c044d-94d9-48dd-b25b-387926d5249d None admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:19.834846 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c044d-94d9-48dd-b25b-387926d5249d None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:19.835119 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c044d-94d9-48dd-b25b-387926d5249d None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:19.835825 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c044d-94d9-48dd-b25b-387926d5249d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:19.837817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c044d-94d9-48dd-b25b-387926d5249d None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:19.852202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74dd4b-35dc-4af9-8bd8-f6aa72aa798b None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:19.885424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947d772-9745-44bb-be81-70e44513cb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:19.886282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947d772-9745-44bb-be81-70e44513cb17 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:19.886611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947d772-9745-44bb-be81-70e44513cb17 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:19.886893 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947d772-9745-44bb-be81-70e44513cb17 None admin] PATH_INFO: `/v3/users/db2257787898445a9acbf032349530b8` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:19.888374 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947d772-9745-44bb-be81-70e44513cb17 None admin] RBAC: Authorizing `identity:get_user(user_id=db2257787898445a9acbf032349530b8)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:19.889817 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947d772-9745-44bb-be81-70e44513cb17 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:19.891455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 113/223] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:19 2022] GET /identity/v3/users/db2257787898445a9acbf032349530b8 => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:19.892235 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947d772-9745-44bb-be81-70e44513cb17 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:19.939452 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 111/224] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 16:40:19 2022] POST /identity/v3/users => generated 297 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:40:19.940835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc3e1-d06b-47d2-9440-b0e941f486e8 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:19.941047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc3e1-d06b-47d2-9440-b0e941f486e8 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:19.941376 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc3e1-d06b-47d2-9440-b0e941f486e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:19.959724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-230dc3e1-d06b-47d2-9440-b0e941f486e8 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:19.960999 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-230dc3e1-d06b-47d2-9440-b0e941f486e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:19.968761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:20.003676 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947d772-9745-44bb-be81-70e44513cb17 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:20.044260 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 112/225] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:20.044260 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dc3e1-d06b-47d2-9440-b0e941f486e8 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:20.066675 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647876a8-04af-4252-9fab-9d05ea1b41a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:20.067564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647876a8-04af-4252-9fab-9d05ea1b41a8 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:20.067836 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647876a8-04af-4252-9fab-9d05ea1b41a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:20.068141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647876a8-04af-4252-9fab-9d05ea1b41a8 None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:20.069387 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647876a8-04af-4252-9fab-9d05ea1b41a8 None admin] RBAC: Authorizing `identity:get_project(project_id=1d92be9a7941425d9b66dc77739c5443)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:20.071452 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647876a8-04af-4252-9fab-9d05ea1b41a8 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:20.073278 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 114/226] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:19 2022] GET /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:20.074063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647876a8-04af-4252-9fab-9d05ea1b41a8 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:20.122099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:20.162184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dc3e1-d06b-47d2-9440-b0e941f486e8 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:20.206633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde359e-9c76-40cb-af7e-3546ad333046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:20.207497 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde359e-9c76-40cb-af7e-3546ad333046 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:20.207778 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde359e-9c76-40cb-af7e-3546ad333046 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:20.208051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde359e-9c76-40cb-af7e-3546ad333046 None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:20.210446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647876a8-04af-4252-9fab-9d05ea1b41a8 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:20.210583 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde359e-9c76-40cb-af7e-3546ad333046 None admin] RBAC: Authorizing `identity:get_project(project_id=1d92be9a7941425d9b66dc77739c5443)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:20.212744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde359e-9c76-40cb-af7e-3546ad333046 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:20.214788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 113/227] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:20 2022] GET /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:20.215578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde359e-9c76-40cb-af7e-3546ad333046 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:20.255342 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e5a11-e980-4c15-9dcb-67485a96967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:20.256166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e5a11-e980-4c15-9dcb-67485a96967b None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:20.256450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e5a11-e980-4c15-9dcb-67485a96967b None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:20.256724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e5a11-e980-4c15-9dcb-67485a96967b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:20.267888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:20.272576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e5a11-e980-4c15-9dcb-67485a96967b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:20.283830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-f08e5a11-e980-4c15-9dcb-67485a96967b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:20.283830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:20.283830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:20.283830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:20.283830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:20.283830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:20.283830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:20.283830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:20.283830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:20.283830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:20.283830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:20.283830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:20.283830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:20.283830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:20.283830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:20.283830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:20.284796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:20.284796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:20.284796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:20.284796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:20.284796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:20.284796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:20.284796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:20.284796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:20.284796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:20.284796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:20.284796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:20.284796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:20.284796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:20.284796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:20.284796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:20.284796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:20.285611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:20.285611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:20.285611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:20.285611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:20.285611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:20.285611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:20.285611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:20.285611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:20.285611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:20.285611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:20.285611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:20.285611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:20.285611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 115/228] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:40:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:20.285611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e5a11-e980-4c15-9dcb-67485a96967b None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:20.353478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde359e-9c76-40cb-af7e-3546ad333046 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:20.403422 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5618a-9826-4e2d-88d8-f2584634bd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:20.404522 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5618a-9826-4e2d-88d8-f2584634bd42 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:20.404998 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5618a-9826-4e2d-88d8-f2584634bd42 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:20.405693 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5618a-9826-4e2d-88d8-f2584634bd42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:20.406855 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e5a11-e980-4c15-9dcb-67485a96967b None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:20.407564 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5618a-9826-4e2d-88d8-f2584634bd42 None admin] RBAC: Adding query filter params (role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2, scope.project.id=1d92be9a7941425d9b66dc77739c5443, user.id=bdcd9d3876dd435bb1291403d56249c0) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:20.408287 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5618a-9826-4e2d-88d8-f2584634bd42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:20.409947 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5618a-9826-4e2d-88d8-f2584634bd42 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:20.412313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:20.417579 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 114/229] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:40:20 2022] GET /identity/v3/role_assignments?user.id=bdcd9d3876dd435bb1291403d56249c0&scope.project.id=1d92be9a7941425d9b66dc77739c5443&role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:20.418652 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5618a-9826-4e2d-88d8-f2584634bd42 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:20.454152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e43ef2-9812-4fcb-b6ad-c51d985895cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:20.455063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e43ef2-9812-4fcb-b6ad-c51d985895cc None admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:20.455406 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e43ef2-9812-4fcb-b6ad-c51d985895cc None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:20.455693 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e43ef2-9812-4fcb-b6ad-c51d985895cc None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443/users/db2257787898445a9acbf032349530b8/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:20.458293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e43ef2-9812-4fcb-b6ad-c51d985895cc None admin] RBAC: Authorizing `identity:create_grant(project_id=1d92be9a7941425d9b66dc77739c5443, user_id=db2257787898445a9acbf032349530b8, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:20.459790 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e43ef2-9812-4fcb-b6ad-c51d985895cc None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:20.540627 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 116/230] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:40:20 2022] PUT /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443/users/db2257787898445a9acbf032349530b8/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:40:20.563445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5618a-9826-4e2d-88d8-f2584634bd42 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:20.614713 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7150ee1-fd1b-43d6-a595-62c85f0e3ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:20.615365 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7150ee1-fd1b-43d6-a595-62c85f0e3ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:20.615651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7150ee1-fd1b-43d6-a595-62c85f0e3ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:20.615929 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7150ee1-fd1b-43d6-a595-62c85f0e3ca7 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:20.616823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7150ee1-fd1b-43d6-a595-62c85f0e3ca7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:20.617145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7150ee1-fd1b-43d6-a595-62c85f0e3ca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:20.622488 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7150ee1-fd1b-43d6-a595-62c85f0e3ca7 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:20.628447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 115/231] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:40:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:20.634826 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e43ef2-9812-4fcb-b6ad-c51d985895cc None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:20.706628 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:20.752714 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e43ef2-9812-4fcb-b6ad-c51d985895cc None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:20.797134 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abce45-f2d7-4119-a78d-4f8178b5c94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:20.798071 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abce45-f2d7-4119-a78d-4f8178b5c94c None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:20.798361 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abce45-f2d7-4119-a78d-4f8178b5c94c None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:20.798639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abce45-f2d7-4119-a78d-4f8178b5c94c None admin] PATH_INFO: `/v3/users/db2257787898445a9acbf032349530b8` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:20.799847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abce45-f2d7-4119-a78d-4f8178b5c94c None admin] RBAC: Authorizing `identity:get_user(user_id=db2257787898445a9acbf032349530b8)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:20.801453 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abce45-f2d7-4119-a78d-4f8178b5c94c None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:20.804433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 117/232] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:20 2022] GET /identity/v3/users/db2257787898445a9acbf032349530b8 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:20.809540 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7150ee1-fd1b-43d6-a595-62c85f0e3ca7 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:20.872859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:20.915410 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7150ee1-fd1b-43d6-a595-62c85f0e3ca7 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:20.951526 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751f699-4450-49a9-8355-d9b27068e0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:20.952420 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751f699-4450-49a9-8355-d9b27068e0fa None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:20.952711 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751f699-4450-49a9-8355-d9b27068e0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:20.952992 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751f699-4450-49a9-8355-d9b27068e0fa None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:20.954214 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751f699-4450-49a9-8355-d9b27068e0fa None admin] RBAC: Authorizing `identity:get_project(project_id=1d92be9a7941425d9b66dc77739c5443)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:20.955665 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a751f699-4450-49a9-8355-d9b27068e0fa None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:20.957458 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 116/233] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:20 2022] GET /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:20.963816 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abce45-f2d7-4119-a78d-4f8178b5c94c None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:21.122308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abce45-f2d7-4119-a78d-4f8178b5c94c None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:21.157265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:21.171548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3601b91-ff73-4f45-9db5-ea5b4d0d5e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:21.172741 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3601b91-ff73-4f45-9db5-ea5b4d0d5e89 None admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:21.173182 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3601b91-ff73-4f45-9db5-ea5b4d0d5e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:21.173609 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3601b91-ff73-4f45-9db5-ea5b4d0d5e89 None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443/users/db2257787898445a9acbf032349530b8/roles/885a05785a714822b2012deb56880a73` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:21.177507 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3601b91-ff73-4f45-9db5-ea5b4d0d5e89 None admin] RBAC: Authorizing `identity:create_grant(project_id=1d92be9a7941425d9b66dc77739c5443, user_id=db2257787898445a9acbf032349530b8, role_id=885a05785a714822b2012deb56880a73)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:21.179252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3601b91-ff73-4f45-9db5-ea5b4d0d5e89 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:21.324142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 118/234] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:40:20 2022] PUT /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443/users/db2257787898445a9acbf032349530b8/roles/885a05785a714822b2012deb56880a73 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:40:22.408358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac7af7-1913-42d4-a7bd-7b09e7bf4b9c None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:22.408868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac7af7-1913-42d4-a7bd-7b09e7bf4b9c None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:22.408975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac7af7-1913-42d4-a7bd-7b09e7bf4b9c None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:22.410280 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 117/235] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:40:22.416190 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823e4c7-f323-4534-a577-0310bfb57f94 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:22.416596 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823e4c7-f323-4534-a577-0310bfb57f94 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:22.416931 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823e4c7-f323-4534-a577-0310bfb57f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:22.434098 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-1823e4c7-f323-4534-a577-0310bfb57f94 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:22.435455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-1823e4c7-f323-4534-a577-0310bfb57f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:22.526710 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 119/236] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:40:22.558870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac7af7-1913-42d4-a7bd-7b09e7bf4b9c None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:22.627067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac890bd-7f8c-4a83-b8e4-7e7793ebf201 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:22.627698 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac890bd-7f8c-4a83-b8e4-7e7793ebf201 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:22.628281 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac890bd-7f8c-4a83-b8e4-7e7793ebf201 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:22.632406 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 120/237] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:40:22.638575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2104986-740d-480b-b756-160364bcc4fc None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:22.638858 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2104986-740d-480b-b756-160364bcc4fc None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:22.639132 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2104986-740d-480b-b756-160364bcc4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:22.658144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-f2104986-740d-480b-b756-160364bcc4fc None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:22.659537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f2104986-740d-480b-b756-160364bcc4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:22.716634 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac7af7-1913-42d4-a7bd-7b09e7bf4b9c None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:22.762117 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:22.771180 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 121/238] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:40:22.775041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dd3ed-a4df-4528-9a66-ed2c089f0041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:22.777048 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dd3ed-a4df-4528-9a66-ed2c089f0041 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:22.777048 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dd3ed-a4df-4528-9a66-ed2c089f0041 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:22.777048 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dd3ed-a4df-4528-9a66-ed2c089f0041 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:22.787387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dd3ed-a4df-4528-9a66-ed2c089f0041 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:22.795073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-cc8dd3ed-a4df-4528-9a66-ed2c089f0041 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 16:40:22.795073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:22.795073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:22.795073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:22.795073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:22.795073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:22.795073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:22.795073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:22.795073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:22.795073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:22.795073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:22.795073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:22.795073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:22.795073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:22.795073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:22.795073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:22.795936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:22.795936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:22.795936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:22.795936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:22.795936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:22.795936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:22.795936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:22.795936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:22.795936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:22.795936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:22.795936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:22.795936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:22.795936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:22.795936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:22.795936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:22.795936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:22.796860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:22.796860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:22.796860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:22.796860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:22.796860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:22.796860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:22.796860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:22.796860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:22.796860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:22.796860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:22.796860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 16:40:22.796860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:22.796860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 118/239] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:22.802214 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2104986-740d-480b-b756-160364bcc4fc None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:22.815028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dd3ed-a4df-4528-9a66-ed2c089f0041 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:22.892487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:22.985262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dd3ed-a4df-4528-9a66-ed2c089f0041 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:22.986399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2104986-740d-480b-b756-160364bcc4fc None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:23.032126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a952c8a-c932-495c-85e4-011e9c0cf94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:23.032126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a952c8a-c932-495c-85e4-011e9c0cf94f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:23.032126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a952c8a-c932-495c-85e4-011e9c0cf94f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:23.032126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a952c8a-c932-495c-85e4-011e9c0cf94f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:23.032475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a952c8a-c932-495c-85e4-011e9c0cf94f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:23.032475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a952c8a-c932-495c-85e4-011e9c0cf94f None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:23.034809 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 119/240] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:40:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:23.042507 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a952c8a-c932-495c-85e4-011e9c0cf94f None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:23.053369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac9f65-400b-4f65-9fe8-1334fa68b374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:23.054049 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac9f65-400b-4f65-9fe8-1334fa68b374 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:23.054337 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac9f65-400b-4f65-9fe8-1334fa68b374 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:23.054621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac9f65-400b-4f65-9fe8-1334fa68b374 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:23.055943 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac9f65-400b-4f65-9fe8-1334fa68b374 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:23.056308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac9f65-400b-4f65-9fe8-1334fa68b374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:23.057726 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac9f65-400b-4f65-9fe8-1334fa68b374 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:23.066902 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 122/241] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:23.068328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6ed92-d6dc-41dc-aa85-c7736bf60c33 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:23.068624 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6ed92-d6dc-41dc-aa85-c7736bf60c33 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:23.068905 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6ed92-d6dc-41dc-aa85-c7736bf60c33 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:23.070182 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 123/242] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:23.075762 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6ed92-d6dc-41dc-aa85-c7736bf60c33 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:23.117159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:23.161471 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a952c8a-c932-495c-85e4-011e9c0cf94f None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:23.181393 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6ed92-d6dc-41dc-aa85-c7736bf60c33 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:23.192383 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:23.204339 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2c8d3-f8ae-4a7e-bb82-672a7fc85b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:23.205396 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2c8d3-f8ae-4a7e-bb82-672a7fc85b1d None admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:23.206151 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2c8d3-f8ae-4a7e-bb82-672a7fc85b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:23.206896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2c8d3-f8ae-4a7e-bb82-672a7fc85b1d None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:23.208008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2c8d3-f8ae-4a7e-bb82-672a7fc85b1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:23.210185 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2c8d3-f8ae-4a7e-bb82-672a7fc85b1d None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:23.215850 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83786ab1-9d71-49a2-8cb8-892087174ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:23.216742 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83786ab1-9d71-49a2-8cb8-892087174ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:23.217030 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83786ab1-9d71-49a2-8cb8-892087174ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:23.217309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83786ab1-9d71-49a2-8cb8-892087174ae3 None admin] PATH_INFO: `/v3/users/4920fb027f394e8d86af12c8ec37adb3` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:23.232168 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83786ab1-9d71-49a2-8cb8-892087174ae3 None admin] RBAC: Authorizing `identity:get_user(user_id=4920fb027f394e8d86af12c8ec37adb3)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:23.233639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83786ab1-9d71-49a2-8cb8-892087174ae3 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:23.238811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 124/243] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:23 2022] GET /identity/v3/users/4920fb027f394e8d86af12c8ec37adb3 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:23.238811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab72b23-91da-4ade-82da-7e108bac5967 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:23.238811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab72b23-91da-4ade-82da-7e108bac5967 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:23.238811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab72b23-91da-4ade-82da-7e108bac5967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:23.253262 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-5ab72b23-91da-4ade-82da-7e108bac5967 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:23.254432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-5ab72b23-91da-4ade-82da-7e108bac5967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:23.279235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 120/244] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 16:40:23 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:40:23.280949 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c84fee-0c2c-46e6-9f42-c01792ef511a None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:23.281803 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c84fee-0c2c-46e6-9f42-c01792ef511a None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:23.282568 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c84fee-0c2c-46e6-9f42-c01792ef511a None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:23.284788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 121/245] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:23.285938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c84fee-0c2c-46e6-9f42-c01792ef511a None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:23.347142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 125/246] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:23.347142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b23138-f8b7-47df-baac-c45d329813cd None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:23.347142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b23138-f8b7-47df-baac-c45d329813cd None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:23.347142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b23138-f8b7-47df-baac-c45d329813cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:23.366024 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-33b23138-f8b7-47df-baac-c45d329813cd None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:23.367978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-33b23138-f8b7-47df-baac-c45d329813cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:23.452092 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c84fee-0c2c-46e6-9f42-c01792ef511a None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:23.459381 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 126/247] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:23.460357 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b23138-f8b7-47df-baac-c45d329813cd None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:23.478515 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:23.498487 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce5d4e-07b8-40fb-bff2-5e230a463683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:23.498873 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:23.499062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce5d4e-07b8-40fb-bff2-5e230a463683 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:23.500044 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce5d4e-07b8-40fb-bff2-5e230a463683 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:23.500044 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce5d4e-07b8-40fb-bff2-5e230a463683 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:23.581002 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce5d4e-07b8-40fb-bff2-5e230a463683 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:23.581225 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b23138-f8b7-47df-baac-c45d329813cd None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:23.581324 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce5d4e-07b8-40fb-bff2-5e230a463683 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:23.624466 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242566f-f301-4348-9e31-bb3d8c27cf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:23.625526 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242566f-f301-4348-9e31-bb3d8c27cf23 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:23.626620 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242566f-f301-4348-9e31-bb3d8c27cf23 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:23.626901 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242566f-f301-4348-9e31-bb3d8c27cf23 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:23.644418 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242566f-f301-4348-9e31-bb3d8c27cf23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:23.652350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-4242566f-f301-4348-9e31-bb3d8c27cf23 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:23.652350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:23.652350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:23.652350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:23.652350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:23.652350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:23.652350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:23.652350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:23.652350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:23.652350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:23.652350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:23.652350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:23.652350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:23.652350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:23.652350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:23.652350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:23.653279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:23.653279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:23.653279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:23.653279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:23.653279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:23.653279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:23.653279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:23.653279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:23.653279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:23.653279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:23.653279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:23.653279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:23.653279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:23.653279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:23.653279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:23.653279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:23.654145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:23.654145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:23.654145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:23.654145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:23.654145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:23.654145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:23.654145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:23.654145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:23.654145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:23.654145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:23.654145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:23.654145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:23.654145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 127/248] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:23.656796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242566f-f301-4348-9e31-bb3d8c27cf23 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:23.714960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 122/249] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:23.716125 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce5d4e-07b8-40fb-bff2-5e230a463683 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:23.739126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:23.767535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:23.788390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242566f-f301-4348-9e31-bb3d8c27cf23 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:23.844814 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd15f37-efef-4469-bc6f-8bb010f38560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:23.845620 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd15f37-efef-4469-bc6f-8bb010f38560 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:23.845907 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd15f37-efef-4469-bc6f-8bb010f38560 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:23.846186 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd15f37-efef-4469-bc6f-8bb010f38560 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:23.864343 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce5d4e-07b8-40fb-bff2-5e230a463683 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:23.868696 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd15f37-efef-4469-bc6f-8bb010f38560 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:23.876553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-abd15f37-efef-4469-bc6f-8bb010f38560 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:40:23.876553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:23.876553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:23.876553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:23.876553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:23.876553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:23.876553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:23.876553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:23.876553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:23.876553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:23.876553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:23.876553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:23.876553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:23.876553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:23.876553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:23.876553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:23.877450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:23.877450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:23.877450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:23.877450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:23.877450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:23.877450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:23.877450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:23.877450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:23.877450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:23.877450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:23.877450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:23.877450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:23.877450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:23.877450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:23.877450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:23.877450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:23.878229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:23.878229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:23.878229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:23.878229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:23.878229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:23.878229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:23.878229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:23.878229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:23.878229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:23.878229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:23.878229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:40:23.878229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:23.880879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 128/250] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:40:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:23.881878 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd15f37-efef-4469-bc6f-8bb010f38560 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:23.953378 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f6257-21ff-4868-9c1b-6a04a8e7d907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:23.954079 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f6257-21ff-4868-9c1b-6a04a8e7d907 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:23.954368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f6257-21ff-4868-9c1b-6a04a8e7d907 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:23.954619 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f6257-21ff-4868-9c1b-6a04a8e7d907 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:23.955386 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f6257-21ff-4868-9c1b-6a04a8e7d907 None admin] RBAC: Adding query filter params (name=member) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:23.955696 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f6257-21ff-4868-9c1b-6a04a8e7d907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:23.957112 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f6257-21ff-4868-9c1b-6a04a8e7d907 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:23.980263 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 123/251] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:23.982472 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f6257-21ff-4868-9c1b-6a04a8e7d907 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:24.005934 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd15f37-efef-4469-bc6f-8bb010f38560 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:24.042883 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e5cc9-a4e9-4f8c-873e-55121d7eae69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:24.043889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e5cc9-a4e9-4f8c-873e-55121d7eae69 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:24.044295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e5cc9-a4e9-4f8c-873e-55121d7eae69 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:24.044667 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e5cc9-a4e9-4f8c-873e-55121d7eae69 None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:24.046064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e5cc9-a4e9-4f8c-873e-55121d7eae69 None admin] RBAC: Authorizing `identity:get_project(project_id=1d92be9a7941425d9b66dc77739c5443)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:24.047685 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e5cc9-a4e9-4f8c-873e-55121d7eae69 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:24.049617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 129/252] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:23 2022] GET /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:24.050467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e5cc9-a4e9-4f8c-873e-55121d7eae69 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:24.074098 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:24.108584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:24.138908 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f6257-21ff-4868-9c1b-6a04a8e7d907 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:24.166978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e5cc9-a4e9-4f8c-873e-55121d7eae69 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:24.176914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a1807-5873-47a9-a517-399be43a0856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:24.177908 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a1807-5873-47a9-a517-399be43a0856 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:24.178399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a1807-5873-47a9-a517-399be43a0856 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:24.178852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a1807-5873-47a9-a517-399be43a0856 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:24.179830 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a1807-5873-47a9-a517-399be43a0856 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:24.180423 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a1807-5873-47a9-a517-399be43a0856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:24.182122 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a1807-5873-47a9-a517-399be43a0856 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:24.191201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 124/253] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:24.193295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12db62-19b5-4aac-b518-96b4dd3fb81e None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:24.194223 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12db62-19b5-4aac-b518-96b4dd3fb81e None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:24.194974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12db62-19b5-4aac-b518-96b4dd3fb81e None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:24.197788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 125/254] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:24.198720 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12db62-19b5-4aac-b518-96b4dd3fb81e None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:24.206020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e8090-88de-4ae2-a732-f2445490fbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:24.206902 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e8090-88de-4ae2-a732-f2445490fbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:24.207191 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e8090-88de-4ae2-a732-f2445490fbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:24.207472 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e8090-88de-4ae2-a732-f2445490fbe1 None admin] PATH_INFO: `/v3/users/bdcd9d3876dd435bb1291403d56249c0` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:24.208758 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e8090-88de-4ae2-a732-f2445490fbe1 None admin] RBAC: Authorizing `identity:get_user(user_id=bdcd9d3876dd435bb1291403d56249c0)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:24.210212 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e8090-88de-4ae2-a732-f2445490fbe1 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:24.212705 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 130/255] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:24 2022] GET /identity/v3/users/bdcd9d3876dd435bb1291403d56249c0 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:24.213200 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e8090-88de-4ae2-a732-f2445490fbe1 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:24.304197 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:24.324159 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e8090-88de-4ae2-a732-f2445490fbe1 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:24.337501 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12db62-19b5-4aac-b518-96b4dd3fb81e None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:24.364693 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c314c34-c539-4d93-b76c-ce30daf7916b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:24.365570 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c314c34-c539-4d93-b76c-ce30daf7916b None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:24.365887 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c314c34-c539-4d93-b76c-ce30daf7916b None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:24.366133 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c314c34-c539-4d93-b76c-ce30daf7916b None admin] PATH_INFO: `/v3/users/db2257787898445a9acbf032349530b8` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:24.367481 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c314c34-c539-4d93-b76c-ce30daf7916b None admin] RBAC: Authorizing `identity:get_user(user_id=db2257787898445a9acbf032349530b8)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:24.368991 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c314c34-c539-4d93-b76c-ce30daf7916b None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:24.370700 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 131/256] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:24 2022] GET /identity/v3/users/db2257787898445a9acbf032349530b8 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:24.372027 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88a52d-a61a-4a5c-878f-a86d50623014 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:24.372244 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88a52d-a61a-4a5c-878f-a86d50623014 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:24.372528 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88a52d-a61a-4a5c-878f-a86d50623014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:24.381396 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33a628-611d-4b3b-bdb9-3246808cc53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:24.382340 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33a628-611d-4b3b-bdb9-3246808cc53f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:24.382823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33a628-611d-4b3b-bdb9-3246808cc53f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:24.383915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33a628-611d-4b3b-bdb9-3246808cc53f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:24.386574 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33a628-611d-4b3b-bdb9-3246808cc53f None admin] RBAC: Adding query filter params (role.id=434b9e3fd1f6417689c6bd184fbdb7e6, scope.project.id=1d92be9a7941425d9b66dc77739c5443, user.id=4920fb027f394e8d86af12c8ec37adb3) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:24.387635 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33a628-611d-4b3b-bdb9-3246808cc53f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:24.390186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33a628-611d-4b3b-bdb9-3246808cc53f None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:24.390566 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-da88a52d-a61a-4a5c-878f-a86d50623014 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:24.391854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-da88a52d-a61a-4a5c-878f-a86d50623014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:24.400483 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:24.403142 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 126/257] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:40:24 2022] GET /identity/v3/role_assignments?user.id=4920fb027f394e8d86af12c8ec37adb3&scope.project.id=1d92be9a7941425d9b66dc77739c5443&role.id=434b9e3fd1f6417689c6bd184fbdb7e6 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:24.404812 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33a628-611d-4b3b-bdb9-3246808cc53f None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:24.544567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 132/258] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:24.545275 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88a52d-a61a-4a5c-878f-a86d50623014 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:24.623543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33a628-611d-4b3b-bdb9-3246808cc53f None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:24.727822 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bdc1a-98a8-46a6-ab8d-4f78c2f0122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:24.728716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bdc1a-98a8-46a6-ab8d-4f78c2f0122d None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:24.728998 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bdc1a-98a8-46a6-ab8d-4f78c2f0122d None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:24.729274 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bdc1a-98a8-46a6-ab8d-4f78c2f0122d None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:24.730586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bdc1a-98a8-46a6-ab8d-4f78c2f0122d None admin] RBAC: Authorizing `identity:get_project(project_id=1d92be9a7941425d9b66dc77739c5443)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:24.732060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bdc1a-98a8-46a6-ab8d-4f78c2f0122d None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:24.733792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 127/259] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:24 2022] GET /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443 => generated 302 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:24.738016 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bdc1a-98a8-46a6-ab8d-4f78c2f0122d None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:24.744325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:24.782983 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88a52d-a61a-4a5c-878f-a86d50623014 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:24.848229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdf27b-5f7e-450d-b5f4-7c0908b72ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:24.848908 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdf27b-5f7e-450d-b5f4-7c0908b72ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:24.849193 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdf27b-5f7e-450d-b5f4-7c0908b72ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:24.849471 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdf27b-5f7e-450d-b5f4-7c0908b72ac9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:24.854234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:24.918007 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bdc1a-98a8-46a6-ab8d-4f78c2f0122d None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:24.964975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa45b81-2fce-438c-8dac-38c85cc7b26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:24.965794 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa45b81-2fce-438c-8dac-38c85cc7b26b None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:24.966079 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa45b81-2fce-438c-8dac-38c85cc7b26b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:24.966357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa45b81-2fce-438c-8dac-38c85cc7b26b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:24.967180 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bdf27b-5f7e-450d-b5f4-7c0908b72ac9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:24.968704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bdf27b-5f7e-450d-b5f4-7c0908b72ac9 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:24.985143 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa45b81-2fce-438c-8dac-38c85cc7b26b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:24.994656 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-aaa45b81-2fce-438c-8dac-38c85cc7b26b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:24.994656 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:24.994656 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:24.994656 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:24.994656 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:24.994656 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:24.994656 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:24.994656 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:24.994656 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:24.994656 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:24.994656 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:24.994656 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:24.994656 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:24.994656 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:24.994656 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:24.994656 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:24.995555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:24.995555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:24.995555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:24.995555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:24.995555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:24.995555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:24.995555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:24.995555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:24.995555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:24.995555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:24.995555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:24.995555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:24.995555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:24.995555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:24.995555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:24.995555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:24.997509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:24.997509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:24.997509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:24.997509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:24.997509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:24.997509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:24.997509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:24.997509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:24.997509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:24.997509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:24.997509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:24.997509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:24.997509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 128/260] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:40:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:24.997509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa45b81-2fce-438c-8dac-38c85cc7b26b None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:25.070278 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:25.090797 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 133/261] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:25.090797 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdf27b-5f7e-450d-b5f4-7c0908b72ac9 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:25.194415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdf27b-5f7e-450d-b5f4-7c0908b72ac9 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:25.229643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c799b-8ab0-4c00-ac72-685115a7a907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:25.230315 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c799b-8ab0-4c00-ac72-685115a7a907 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:25.230604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c799b-8ab0-4c00-ac72-685115a7a907 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:25.230881 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c799b-8ab0-4c00-ac72-685115a7a907 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:25.231640 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c799b-8ab0-4c00-ac72-685115a7a907 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:25.232060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c799b-8ab0-4c00-ac72-685115a7a907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:25.233479 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c799b-8ab0-4c00-ac72-685115a7a907 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:25.241650 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 134/262] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:40:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:25.243047 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c799b-8ab0-4c00-ac72-685115a7a907 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:25.290643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa45b81-2fce-438c-8dac-38c85cc7b26b None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:25.296462 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:25.351402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c799b-8ab0-4c00-ac72-685115a7a907 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:25.365149 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:25.388630 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3beb15-c6fd-4a43-b3de-80c1890832f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:25.389498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3beb15-c6fd-4a43-b3de-80c1890832f7 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:25.389787 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3beb15-c6fd-4a43-b3de-80c1890832f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:25.390917 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3beb15-c6fd-4a43-b3de-80c1890832f7 None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:25.392171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3beb15-c6fd-4a43-b3de-80c1890832f7 None admin] RBAC: Authorizing `identity:get_project(project_id=1d92be9a7941425d9b66dc77739c5443)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:25.393645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3beb15-c6fd-4a43-b3de-80c1890832f7 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:25.395657 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 135/263] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:25 2022] GET /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:25.396553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3beb15-c6fd-4a43-b3de-80c1890832f7 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:25.396789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf201718-2952-46b2-87a4-ca8e410e1730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:25.397687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf201718-2952-46b2-87a4-ca8e410e1730 None admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:25.397974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf201718-2952-46b2-87a4-ca8e410e1730 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:25.398257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf201718-2952-46b2-87a4-ca8e410e1730 None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443/users/bdcd9d3876dd435bb1291403d56249c0/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:25.404920 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf201718-2952-46b2-87a4-ca8e410e1730 None admin] RBAC: Authorizing `identity:create_grant(project_id=1d92be9a7941425d9b66dc77739c5443, user_id=bdcd9d3876dd435bb1291403d56249c0, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:25.406414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf201718-2952-46b2-87a4-ca8e410e1730 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:25.497705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 129/264] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:40:24 2022] PUT /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443/users/bdcd9d3876dd435bb1291403d56249c0/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:40:25.498571 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf201718-2952-46b2-87a4-ca8e410e1730 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:25.505487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3beb15-c6fd-4a43-b3de-80c1890832f7 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:25.520678 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:25.544852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82237e-bd11-4f5a-bd16-34cef4875a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:25.545885 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82237e-bd11-4f5a-bd16-34cef4875a9b None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:25.546172 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82237e-bd11-4f5a-bd16-34cef4875a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:25.546451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82237e-bd11-4f5a-bd16-34cef4875a9b None admin] PATH_INFO: `/v3/users/db2257787898445a9acbf032349530b8` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:25.547778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82237e-bd11-4f5a-bd16-34cef4875a9b None admin] RBAC: Authorizing `identity:get_user(user_id=db2257787898445a9acbf032349530b8)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:25.549545 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82237e-bd11-4f5a-bd16-34cef4875a9b None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:25.551234 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 136/265] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:25 2022] GET /identity/v3/users/db2257787898445a9acbf032349530b8 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:25.556802 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82237e-bd11-4f5a-bd16-34cef4875a9b None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:25.668579 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82237e-bd11-4f5a-bd16-34cef4875a9b None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:25.708265 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf201718-2952-46b2-87a4-ca8e410e1730 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:25.724299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72318416-3c41-4318-be06-2756e57445a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:25.724968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72318416-3c41-4318-be06-2756e57445a8 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:25.725254 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72318416-3c41-4318-be06-2756e57445a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:25.725536 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72318416-3c41-4318-be06-2756e57445a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:25.790369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7f350-1fb2-4d71-820d-288e4dce4790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:25.790959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7f350-1fb2-4d71-820d-288e4dce4790 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:25.791246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7f350-1fb2-4d71-820d-288e4dce4790 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:25.791529 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7f350-1fb2-4d71-820d-288e4dce4790 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:25.792417 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7f350-1fb2-4d71-820d-288e4dce4790 None admin] RBAC: Adding query filter params (role.id=459b0e5c21c94fb1b81f76c65780fdb5, scope.project.id=1d92be9a7941425d9b66dc77739c5443, user.id=db2257787898445a9acbf032349530b8) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:25.792736 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7f350-1fb2-4d71-820d-288e4dce4790 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:25.794214 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7f350-1fb2-4d71-820d-288e4dce4790 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:25.815867 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 130/266] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:40:25 2022] GET /identity/v3/role_assignments?user.id=db2257787898445a9acbf032349530b8&scope.project.id=1d92be9a7941425d9b66dc77739c5443&role.id=459b0e5c21c94fb1b81f76c65780fdb5 => generated 608 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:25.828649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:25.850255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72318416-3c41-4318-be06-2756e57445a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:25.851850 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72318416-3c41-4318-be06-2756e57445a8 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:25.960308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 137/267] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 16:40:25.965944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e732e4-eb59-4c54-a98f-df7b15113708 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:25.966243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e732e4-eb59-4c54-a98f-df7b15113708 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:25.966531 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e732e4-eb59-4c54-a98f-df7b15113708 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:25.968005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 131/268] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:25.970181 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72318416-3c41-4318-be06-2756e57445a8 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:25.973381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdba3a8-831e-40c5-9c44-88b313b95fcc None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:25.973671 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdba3a8-831e-40c5-9c44-88b313b95fcc None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:25.973950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdba3a8-831e-40c5-9c44-88b313b95fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:26.016439 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-1fdba3a8-831e-40c5-9c44-88b313b95fcc None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:26.017710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-1fdba3a8-831e-40c5-9c44-88b313b95fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:26.065573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:26.084194 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72318416-3c41-4318-be06-2756e57445a8 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:26.122490 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d22114-95bc-4641-b276-c3f1dba7cefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:26.124461 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d22114-95bc-4641-b276-c3f1dba7cefc None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:26.125113 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d22114-95bc-4641-b276-c3f1dba7cefc None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:26.125572 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d22114-95bc-4641-b276-c3f1dba7cefc None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:26.127125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d22114-95bc-4641-b276-c3f1dba7cefc None admin] RBAC: Authorizing `identity:get_project(project_id=1d92be9a7941425d9b66dc77739c5443)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:26.128871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d22114-95bc-4641-b276-c3f1dba7cefc None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:26.133525 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 138/269] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:25 2022] GET /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:26.135070 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71766375-52fb-42c4-a7be-4871a452314d None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:26.135357 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71766375-52fb-42c4-a7be-4871a452314d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:26.135796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71766375-52fb-42c4-a7be-4871a452314d None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:26.140439 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:26.142832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 139/270] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:26.148124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71766375-52fb-42c4-a7be-4871a452314d None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:26.176577 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 132/271] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:26.178745 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5182519-e009-4818-96c5-70ca32666d5b None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:26.179307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5182519-e009-4818-96c5-70ca32666d5b None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:26.182508 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5182519-e009-4818-96c5-70ca32666d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:26.214615 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-f5182519-e009-4818-96c5-70ca32666d5b None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:26.216292 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-f5182519-e009-4818-96c5-70ca32666d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:26.262575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71766375-52fb-42c4-a7be-4871a452314d None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:26.307013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 133/272] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:26.307882 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5182519-e009-4818-96c5-70ca32666d5b None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:26.313973 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9718ef-857d-4824-b84b-360740b86a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:26.314646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9718ef-857d-4824-b84b-360740b86a26 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:26.314928 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9718ef-857d-4824-b84b-360740b86a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:26.315205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9718ef-857d-4824-b84b-360740b86a26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:26.316183 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9718ef-857d-4824-b84b-360740b86a26 None admin] RBAC: Adding query filter params (role.id=885a05785a714822b2012deb56880a73, scope.project.id=1d92be9a7941425d9b66dc77739c5443, user.id=db2257787898445a9acbf032349530b8) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:26.316419 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9718ef-857d-4824-b84b-360740b86a26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:26.317885 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9718ef-857d-4824-b84b-360740b86a26 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:26.338030 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 140/273] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:40:26 2022] GET /identity/v3/role_assignments?user.id=db2257787898445a9acbf032349530b8&scope.project.id=1d92be9a7941425d9b66dc77739c5443&role.id=885a05785a714822b2012deb56880a73 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:26.354837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9718ef-857d-4824-b84b-360740b86a26 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:26.388883 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:26.480574 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9718ef-857d-4824-b84b-360740b86a26 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:26.504277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5182519-e009-4818-96c5-70ca32666d5b None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:26.522452 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d31dcc-8008-4207-b432-e9d2aaa4eea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:26.523255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d31dcc-8008-4207-b432-e9d2aaa4eea5 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:26.523612 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d31dcc-8008-4207-b432-e9d2aaa4eea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:26.523897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d31dcc-8008-4207-b432-e9d2aaa4eea5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:26.525230 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d31dcc-8008-4207-b432-e9d2aaa4eea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:26.526873 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d31dcc-8008-4207-b432-e9d2aaa4eea5 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:26.528987 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 141/274] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:40:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:26.531247 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:26.534263 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d31dcc-8008-4207-b432-e9d2aaa4eea5 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:26.559004 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab7795-f48d-48f0-9c3b-a66db77c366e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:26.560198 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab7795-f48d-48f0-9c3b-a66db77c366e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:26.560724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab7795-f48d-48f0-9c3b-a66db77c366e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:26.562189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab7795-f48d-48f0-9c3b-a66db77c366e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:26.577069 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab7795-f48d-48f0-9c3b-a66db77c366e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:26.586081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-4dab7795-f48d-48f0-9c3b-a66db77c366e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:26.586081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:26.586081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:26.586081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:26.586081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:26.586081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:26.586081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:26.586081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:26.586081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:26.586081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:26.586081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:26.586081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:26.586081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:26.586081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:26.586081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:26.586081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:26.587005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:26.587005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:26.587005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:26.587005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:26.587005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:26.587005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:26.587005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:26.587005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:26.587005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:26.587005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:26.587005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:26.587005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:26.587005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:26.587005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:26.587005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:26.587005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:26.587829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:26.587829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:26.587829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:26.587829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:26.587829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:26.587829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:26.587829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:26.587829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:26.587829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:26.587829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:26.587829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:26.587829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:26.590590 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 134/275] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:26.596910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab7795-f48d-48f0-9c3b-a66db77c366e None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:26.628538 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:26.653394 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d31dcc-8008-4207-b432-e9d2aaa4eea5 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:26.700601 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c74c92-c292-47c3-a31c-9d362fc4f2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:26.701579 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c74c92-c292-47c3-a31c-9d362fc4f2e5 None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:26.702074 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c74c92-c292-47c3-a31c-9d362fc4f2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:26.702623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c74c92-c292-47c3-a31c-9d362fc4f2e5 None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:26.703632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c74c92-c292-47c3-a31c-9d362fc4f2e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:26.705322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c74c92-c292-47c3-a31c-9d362fc4f2e5 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:26.722040 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab7795-f48d-48f0-9c3b-a66db77c366e None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:26.764886 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d1978-c946-4416-a695-6d999d2e9f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:26.765556 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d1978-c946-4416-a695-6d999d2e9f02 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:26.765844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d1978-c946-4416-a695-6d999d2e9f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:26.766123 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d1978-c946-4416-a695-6d999d2e9f02 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:26.766882 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d1978-c946-4416-a695-6d999d2e9f02 None admin] RBAC: Adding query filter params (name=member) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:26.767248 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d1978-c946-4416-a695-6d999d2e9f02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:26.768736 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d1978-c946-4416-a695-6d999d2e9f02 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:26.780417 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 142/276] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 16:40:26 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:40:26.785404 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 135/277] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:26.791839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c74c92-c292-47c3-a31c-9d362fc4f2e5 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:26.906123 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c74c92-c292-47c3-a31c-9d362fc4f2e5 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:26.941546 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695dde2-2b3d-41f2-9d6d-85e342c81a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:26.942419 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695dde2-2b3d-41f2-9d6d-85e342c81a49 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:26.942701 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695dde2-2b3d-41f2-9d6d-85e342c81a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:26.942976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695dde2-2b3d-41f2-9d6d-85e342c81a49 None admin] PATH_INFO: `/v3/users/66fad3e0fa34453db2672ebecbc6555f` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:26.945867 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:26.958498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695dde2-2b3d-41f2-9d6d-85e342c81a49 None admin] RBAC: Authorizing `identity:get_user(user_id=66fad3e0fa34453db2672ebecbc6555f)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:26.959979 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695dde2-2b3d-41f2-9d6d-85e342c81a49 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:26.967289 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 143/278] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:26 2022] GET /identity/v3/users/66fad3e0fa34453db2672ebecbc6555f => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:26.969091 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d1978-c946-4416-a695-6d999d2e9f02 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:27.018179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:27.059796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d0f1a-fcdb-4127-9a5e-aa43f3bd6cfc None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:27.060146 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d0f1a-fcdb-4127-9a5e-aa43f3bd6cfc None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:27.060407 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d0f1a-fcdb-4127-9a5e-aa43f3bd6cfc None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:27.061788 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 144/279] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:27.067428 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c5ab8-5201-4400-80d0-ea8e37b000ef None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:27.067428 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c5ab8-5201-4400-80d0-ea8e37b000ef None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:27.067740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c5ab8-5201-4400-80d0-ea8e37b000ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:27.092594 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-803c5ab8-5201-4400-80d0-ea8e37b000ef None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:27.093798 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-803c5ab8-5201-4400-80d0-ea8e37b000ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:27.098334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d1978-c946-4416-a695-6d999d2e9f02 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:27.140933 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9dd6cf-688f-4f42-9ee8-b8192f44080f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:27.141914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9dd6cf-688f-4f42-9ee8-b8192f44080f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:27.142376 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9dd6cf-688f-4f42-9ee8-b8192f44080f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:27.142824 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9dd6cf-688f-4f42-9ee8-b8192f44080f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:27.143901 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9dd6cf-688f-4f42-9ee8-b8192f44080f None admin] RBAC: Adding query filter params (role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2, user.id=66fad3e0fa34453db2672ebecbc6555f, scope.system=all) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:27.144484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9dd6cf-688f-4f42-9ee8-b8192f44080f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:27.146397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9dd6cf-688f-4f42-9ee8-b8192f44080f None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:27.154486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 136/280] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Jun 22 16:40:26 2022] GET /identity/v3/role_assignments?user.id=66fad3e0fa34453db2672ebecbc6555f&scope.system=all&role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:27.195060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 145/281] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:40:27.220151 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9dd6cf-688f-4f42-9ee8-b8192f44080f None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:27.333071 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:27.338254 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9dd6cf-688f-4f42-9ee8-b8192f44080f None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:27.373717 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72811bc1-723d-4737-a5d1-a5953dd8e730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:27.374513 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72811bc1-723d-4737-a5d1-a5953dd8e730 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:27.374806 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72811bc1-723d-4737-a5d1-a5953dd8e730 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:27.375089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72811bc1-723d-4737-a5d1-a5953dd8e730 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:27.385839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72811bc1-723d-4737-a5d1-a5953dd8e730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:27.393974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-72811bc1-723d-4737-a5d1-a5953dd8e730 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 16:40:27.393974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:27.393974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:27.393974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:27.393974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:27.393974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:27.393974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:27.393974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:27.393974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:27.393974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:27.393974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:27.393974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:27.393974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:27.393974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:27.393974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:27.393974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:27.394909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:27.394909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:27.394909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:27.394909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:27.394909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:27.394909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:27.394909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:27.394909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:27.394909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:27.394909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:27.394909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:27.394909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:27.394909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:27.394909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:27.394909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:27.394909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:27.396246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:27.396246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:27.396246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:27.396246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:27.396246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:27.396246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:27.396246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:27.396246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:27.396246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:27.396246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:27.396246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 16:40:27.396246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:27.396246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 137/282] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:27.401950 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c5ab8-5201-4400-80d0-ea8e37b000ef None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:27.505327 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c5ab8-5201-4400-80d0-ea8e37b000ef None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:27.530605 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:27.541312 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311131df-cca1-49c1-b9b4-ad683cdfba00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:27.541997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311131df-cca1-49c1-b9b4-ad683cdfba00 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:27.545344 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311131df-cca1-49c1-b9b4-ad683cdfba00 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:27.545344 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311131df-cca1-49c1-b9b4-ad683cdfba00 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:27.545344 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311131df-cca1-49c1-b9b4-ad683cdfba00 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:27.545344 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311131df-cca1-49c1-b9b4-ad683cdfba00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:27.545344 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311131df-cca1-49c1-b9b4-ad683cdfba00 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:27.553904 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 146/283] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:27.559781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72811bc1-723d-4737-a5d1-a5953dd8e730 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:27.694895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72811bc1-723d-4737-a5d1-a5953dd8e730 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:27.737320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd53a68-369f-438e-8f57-e73e2873c789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:27.738196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd53a68-369f-438e-8f57-e73e2873c789 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:27.738485 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd53a68-369f-438e-8f57-e73e2873c789 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:27.738767 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd53a68-369f-438e-8f57-e73e2873c789 None admin] PATH_INFO: `/v3/users/4920fb027f394e8d86af12c8ec37adb3` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:27.739979 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd53a68-369f-438e-8f57-e73e2873c789 None admin] RBAC: Authorizing `identity:get_user(user_id=4920fb027f394e8d86af12c8ec37adb3)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:27.741548 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd53a68-369f-438e-8f57-e73e2873c789 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:27.749461 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311131df-cca1-49c1-b9b4-ad683cdfba00 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:27.750305 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 138/284] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:27 2022] GET /identity/v3/users/4920fb027f394e8d86af12c8ec37adb3 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:27.906621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311131df-cca1-49c1-b9b4-ad683cdfba00 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:27.953931 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c47d8c-a3f1-4332-93c2-8359ac49cdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:27.954831 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c47d8c-a3f1-4332-93c2-8359ac49cdac None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:27.955118 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c47d8c-a3f1-4332-93c2-8359ac49cdac None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:27.955400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c47d8c-a3f1-4332-93c2-8359ac49cdac None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:27.956632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c47d8c-a3f1-4332-93c2-8359ac49cdac None admin] RBAC: Authorizing `identity:get_project(project_id=1d92be9a7941425d9b66dc77739c5443)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:27.958088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c47d8c-a3f1-4332-93c2-8359ac49cdac None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:27.960011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 147/285] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:27 2022] GET /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:27.965960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd53a68-369f-438e-8f57-e73e2873c789 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:27.994203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:28.091821 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd53a68-369f-438e-8f57-e73e2873c789 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:28.134042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d346b2-7b46-469b-acbf-4f0176c8ffb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:28.134935 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d346b2-7b46-469b-acbf-4f0176c8ffb3 None admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:28.135221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d346b2-7b46-469b-acbf-4f0176c8ffb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:28.135505 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d346b2-7b46-469b-acbf-4f0176c8ffb3 None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443/users/4920fb027f394e8d86af12c8ec37adb3/roles/434b9e3fd1f6417689c6bd184fbdb7e6` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:28.137803 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d346b2-7b46-469b-acbf-4f0176c8ffb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=1d92be9a7941425d9b66dc77739c5443, user_id=4920fb027f394e8d86af12c8ec37adb3, role_id=434b9e3fd1f6417689c6bd184fbdb7e6)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:28.139364 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d346b2-7b46-469b-acbf-4f0176c8ffb3 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:28.159803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b71c9-4031-41eb-9fb0-3095ff9ad6b8 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:28.160297 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b71c9-4031-41eb-9fb0-3095ff9ad6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:28.160774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b71c9-4031-41eb-9fb0-3095ff9ad6b8 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:28.163800 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 148/286] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:28.167989 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c7c48-d77c-4822-a9bb-91cfec82d94c None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:28.168523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c7c48-d77c-4822-a9bb-91cfec82d94c None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:28.169017 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c7c48-d77c-4822-a9bb-91cfec82d94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:28.186930 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-3e9c7c48-d77c-4822-a9bb-91cfec82d94c None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:28.188499 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3e9c7c48-d77c-4822-a9bb-91cfec82d94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:28.218528 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 139/287] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:40:27 2022] PUT /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443/users/4920fb027f394e8d86af12c8ec37adb3/roles/434b9e3fd1f6417689c6bd184fbdb7e6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 16:40:28.266673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:28.285637 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 149/288] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:40:28.325884 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d346b2-7b46-469b-acbf-4f0176c8ffb3 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:28.426667 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:28.442086 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d346b2-7b46-469b-acbf-4f0176c8ffb3 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:28.477259 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489aa9e7-55f7-40e5-96cc-c52794d7413d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:28.478055 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489aa9e7-55f7-40e5-96cc-c52794d7413d None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:28.478345 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489aa9e7-55f7-40e5-96cc-c52794d7413d None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:28.478681 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489aa9e7-55f7-40e5-96cc-c52794d7413d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:28.489461 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489aa9e7-55f7-40e5-96cc-c52794d7413d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:28.497659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-489aa9e7-55f7-40e5-96cc-c52794d7413d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:28.497659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:28.497659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:28.497659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:28.497659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:28.497659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:28.497659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:28.497659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:28.497659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:28.497659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:28.497659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:28.497659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:28.497659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:28.497659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:28.497659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:28.497659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:28.498594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:28.498594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:28.498594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:28.498594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:28.498594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:28.498594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:28.498594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:28.498594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:28.498594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:28.498594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:28.498594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:28.498594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:28.498594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:28.498594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:28.498594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:28.498594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:28.499388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:28.499388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:28.499388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:28.499388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:28.499388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:28.499388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:28.499388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:28.499388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:28.499388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:28.499388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:28.499388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:28.499388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:28.499388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 140/289] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:28.505955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c7c48-d77c-4822-a9bb-91cfec82d94c None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:28.620630 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c7c48-d77c-4822-a9bb-91cfec82d94c None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:28.670811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37355f16-1966-4906-a580-cfae92f7b885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:28.671892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37355f16-1966-4906-a580-cfae92f7b885 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:28.672430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37355f16-1966-4906-a580-cfae92f7b885 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:28.672906 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37355f16-1966-4906-a580-cfae92f7b885 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:28.673958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37355f16-1966-4906-a580-cfae92f7b885 None admin] RBAC: Adding query filter params (name=member) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:28.674513 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37355f16-1966-4906-a580-cfae92f7b885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:28.676305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37355f16-1966-4906-a580-cfae92f7b885 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:28.691525 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 150/290] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:28.696494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489aa9e7-55f7-40e5-96cc-c52794d7413d None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:28.810492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489aa9e7-55f7-40e5-96cc-c52794d7413d None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:28.845447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4a126-c645-439a-b266-a0eb2de587b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:28.846304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4a126-c645-439a-b266-a0eb2de587b0 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:28.846581 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4a126-c645-439a-b266-a0eb2de587b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:28.846849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4a126-c645-439a-b266-a0eb2de587b0 None admin] PATH_INFO: `/v3/users/bdcd9d3876dd435bb1291403d56249c0` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:28.848048 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4a126-c645-439a-b266-a0eb2de587b0 None admin] RBAC: Authorizing `identity:get_user(user_id=bdcd9d3876dd435bb1291403d56249c0)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:28.849515 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4a126-c645-439a-b266-a0eb2de587b0 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:28.851124 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 141/291] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:28 2022] GET /identity/v3/users/bdcd9d3876dd435bb1291403d56249c0 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:28.857095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37355f16-1966-4906-a580-cfae92f7b885 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:28.904494 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:28.977179 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37355f16-1966-4906-a580-cfae92f7b885 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:29.024919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43ab37-7a63-4639-9a30-3ab3ac04e167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:29.028131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43ab37-7a63-4639-9a30-3ab3ac04e167 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:29.028131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43ab37-7a63-4639-9a30-3ab3ac04e167 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:29.028131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43ab37-7a63-4639-9a30-3ab3ac04e167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:29.118789 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43ab37-7a63-4639-9a30-3ab3ac04e167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:29.122241 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43ab37-7a63-4639-9a30-3ab3ac04e167 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:29.173211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:29.235044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 151/292] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:29.240136 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4a126-c645-439a-b266-a0eb2de587b0 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:29.256174 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:29.344140 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4a126-c645-439a-b266-a0eb2de587b0 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:29.379512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73f3cd-8cfe-4c8d-8d37-26aa0bdbf8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:29.380386 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f3cd-8cfe-4c8d-8d37-26aa0bdbf8fb None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:29.380667 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f3cd-8cfe-4c8d-8d37-26aa0bdbf8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:29.380941 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f3cd-8cfe-4c8d-8d37-26aa0bdbf8fb None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:29.382135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73f3cd-8cfe-4c8d-8d37-26aa0bdbf8fb None admin] RBAC: Authorizing `identity:get_project(project_id=1d92be9a7941425d9b66dc77739c5443)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:29.383601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73f3cd-8cfe-4c8d-8d37-26aa0bdbf8fb None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:29.385633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 142/293] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:29 2022] GET /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:29.391886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43ab37-7a63-4639-9a30-3ab3ac04e167 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:29.501844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607b096-2279-42c0-8df7-65ed22d1187e None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:29.502132 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607b096-2279-42c0-8df7-65ed22d1187e None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:29.502317 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607b096-2279-42c0-8df7-65ed22d1187e None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:29.503679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 143/294] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:29.510296 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcd38b-9762-45b2-8a50-64caa39a7301 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:29.510787 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcd38b-9762-45b2-8a50-64caa39a7301 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:29.511285 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcd38b-9762-45b2-8a50-64caa39a7301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:29.515605 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43ab37-7a63-4639-9a30-3ab3ac04e167 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:29.544284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-86bcd38b-9762-45b2-8a50-64caa39a7301 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:29.546738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-86bcd38b-9762-45b2-8a50-64caa39a7301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:29.564310 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339778f-ef54-436b-8922-ffeeaedbc2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:29.565081 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339778f-ef54-436b-8922-ffeeaedbc2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:29.565366 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339778f-ef54-436b-8922-ffeeaedbc2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:29.571570 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339778f-ef54-436b-8922-ffeeaedbc2a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:29.571570 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339778f-ef54-436b-8922-ffeeaedbc2a4 None admin] RBAC: Adding query filter params (role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2, scope.project.id=1d92be9a7941425d9b66dc77739c5443, user.id=bdcd9d3876dd435bb1291403d56249c0) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:29.571570 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339778f-ef54-436b-8922-ffeeaedbc2a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:29.571570 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339778f-ef54-436b-8922-ffeeaedbc2a4 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:29.582879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 152/295] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:40:29 2022] GET /identity/v3/role_assignments?user.id=bdcd9d3876dd435bb1291403d56249c0&scope.project.id=1d92be9a7941425d9b66dc77739c5443&role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:29.654579 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 144/296] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:29.685214 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339778f-ef54-436b-8922-ffeeaedbc2a4 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:29.698563 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:29.816773 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339778f-ef54-436b-8922-ffeeaedbc2a4 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:29.862132 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539ef95-e2d9-4523-8cee-30c2f77539c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:29.863090 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539ef95-e2d9-4523-8cee-30c2f77539c3 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:29.863423 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539ef95-e2d9-4523-8cee-30c2f77539c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:29.863702 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539ef95-e2d9-4523-8cee-30c2f77539c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:29.875037 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539ef95-e2d9-4523-8cee-30c2f77539c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:29.882748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-5539ef95-e2d9-4523-8cee-30c2f77539c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 16:40:29.882748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:29.882748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:29.882748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:29.882748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:29.882748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:29.882748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:29.882748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:29.882748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:29.882748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:29.882748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:29.882748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:29.882748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:29.882748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:29.882748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:29.882748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:29.885430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:29.885430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:29.885430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:29.885430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:29.885430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:29.885430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:29.885430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:29.885430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:29.885430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:29.885430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:29.885430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:29.885430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:29.885430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:29.885430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:29.885430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:29.885430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:29.887623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:29.887623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:29.887623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:29.887623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:29.887623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:29.887623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:29.887623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:29.887623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:29.887623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:29.887623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:29.887623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 16:40:29.887623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:29.887623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 153/297] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:29.890624 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcd38b-9762-45b2-8a50-64caa39a7301 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:29.910413 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:29.919966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c8e7d-228b-4f31-a274-30e7a7f9c012 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:29.920535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c8e7d-228b-4f31-a274-30e7a7f9c012 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:29.927377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c8e7d-228b-4f31-a274-30e7a7f9c012 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:29.927377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 154/298] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:29.932170 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2610a-4a09-449c-97c2-ad411443ffb4 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:29.932668 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2610a-4a09-449c-97c2-ad411443ffb4 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:29.933147 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2610a-4a09-449c-97c2-ad411443ffb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:29.957048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-4bb2610a-4a09-449c-97c2-ad411443ffb4 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:29.958238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-4bb2610a-4a09-449c-97c2-ad411443ffb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:30.026345 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcd38b-9762-45b2-8a50-64caa39a7301 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:30.041900 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:30.046617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 155/299] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:30.049529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18445f58-8bb0-446b-aa78-27765348a14f None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:30.050543 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18445f58-8bb0-446b-aa78-27765348a14f None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:30.050991 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18445f58-8bb0-446b-aa78-27765348a14f None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:30.053206 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 156/300] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:30.061199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ea700-d9c0-4ef0-8d06-d7f5f37c9de2 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:30.061199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ea700-d9c0-4ef0-8d06-d7f5f37c9de2 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:30.061199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ea700-d9c0-4ef0-8d06-d7f5f37c9de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:30.065691 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69033525-0a39-47f7-8aa2-e7f45811c83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:30.066441 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69033525-0a39-47f7-8aa2-e7f45811c83e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:30.066846 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69033525-0a39-47f7-8aa2-e7f45811c83e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:30.067131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69033525-0a39-47f7-8aa2-e7f45811c83e None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:30.068151 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69033525-0a39-47f7-8aa2-e7f45811c83e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:30.068392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69033525-0a39-47f7-8aa2-e7f45811c83e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:30.069900 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69033525-0a39-47f7-8aa2-e7f45811c83e None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:30.079803 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 145/301] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:30.080727 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69033525-0a39-47f7-8aa2-e7f45811c83e None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:30.082794 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-783ea700-d9c0-4ef0-8d06-d7f5f37c9de2 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:30.085400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-783ea700-d9c0-4ef0-8d06-d7f5f37c9de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:30.158353 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 157/302] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:40:30.159574 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ea700-d9c0-4ef0-8d06-d7f5f37c9de2 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:30.165837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:30.195918 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69033525-0a39-47f7-8aa2-e7f45811c83e None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:30.234585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5a837-95ef-4bea-9d7b-8924825dd623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:30.235488 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5a837-95ef-4bea-9d7b-8924825dd623 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:30.235894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5a837-95ef-4bea-9d7b-8924825dd623 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:30.236149 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5a837-95ef-4bea-9d7b-8924825dd623 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:30.237333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5a837-95ef-4bea-9d7b-8924825dd623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:30.238977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5a837-95ef-4bea-9d7b-8924825dd623 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:30.245539 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 146/303] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:40:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:30.245539 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5a837-95ef-4bea-9d7b-8924825dd623 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:30.274188 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ea700-d9c0-4ef0-8d06-d7f5f37c9de2 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:30.305255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:30.311915 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03600cf6-4c5e-4c87-a68b-04cc709c1c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:30.312823 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03600cf6-4c5e-4c87-a68b-04cc709c1c25 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:30.313165 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03600cf6-4c5e-4c87-a68b-04cc709c1c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:30.313446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03600cf6-4c5e-4c87-a68b-04cc709c1c25 None admin] PATH_INFO: `/v3/users/092f05933deb48f8a7a3513d1dabe8cb` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:30.327167 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03600cf6-4c5e-4c87-a68b-04cc709c1c25 None admin] RBAC: Authorizing `identity:get_user(user_id=092f05933deb48f8a7a3513d1dabe8cb)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:30.328608 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03600cf6-4c5e-4c87-a68b-04cc709c1c25 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:30.330539 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 158/304] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:30 2022] GET /identity/v3/users/092f05933deb48f8a7a3513d1dabe8cb => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:30.335762 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03600cf6-4c5e-4c87-a68b-04cc709c1c25 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:30.348564 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5a837-95ef-4bea-9d7b-8924825dd623 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:30.383760 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7eec2-b10e-4de8-b2ac-61b614ab1433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:30.384592 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7eec2-b10e-4de8-b2ac-61b614ab1433 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:30.384879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7eec2-b10e-4de8-b2ac-61b614ab1433 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:30.385155 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7eec2-b10e-4de8-b2ac-61b614ab1433 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:30.395566 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7eec2-b10e-4de8-b2ac-61b614ab1433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:30.409445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-88f7eec2-b10e-4de8-b2ac-61b614ab1433 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:30.409445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:30.409445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:30.409445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:30.409445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:30.409445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:30.409445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:30.409445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:30.409445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:30.409445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:30.409445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:30.409445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:30.409445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:30.409445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:30.409445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:30.409445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:30.410381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:30.410381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:30.410381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:30.410381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:30.410381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:30.410381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:30.410381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:30.410381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:30.410381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:30.410381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:30.410381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:30.410381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:30.410381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:30.410381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:30.410381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:30.410381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:30.411188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:30.411188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:30.411188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:30.411188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:30.411188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:30.411188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:30.411188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:30.411188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:30.411188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:30.411188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:30.411188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:30.411188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:30.411809 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 147/305] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:30.413178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7eec2-b10e-4de8-b2ac-61b614ab1433 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:30.419747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:30.449616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03600cf6-4c5e-4c87-a68b-04cc709c1c25 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:30.485966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41c303-7673-4655-b4de-18e3869f4956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:30.486640 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41c303-7673-4655-b4de-18e3869f4956 None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:30.486903 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41c303-7673-4655-b4de-18e3869f4956 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:30.487174 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41c303-7673-4655-b4de-18e3869f4956 None admin] PATH_INFO: `/v3/groups` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:30.487892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41c303-7673-4655-b4de-18e3869f4956 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:30.489335 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41c303-7673-4655-b4de-18e3869f4956 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:30.520505 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7eec2-b10e-4de8-b2ac-61b614ab1433 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:30.553525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f1e4e-fac9-4699-9bd0-3793de90bdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:30.554165 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f1e4e-fac9-4699-9bd0-3793de90bdd9 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:30.558169 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f1e4e-fac9-4699-9bd0-3793de90bdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:30.558169 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f1e4e-fac9-4699-9bd0-3793de90bdd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:30.558169 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f1e4e-fac9-4699-9bd0-3793de90bdd9 None admin] RBAC: Adding query filter params (role.id=434b9e3fd1f6417689c6bd184fbdb7e6, user.id=092f05933deb48f8a7a3513d1dabe8cb, scope.system=all) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:30.558169 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f1e4e-fac9-4699-9bd0-3793de90bdd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:30.558169 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f1e4e-fac9-4699-9bd0-3793de90bdd9 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:30.562198 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 148/306] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Jun 22 16:40:30 2022] GET /identity/v3/role_assignments?user.id=092f05933deb48f8a7a3513d1dabe8cb&scope.system=all&role.id=434b9e3fd1f6417689c6bd184fbdb7e6 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:30.563255 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f1e4e-fac9-4699-9bd0-3793de90bdd9 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:30.612619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 159/307] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Jun 22 16:40:30 2022] POST /identity/v3/groups => generated 229 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:40:30.689136 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:30.731028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f1e4e-fac9-4699-9bd0-3793de90bdd9 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:30.767342 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa956e3-0fa7-47a7-a7d3-71a4dcfb89d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:30.768020 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa956e3-0fa7-47a7-a7d3-71a4dcfb89d8 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:30.768226 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94374a91-4ab7-4de2-b277-204622384a47 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:30.768325 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa956e3-0fa7-47a7-a7d3-71a4dcfb89d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:30.768526 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94374a91-4ab7-4de2-b277-204622384a47 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:30.768618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa956e3-0fa7-47a7-a7d3-71a4dcfb89d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:30.768808 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94374a91-4ab7-4de2-b277-204622384a47 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:30.769361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa956e3-0fa7-47a7-a7d3-71a4dcfb89d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:30.769675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa956e3-0fa7-47a7-a7d3-71a4dcfb89d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:30.770317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 160/308] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:40:30.771076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa956e3-0fa7-47a7-a7d3-71a4dcfb89d8 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:30.777394 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea31e39-3c8c-4313-9a0f-f8f50afeb738 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:30.777394 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea31e39-3c8c-4313-9a0f-f8f50afeb738 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:30.777394 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea31e39-3c8c-4313-9a0f-f8f50afeb738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:30.781491 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 149/309] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:30.786946 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa956e3-0fa7-47a7-a7d3-71a4dcfb89d8 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:30.802022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-3ea31e39-3c8c-4313-9a0f-f8f50afeb738 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:30.803534 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3ea31e39-3c8c-4313-9a0f-f8f50afeb738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:30.864510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:30.900977 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 161/310] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:40:30.910306 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa956e3-0fa7-47a7-a7d3-71a4dcfb89d8 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:30.924741 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea31e39-3c8c-4313-9a0f-f8f50afeb738 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:30.940574 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:30.949399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a595742-3d3a-4d72-b188-0e58c1de2507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:30.950443 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a595742-3d3a-4d72-b188-0e58c1de2507 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:30.950791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a595742-3d3a-4d72-b188-0e58c1de2507 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:30.951135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a595742-3d3a-4d72-b188-0e58c1de2507 None admin] PATH_INFO: `/v3/users/66fad3e0fa34453db2672ebecbc6555f` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:30.952440 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a595742-3d3a-4d72-b188-0e58c1de2507 None admin] RBAC: Authorizing `identity:get_user(user_id=66fad3e0fa34453db2672ebecbc6555f)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:30.954333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a595742-3d3a-4d72-b188-0e58c1de2507 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:30.956044 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 150/311] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:30 2022] GET /identity/v3/users/66fad3e0fa34453db2672ebecbc6555f => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:30.961977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a595742-3d3a-4d72-b188-0e58c1de2507 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:31.053551 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea31e39-3c8c-4313-9a0f-f8f50afeb738 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:31.091692 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee3344-61f5-486a-95c6-c8a541718e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:31.092521 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee3344-61f5-486a-95c6-c8a541718e24 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:31.092805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee3344-61f5-486a-95c6-c8a541718e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:31.093090 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee3344-61f5-486a-95c6-c8a541718e24 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:31.103846 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee3344-61f5-486a-95c6-c8a541718e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:31.108051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a595742-3d3a-4d72-b188-0e58c1de2507 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:31.111510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-f0ee3344-61f5-486a-95c6-c8a541718e24 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 16:40:31.111510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:31.111510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:31.111510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:31.111510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:31.111510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:31.111510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:31.111510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:31.111510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:31.111510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:31.111510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:31.111510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:31.111510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:31.111510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:31.111510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:31.111510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:31.112429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:31.112429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:31.112429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:31.112429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:31.112429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:31.112429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:31.112429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:31.112429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:31.112429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:31.112429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:31.112429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:31.112429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:31.112429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:31.112429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:31.112429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:31.112429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:31.113240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:31.113240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:31.113240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:31.113240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:31.113240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:31.113240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:31.113240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:31.113240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:31.113240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:31.113240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:31.113240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 16:40:31.113240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:31.117893 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 162/312] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:40:31.118706 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee3344-61f5-486a-95c6-c8a541718e24 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:31.159406 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806eaad-0a2f-4b75-98b0-329e47e633e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:31.160662 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806eaad-0a2f-4b75-98b0-329e47e633e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:31.161786 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:31.162151 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806eaad-0a2f-4b75-98b0-329e47e633e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:31.162631 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806eaad-0a2f-4b75-98b0-329e47e633e8 None admin] PATH_INFO: `/v3/system/users/66fad3e0fa34453db2672ebecbc6555f/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:31.165875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806eaad-0a2f-4b75-98b0-329e47e633e8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=66fad3e0fa34453db2672ebecbc6555f, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:31.167760 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806eaad-0a2f-4b75-98b0-329e47e633e8 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:31.230393 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee3344-61f5-486a-95c6-c8a541718e24 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:31.243134 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 151/313] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Jun 22 16:40:30 2022] PUT /identity/v3/system/users/66fad3e0fa34453db2672ebecbc6555f/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:40:31.279841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7d03f-eed1-409f-b8af-19bfc4332d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:31.280599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7d03f-eed1-409f-b8af-19bfc4332d2d None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:31.280990 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7d03f-eed1-409f-b8af-19bfc4332d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:31.281334 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7d03f-eed1-409f-b8af-19bfc4332d2d None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:31.282135 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7d03f-eed1-409f-b8af-19bfc4332d2d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:31.282502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7d03f-eed1-409f-b8af-19bfc4332d2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:31.283997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c7d03f-eed1-409f-b8af-19bfc4332d2d None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:31.294435 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 163/314] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:31.300200 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806eaad-0a2f-4b75-98b0-329e47e633e8 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:31.371077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:31.416834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806eaad-0a2f-4b75-98b0-329e47e633e8 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:31.453247 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0bf48-5859-4545-ac49-90e4266b81ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:31.454119 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0bf48-5859-4545-ac49-90e4266b81ee None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:31.454407 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0bf48-5859-4545-ac49-90e4266b81ee None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:31.454690 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0bf48-5859-4545-ac49-90e4266b81ee None admin] PATH_INFO: `/v3/users/4920fb027f394e8d86af12c8ec37adb3` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:31.455905 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0bf48-5859-4545-ac49-90e4266b81ee None admin] RBAC: Authorizing `identity:get_user(user_id=4920fb027f394e8d86af12c8ec37adb3)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:31.457388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0bf48-5859-4545-ac49-90e4266b81ee None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:31.459331 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 152/315] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:31 2022] GET /identity/v3/users/4920fb027f394e8d86af12c8ec37adb3 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:31.464893 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7d03f-eed1-409f-b8af-19bfc4332d2d None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:31.568585 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:31.572413 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7d03f-eed1-409f-b8af-19bfc4332d2d None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:31.606451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b4ff8-89ab-4ddb-83cd-7c63daef6a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:31.607104 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b4ff8-89ab-4ddb-83cd-7c63daef6a26 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:31.607448 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b4ff8-89ab-4ddb-83cd-7c63daef6a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:31.607732 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b4ff8-89ab-4ddb-83cd-7c63daef6a26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:31.680507 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b4ff8-89ab-4ddb-83cd-7c63daef6a26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:31.681958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b4ff8-89ab-4ddb-83cd-7c63daef6a26 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:31.786470 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:31.790435 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 164/316] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:31.796094 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0bf48-5859-4545-ac49-90e4266b81ee None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:31.904388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0bf48-5859-4545-ac49-90e4266b81ee None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:31.930913 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:31.939174 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58bf9c-f291-47ee-b316-b4dec085a817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:31.940036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58bf9c-f291-47ee-b316-b4dec085a817 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:31.940349 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58bf9c-f291-47ee-b316-b4dec085a817 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:31.940624 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58bf9c-f291-47ee-b316-b4dec085a817 None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:31.941800 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58bf9c-f291-47ee-b316-b4dec085a817 None admin] RBAC: Authorizing `identity:get_project(project_id=1d92be9a7941425d9b66dc77739c5443)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:31.943240 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58bf9c-f291-47ee-b316-b4dec085a817 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:31.945782 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 153/317] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:31 2022] GET /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:31.951340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b4ff8-89ab-4ddb-83cd-7c63daef6a26 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:32.082002 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b4ff8-89ab-4ddb-83cd-7c63daef6a26 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:32.116496 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538c295-8aa1-40ed-909c-2229e5744869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:32.117681 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538c295-8aa1-40ed-909c-2229e5744869 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:32.117974 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538c295-8aa1-40ed-909c-2229e5744869 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:32.118255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538c295-8aa1-40ed-909c-2229e5744869 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:32.119100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538c295-8aa1-40ed-909c-2229e5744869 None admin] RBAC: Adding query filter params (role.id=434b9e3fd1f6417689c6bd184fbdb7e6, scope.project.id=1d92be9a7941425d9b66dc77739c5443, user.id=4920fb027f394e8d86af12c8ec37adb3) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:32.119417 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538c295-8aa1-40ed-909c-2229e5744869 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:32.120877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538c295-8aa1-40ed-909c-2229e5744869 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:32.127171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 165/318] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:40:31 2022] GET /identity/v3/role_assignments?user.id=4920fb027f394e8d86af12c8ec37adb3&scope.project.id=1d92be9a7941425d9b66dc77739c5443&role.id=434b9e3fd1f6417689c6bd184fbdb7e6 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:32.657741 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628bf4d-85b7-4571-b58c-11536821ec78 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:32.658036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628bf4d-85b7-4571-b58c-11536821ec78 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:32.658467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628bf4d-85b7-4571-b58c-11536821ec78 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:32.659881 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 154/319] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:32.665382 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7bd77-5ecf-4373-8e02-fb8a9dc0d30c None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:32.665673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7bd77-5ecf-4373-8e02-fb8a9dc0d30c None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:32.665950 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7bd77-5ecf-4373-8e02-fb8a9dc0d30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:32.682715 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-9ae7bd77-5ecf-4373-8e02-fb8a9dc0d30c None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:32.683887 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-9ae7bd77-5ecf-4373-8e02-fb8a9dc0d30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:32.742797 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:32.751018 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 166/320] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:32.752353 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511926db-2c36-4fdb-b9f8-3d1c3a77214e None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:32.752647 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511926db-2c36-4fdb-b9f8-3d1c3a77214e None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:32.752927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511926db-2c36-4fdb-b9f8-3d1c3a77214e None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:32.754471 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 155/321] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:40:32.760009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db16168-fbfa-433f-8264-40184bdc010d None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:32.762059 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db16168-fbfa-433f-8264-40184bdc010d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:32.762059 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db16168-fbfa-433f-8264-40184bdc010d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:32.774230 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511926db-2c36-4fdb-b9f8-3d1c3a77214e None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:32.778387 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-7db16168-fbfa-433f-8264-40184bdc010d None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:32.780256 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-7db16168-fbfa-433f-8264-40184bdc010d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:32.850680 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 167/322] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:40:32.873773 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db16168-fbfa-433f-8264-40184bdc010d None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:32.880095 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511926db-2c36-4fdb-b9f8-3d1c3a77214e None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:32.917584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb60cc4-2157-43ea-b3d8-4cf5a6c97d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:32.918290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb60cc4-2157-43ea-b3d8-4cf5a6c97d87 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:32.918575 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb60cc4-2157-43ea-b3d8-4cf5a6c97d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:32.918854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb60cc4-2157-43ea-b3d8-4cf5a6c97d87 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:32.930914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb60cc4-2157-43ea-b3d8-4cf5a6c97d87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:32.938645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-eeb60cc4-2157-43ea-b3d8-4cf5a6c97d87 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 16:40:32.938645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:32.938645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:32.938645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:32.938645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:32.938645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:32.938645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:32.938645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:32.938645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:32.938645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:32.938645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:32.938645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:32.938645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:32.938645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:32.938645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:32.938645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:32.939749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:32.939749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:32.939749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:32.939749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:32.939749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:32.939749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:32.939749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:32.939749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:32.939749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:32.939749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:32.939749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:32.939749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:32.939749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:32.939749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:32.939749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:32.939749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:32.940672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:32.940672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:32.940672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:32.940672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:32.940672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:32.940672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:32.940672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:32.940672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:32.940672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:32.940672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:32.940672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 16:40:32.940672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:32.940672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 156/323] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:40:32.946795 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb60cc4-2157-43ea-b3d8-4cf5a6c97d87 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:32.979084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db16168-fbfa-433f-8264-40184bdc010d None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:33.004412 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:33.010879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:33.019530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec154525-262e-4bf9-a620-51c595a40f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:33.020824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec154525-262e-4bf9-a620-51c595a40f32 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:33.021315 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec154525-262e-4bf9-a620-51c595a40f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:33.022279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec154525-262e-4bf9-a620-51c595a40f32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:33.024012 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec154525-262e-4bf9-a620-51c595a40f32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:33.026747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec154525-262e-4bf9-a620-51c595a40f32 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:33.028616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 168/324] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:40:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:33.033934 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec154525-262e-4bf9-a620-51c595a40f32 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:33.057863 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb60cc4-2157-43ea-b3d8-4cf5a6c97d87 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:33.092299 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213bfef-5db2-4846-9e3e-0d74c8fbef0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:33.092951 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213bfef-5db2-4846-9e3e-0d74c8fbef0e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:33.093232 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213bfef-5db2-4846-9e3e-0d74c8fbef0e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:33.093507 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213bfef-5db2-4846-9e3e-0d74c8fbef0e None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:33.094279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213bfef-5db2-4846-9e3e-0d74c8fbef0e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:33.094563 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213bfef-5db2-4846-9e3e-0d74c8fbef0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:33.095943 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213bfef-5db2-4846-9e3e-0d74c8fbef0e None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:33.104078 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 157/325] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:33.109371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213bfef-5db2-4846-9e3e-0d74c8fbef0e None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:33.144286 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec154525-262e-4bf9-a620-51c595a40f32 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:33.182186 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5dbe7-beec-4126-89e2-9ead0e2b0e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:33.182774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5dbe7-beec-4126-89e2-9ead0e2b0e58 None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:33.183061 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5dbe7-beec-4126-89e2-9ead0e2b0e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:33.183343 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5dbe7-beec-4126-89e2-9ead0e2b0e58 None admin] PATH_INFO: `/v3/groups` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:33.184040 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5dbe7-beec-4126-89e2-9ead0e2b0e58 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:33.185583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5dbe7-beec-4126-89e2-9ead0e2b0e58 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:33.208013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213bfef-5db2-4846-9e3e-0d74c8fbef0e None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:33.224403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:33.241087 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf6c3f-f554-4215-98fb-088c5fdbaaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:33.241942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf6c3f-f554-4215-98fb-088c5fdbaaff None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:33.242802 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf6c3f-f554-4215-98fb-088c5fdbaaff None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:33.243073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf6c3f-f554-4215-98fb-088c5fdbaaff None admin] PATH_INFO: `/v3/users/092f05933deb48f8a7a3513d1dabe8cb` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:33.244293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf6c3f-f554-4215-98fb-088c5fdbaaff None admin] RBAC: Authorizing `identity:get_user(user_id=092f05933deb48f8a7a3513d1dabe8cb)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:33.245716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf6c3f-f554-4215-98fb-088c5fdbaaff None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:33.247375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 158/326] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:33 2022] GET /identity/v3/users/092f05933deb48f8a7a3513d1dabe8cb => generated 293 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:33.252892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf6c3f-f554-4215-98fb-088c5fdbaaff None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:33.272152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 169/327] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Jun 22 16:40:33 2022] POST /identity/v3/groups => generated 226 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 16:40:33.333087 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28ad54-328b-47d6-9f87-41f7b093b567 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:33.333395 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28ad54-328b-47d6-9f87-41f7b093b567 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:33.333653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28ad54-328b-47d6-9f87-41f7b093b567 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:33.335248 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 170/328] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:40:33.341116 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389cb7f-2455-4c38-9168-cbe14827d265 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:33.341405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389cb7f-2455-4c38-9168-cbe14827d265 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:33.341679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389cb7f-2455-4c38-9168-cbe14827d265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:33.358845 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-9389cb7f-2455-4c38-9168-cbe14827d265 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:33.360070 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-9389cb7f-2455-4c38-9168-cbe14827d265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:33.363104 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf6c3f-f554-4215-98fb-088c5fdbaaff None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:33.404015 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8c5f4-40fb-42d3-90c3-c998cd93cf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:33.404915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8c5f4-40fb-42d3-90c3-c998cd93cf13 None admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:33.405571 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8c5f4-40fb-42d3-90c3-c998cd93cf13 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:33.405571 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8c5f4-40fb-42d3-90c3-c998cd93cf13 None admin] PATH_INFO: `/v3/system/users/092f05933deb48f8a7a3513d1dabe8cb/roles/434b9e3fd1f6417689c6bd184fbdb7e6` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:33.406957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8c5f4-40fb-42d3-90c3-c998cd93cf13 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=092f05933deb48f8a7a3513d1dabe8cb, role_id=434b9e3fd1f6417689c6bd184fbdb7e6)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:33.408356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8c5f4-40fb-42d3-90c3-c998cd93cf13 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:33.413213 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:33.434153 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 171/329] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:40:33.458103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389cb7f-2455-4c38-9168-cbe14827d265 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:33.460352 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 159/330] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Jun 22 16:40:33 2022] PUT /identity/v3/system/users/092f05933deb48f8a7a3513d1dabe8cb/roles/434b9e3fd1f6417689c6bd184fbdb7e6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 16:40:33.578920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389cb7f-2455-4c38-9168-cbe14827d265 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:33.616616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7c53e-c77a-450c-860d-2d6ca8e603ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:33.618004 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7c53e-c77a-450c-860d-2d6ca8e603ab None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:33.618319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7c53e-c77a-450c-860d-2d6ca8e603ab None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:33.618592 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7c53e-c77a-450c-860d-2d6ca8e603ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:33.629604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7c53e-c77a-450c-860d-2d6ca8e603ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:33.638115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-14c7c53e-c77a-450c-860d-2d6ca8e603ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:33.638115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:33.638115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:33.638115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:33.638115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:33.638115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:33.638115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:33.638115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:33.638115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:33.638115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:33.638115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:33.638115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:33.638115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:33.638115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:33.638115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:33.638115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:33.639009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:33.639009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:33.639009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:33.639009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:33.639009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:33.639009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:33.639009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:33.639009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:33.639009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:33.639009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:33.639009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:33.639009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:33.639009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:33.639009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:33.639009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:33.639009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:33.639795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:33.639795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:33.639795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:33.639795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:33.639795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:33.639795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:33.639795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:33.639795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:33.639795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:33.639795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:33.639795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:33.639795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:33.639795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 172/331] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:40:33.645079 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8c5f4-40fb-42d3-90c3-c998cd93cf13 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:33.713630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:33.768314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8c5f4-40fb-42d3-90c3-c998cd93cf13 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:33.807437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6e1b7-0798-413d-9be7-b9325de2e2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:33.808132 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6e1b7-0798-413d-9be7-b9325de2e2af None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:33.808440 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6e1b7-0798-413d-9be7-b9325de2e2af None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:33.808731 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6e1b7-0798-413d-9be7-b9325de2e2af None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:33.809499 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6e1b7-0798-413d-9be7-b9325de2e2af None admin] RBAC: Adding query filter params (name=member) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:33.809813 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6e1b7-0798-413d-9be7-b9325de2e2af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:33.811197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6e1b7-0798-413d-9be7-b9325de2e2af None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:33.820198 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 160/332] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:33.829226 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7c53e-c77a-450c-860d-2d6ca8e603ab None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:33.878238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:33.943585 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7c53e-c77a-450c-860d-2d6ca8e603ab None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:33.984668 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f0bb5-3a18-4640-954c-c349749e988e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:33.986233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f0bb5-3a18-4640-954c-c349749e988e None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:33.986694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f0bb5-3a18-4640-954c-c349749e988e None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:33.987161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f0bb5-3a18-4640-954c-c349749e988e None admin] PATH_INFO: `/v3/users/66fad3e0fa34453db2672ebecbc6555f` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:33.988625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f0bb5-3a18-4640-954c-c349749e988e None admin] RBAC: Authorizing `identity:get_user(user_id=66fad3e0fa34453db2672ebecbc6555f)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:33.990246 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f0bb5-3a18-4640-954c-c349749e988e None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:33.995259 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 173/333] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:33 2022] GET /identity/v3/users/66fad3e0fa34453db2672ebecbc6555f => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:34.000670 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6e1b7-0798-413d-9be7-b9325de2e2af None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:34.111971 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6e1b7-0798-413d-9be7-b9325de2e2af None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:34.126373 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:34.148590 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14fd0b-9266-4b4c-a996-d78e138132cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:34.149255 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14fd0b-9266-4b4c-a996-d78e138132cf None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:34.149542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14fd0b-9266-4b4c-a996-d78e138132cf None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:34.149831 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14fd0b-9266-4b4c-a996-d78e138132cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:34.150679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14fd0b-9266-4b4c-a996-d78e138132cf None admin] RBAC: Adding query filter params (role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2, user.id=66fad3e0fa34453db2672ebecbc6555f, scope.system=all) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:34.150996 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14fd0b-9266-4b4c-a996-d78e138132cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:34.152481 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14fd0b-9266-4b4c-a996-d78e138132cf None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:34.167468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 161/334] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Jun 22 16:40:33 2022] GET /identity/v3/role_assignments?user.id=66fad3e0fa34453db2672ebecbc6555f&scope.system=all&role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 510 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:36.120968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945838c5-0a20-4ae0-b49f-7b56a29fc708 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:36.121914 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945838c5-0a20-4ae0-b49f-7b56a29fc708 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:36.122395 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945838c5-0a20-4ae0-b49f-7b56a29fc708 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:36.124324 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 174/335] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:36.129776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7854bf-0d9b-42e8-8264-522df4c14ccc None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:36.130627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7854bf-0d9b-42e8-8264-522df4c14ccc None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:36.131120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7854bf-0d9b-42e8-8264-522df4c14ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:36.156770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-6d7854bf-0d9b-42e8-8264-522df4c14ccc None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:36.158334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6d7854bf-0d9b-42e8-8264-522df4c14ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:36.236144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241c3bc-bac8-4437-b325-b9f5eba4c481 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:36.237866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241c3bc-bac8-4437-b325-b9f5eba4c481 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:36.238355 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241c3bc-bac8-4437-b325-b9f5eba4c481 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:36.240216 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 175/336] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:36.246389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c8f03-ce1d-4681-a2db-03f1557c4a68 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:36.246950 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c8f03-ce1d-4681-a2db-03f1557c4a68 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:36.247592 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c8f03-ce1d-4681-a2db-03f1557c4a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:36.252880 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 162/337] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:36.285816 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-e14c8f03-ce1d-4681-a2db-03f1557c4a68 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:36.287706 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e14c8f03-ce1d-4681-a2db-03f1557c4a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:36.292325 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7854bf-0d9b-42e8-8264-522df4c14ccc None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:36.423231 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 176/338] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:40:36.425653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e38cd3-d848-47a0-ba1b-9390349b5e72 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:36.426898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e38cd3-d848-47a0-ba1b-9390349b5e72 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:36.427410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e38cd3-d848-47a0-ba1b-9390349b5e72 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:36.429721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 177/339] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:36.437351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c6178-8ba5-47b5-a95b-0c78396fb0ea None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:36.437912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c6178-8ba5-47b5-a95b-0c78396fb0ea None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:36.438420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c6178-8ba5-47b5-a95b-0c78396fb0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:36.472892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-939c6178-8ba5-47b5-a95b-0c78396fb0ea None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:36.474219 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-939c6178-8ba5-47b5-a95b-0c78396fb0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:36.528957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:36.553012 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:36.553012 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7854bf-0d9b-42e8-8264-522df4c14ccc None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:36.563471 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 178/340] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:36.564604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c6178-8ba5-47b5-a95b-0c78396fb0ea None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:36.624811 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3cb74-a3a2-4516-9726-2f6549f3bd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:36.626072 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3cb74-a3a2-4516-9726-2f6549f3bd32 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:36.626553 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3cb74-a3a2-4516-9726-2f6549f3bd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:36.627093 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3cb74-a3a2-4516-9726-2f6549f3bd32 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:36.652630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3cb74-a3a2-4516-9726-2f6549f3bd32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:36.664975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-f9b3cb74-a3a2-4516-9726-2f6549f3bd32 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:36.664975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:36.664975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:36.664975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:36.664975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:36.664975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:36.664975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:36.664975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:36.664975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:36.664975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:36.664975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:36.664975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:36.664975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:36.664975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:36.664975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:36.664975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:36.672637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:36.672637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:36.672637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:36.672637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:36.672637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:36.672637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:36.672637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:36.672637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:36.672637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:36.672637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:36.672637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:36.672637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:36.672637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:36.672637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:36.672637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:36.672637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:36.673436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:36.673436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:36.673436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:36.673436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:36.673436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:36.673436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:36.673436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:36.673436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:36.673436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:36.673436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:36.673436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:36.673436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:36.673436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 163/341] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:40:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:40:36.673436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3cb74-a3a2-4516-9726-2f6549f3bd32 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:36.681981 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c6178-8ba5-47b5-a95b-0c78396fb0ea None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:36.720890 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28148ac-1ae9-484b-82b2-d674e1228a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:36.721813 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28148ac-1ae9-484b-82b2-d674e1228a96 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:36.722103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28148ac-1ae9-484b-82b2-d674e1228a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:36.722379 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28148ac-1ae9-484b-82b2-d674e1228a96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:36.734501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28148ac-1ae9-484b-82b2-d674e1228a96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:36.743912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-e28148ac-1ae9-484b-82b2-d674e1228a96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:36.743912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:36.743912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:36.743912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:36.743912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:36.743912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:36.743912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:36.743912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:36.743912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:36.743912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:36.743912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:36.743912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:36.743912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:36.743912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:36.743912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:36.743912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:36.744811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:36.744811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:36.744811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:36.744811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:36.744811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:36.744811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:36.744811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:36.744811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:36.744811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:36.744811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:36.744811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:36.744811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:36.744811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:36.744811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:36.744811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:36.744811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:36.745613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:36.745613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:36.745613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:36.745613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:36.745613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:36.745613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:36.745613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:36.745613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:36.745613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:36.745613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:36.745613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:36.745613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:36.748755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 179/342] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:36.749688 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28148ac-1ae9-484b-82b2-d674e1228a96 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:36.784727 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:36.954481 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3cb74-a3a2-4516-9726-2f6549f3bd32 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:36.961746 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28148ac-1ae9-484b-82b2-d674e1228a96 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:37.074060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d20815-3290-4314-9386-efeef5e12d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:37.075384 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d20815-3290-4314-9386-efeef5e12d97 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:37.075841 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d20815-3290-4314-9386-efeef5e12d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:37.076336 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d20815-3290-4314-9386-efeef5e12d97 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:37.081714 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb89093-676e-43a3-997a-16334fb00fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:37.082623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb89093-676e-43a3-997a-16334fb00fcb None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:37.083107 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb89093-676e-43a3-997a-16334fb00fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:37.083605 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb89093-676e-43a3-997a-16334fb00fcb None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:37.084603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb89093-676e-43a3-997a-16334fb00fcb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:37.085114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb89093-676e-43a3-997a-16334fb00fcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:37.086713 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb89093-676e-43a3-997a-16334fb00fcb None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:37.095899 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d20815-3290-4314-9386-efeef5e12d97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:37.104147 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 180/343] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:40:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:37.105265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb89093-676e-43a3-997a-16334fb00fcb None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:37.114897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-36d20815-3290-4314-9386-efeef5e12d97 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 16:40:37.114897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:37.114897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:37.114897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:37.114897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:37.114897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:37.114897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:37.114897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:37.114897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:37.114897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:37.114897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:37.114897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:37.114897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:37.114897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:37.114897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:37.114897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:37.115832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:37.115832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:37.115832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:37.115832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:37.115832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:37.115832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:37.115832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:37.115832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:37.115832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:37.115832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:37.115832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:37.115832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:37.115832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:37.115832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:37.115832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:37.115832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:37.116694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:37.116694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:37.116694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:37.116694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:37.116694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:37.116694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:37.116694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:37.116694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:37.116694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:37.116694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:37.116694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 22 16:40:37.116694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:37.118293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 164/344] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 450 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:37.119070 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d20815-3290-4314-9386-efeef5e12d97 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:37.168620 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:37.290046 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:37.312725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb89093-676e-43a3-997a-16334fb00fcb None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:37.318188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d20815-3290-4314-9386-efeef5e12d97 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:37.377962 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25af99-ebec-4766-9d74-36d871ca3c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:37.379329 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25af99-ebec-4766-9d74-36d871ca3c56 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:37.380012 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25af99-ebec-4766-9d74-36d871ca3c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:37.380719 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25af99-ebec-4766-9d74-36d871ca3c56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:37.406052 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f049d9-60ed-47e6-a956-f6151896eb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:37.407112 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f049d9-60ed-47e6-a956-f6151896eb51 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:37.407598 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f049d9-60ed-47e6-a956-f6151896eb51 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:37.408071 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f049d9-60ed-47e6-a956-f6151896eb51 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:37.409446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f049d9-60ed-47e6-a956-f6151896eb51 None admin] RBAC: Adding query filter params (name=member) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:37.409971 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f049d9-60ed-47e6-a956-f6151896eb51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:37.412476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f049d9-60ed-47e6-a956-f6151896eb51 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:37.437382 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 181/345] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:37.443128 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f049d9-60ed-47e6-a956-f6151896eb51 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:37.508476 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25af99-ebec-4766-9d74-36d871ca3c56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:37.511362 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25af99-ebec-4766-9d74-36d871ca3c56 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:37.557896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:37.622580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f049d9-60ed-47e6-a956-f6151896eb51 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:37.683821 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f8e69-e793-4608-8faa-7063ba0b360a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:37.685319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f8e69-e793-4608-8faa-7063ba0b360a None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:37.686053 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f8e69-e793-4608-8faa-7063ba0b360a None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:37.686737 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f8e69-e793-4608-8faa-7063ba0b360a None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:37.688284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f8e69-e793-4608-8faa-7063ba0b360a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:37.689024 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f8e69-e793-4608-8faa-7063ba0b360a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:37.691674 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f8e69-e793-4608-8faa-7063ba0b360a None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:37.708174 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 182/346] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:37.710064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f8e69-e793-4608-8faa-7063ba0b360a None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:37.744143 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:37.759728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 165/347] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:37.759728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25af99-ebec-4766-9d74-36d871ca3c56 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:37.882215 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f8e69-e793-4608-8faa-7063ba0b360a None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:37.914741 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25af99-ebec-4766-9d74-36d871ca3c56 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:37.924484 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea522456-5427-4bf7-920e-da3271cf28ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:37.925394 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea522456-5427-4bf7-920e-da3271cf28ba None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:37.926217 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea522456-5427-4bf7-920e-da3271cf28ba None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:37.926506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea522456-5427-4bf7-920e-da3271cf28ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:37.939236 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:37.958171 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847626b8-453e-4ec7-b391-80a674d2a394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:37.959048 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847626b8-453e-4ec7-b391-80a674d2a394 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:37.959335 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847626b8-453e-4ec7-b391-80a674d2a394 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:37.959618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847626b8-453e-4ec7-b391-80a674d2a394 None admin] PATH_INFO: `/v3/users/092f05933deb48f8a7a3513d1dabe8cb` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:37.961402 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847626b8-453e-4ec7-b391-80a674d2a394 None admin] RBAC: Authorizing `identity:get_user(user_id=092f05933deb48f8a7a3513d1dabe8cb)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:37.963967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847626b8-453e-4ec7-b391-80a674d2a394 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:37.965829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 166/348] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:40:37 2022] GET /identity/v3/users/092f05933deb48f8a7a3513d1dabe8cb => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:37.968913 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847626b8-453e-4ec7-b391-80a674d2a394 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:38.022015 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea522456-5427-4bf7-920e-da3271cf28ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:38.025062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea522456-5427-4bf7-920e-da3271cf28ba None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:38.048659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:38.097562 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847626b8-453e-4ec7-b391-80a674d2a394 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:38.138090 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20b8f7-41f0-486e-b266-bf45eae156fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:38.139009 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20b8f7-41f0-486e-b266-bf45eae156fa None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:38.139412 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20b8f7-41f0-486e-b266-bf45eae156fa None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:38.139784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20b8f7-41f0-486e-b266-bf45eae156fa None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:38.141126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20b8f7-41f0-486e-b266-bf45eae156fa None admin] RBAC: Authorizing `identity:get_project(project_id=d81536229a89416692cd909ecd4bd4ec)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:38.142672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20b8f7-41f0-486e-b266-bf45eae156fa None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:38.144811 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 167/349] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:37 2022] GET /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:38.146010 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05244c1-91e7-40e4-a156-247d70b04d2d None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:38.146392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05244c1-91e7-40e4-a156-247d70b04d2d None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:38.146767 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05244c1-91e7-40e4-a156-247d70b04d2d None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:38.148213 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 168/350] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:38.148618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 183/351] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:38.149720 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea522456-5427-4bf7-920e-da3271cf28ba None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:38.154328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87a70a-ed46-42c4-aadc-599d3e112fd7 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:38.154618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87a70a-ed46-42c4-aadc-599d3e112fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:38.154889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87a70a-ed46-42c4-aadc-599d3e112fd7 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:38.156306 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 169/352] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:38.156983 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87a70a-ed46-42c4-aadc-599d3e112fd7 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:38.224567 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:38.279229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea522456-5427-4bf7-920e-da3271cf28ba None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:38.283898 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87a70a-ed46-42c4-aadc-599d3e112fd7 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:38.298603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:38.326751 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebdb645-8b48-49a5-8e7c-0e9445dbf4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:38.327418 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdb645-8b48-49a5-8e7c-0e9445dbf4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:38.327704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdb645-8b48-49a5-8e7c-0e9445dbf4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:38.327984 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdb645-8b48-49a5-8e7c-0e9445dbf4e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:38.328894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebdb645-8b48-49a5-8e7c-0e9445dbf4e3 None admin] RBAC: Adding query filter params (role.id=434b9e3fd1f6417689c6bd184fbdb7e6, user.id=092f05933deb48f8a7a3513d1dabe8cb, scope.system=all) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:38.329211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebdb645-8b48-49a5-8e7c-0e9445dbf4e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:38.330660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebdb645-8b48-49a5-8e7c-0e9445dbf4e3 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:38.342237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b060dd0-6990-4cab-8c75-f90381b50b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:38.343591 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b060dd0-6990-4cab-8c75-f90381b50b6f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:38.344047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b060dd0-6990-4cab-8c75-f90381b50b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:38.344572 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b060dd0-6990-4cab-8c75-f90381b50b6f None admin] PATH_INFO: `/v3/groups/96f14487db2f4fa39a598cdabca81a49` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:38.345161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 184/353] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Jun 22 16:40:38 2022] GET /identity/v3/role_assignments?user.id=092f05933deb48f8a7a3513d1dabe8cb&scope.system=all&role.id=434b9e3fd1f6417689c6bd184fbdb7e6 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:38.346459 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b6192-55d0-4db5-8a12-7be23d11d3e3 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:38.346749 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b6192-55d0-4db5-8a12-7be23d11d3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:38.347028 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b6192-55d0-4db5-8a12-7be23d11d3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:38.357287 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b060dd0-6990-4cab-8c75-f90381b50b6f None admin] RBAC: Authorizing `identity:get_group(group_id=96f14487db2f4fa39a598cdabca81a49)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:38.359208 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b060dd0-6990-4cab-8c75-f90381b50b6f None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:38.361396 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 170/354] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 16:40:38 2022] GET /identity/v3/groups/96f14487db2f4fa39a598cdabca81a49 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:38.363042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e275d76-0ae6-4d8f-835d-6519e8251245 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:38.363574 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e275d76-0ae6-4d8f-835d-6519e8251245 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:38.364776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e275d76-0ae6-4d8f-835d-6519e8251245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:38.368983 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-a88b6192-55d0-4db5-8a12-7be23d11d3e3 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:38.370491 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-a88b6192-55d0-4db5-8a12-7be23d11d3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:38.386452 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-0e275d76-0ae6-4d8f-835d-6519e8251245 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:38.388353 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0e275d76-0ae6-4d8f-835d-6519e8251245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:38.462748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 185/355] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:38.463963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b6192-55d0-4db5-8a12-7be23d11d3e3 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:38.491276 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 171/356] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:38.493837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e275d76-0ae6-4d8f-835d-6519e8251245 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:38.565796 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:38.598884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b6192-55d0-4db5-8a12-7be23d11d3e3 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:38.601829 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:38.631200 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e275d76-0ae6-4d8f-835d-6519e8251245 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:38.640711 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885fcf4-4176-487f-aca4-ec8c3a9b92cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:38.641511 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885fcf4-4176-487f-aca4-ec8c3a9b92cf None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:38.642043 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885fcf4-4176-487f-aca4-ec8c3a9b92cf None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:38.642043 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885fcf4-4176-487f-aca4-ec8c3a9b92cf None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:38.643248 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885fcf4-4176-487f-aca4-ec8c3a9b92cf None admin] RBAC: Authorizing `identity:get_project(project_id=d81536229a89416692cd909ecd4bd4ec)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:38.644740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885fcf4-4176-487f-aca4-ec8c3a9b92cf None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:38.646570 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 186/357] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:38 2022] GET /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:38.647187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885fcf4-4176-487f-aca4-ec8c3a9b92cf None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:38.676688 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699ea67-b288-4f0c-9448-6e7ef5283fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:38.677344 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699ea67-b288-4f0c-9448-6e7ef5283fef None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:38.677626 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699ea67-b288-4f0c-9448-6e7ef5283fef None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:38.677905 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699ea67-b288-4f0c-9448-6e7ef5283fef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:38.678740 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699ea67-b288-4f0c-9448-6e7ef5283fef None admin] RBAC: Adding query filter params (group.id=96f14487db2f4fa39a598cdabca81a49, role.id=885a05785a714822b2012deb56880a73, scope.project.id=d81536229a89416692cd909ecd4bd4ec) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:38.679048 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699ea67-b288-4f0c-9448-6e7ef5283fef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:38.682010 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699ea67-b288-4f0c-9448-6e7ef5283fef None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:38.688784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 172/358] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jun 22 16:40:38 2022] GET /identity/v3/role_assignments?group.id=96f14487db2f4fa39a598cdabca81a49&scope.project.id=d81536229a89416692cd909ecd4bd4ec&role.id=885a05785a714822b2012deb56880a73 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:38.690065 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec40a1-0e3c-409f-892a-07a67d19f0fe None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:38.690244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec40a1-0e3c-409f-892a-07a67d19f0fe None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:38.690473 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec40a1-0e3c-409f-892a-07a67d19f0fe None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:38.691715 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 173/359] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:38.692433 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec40a1-0e3c-409f-892a-07a67d19f0fe None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:38.778280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885fcf4-4176-487f-aca4-ec8c3a9b92cf None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:38.825816 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c9357-6ccf-4a8f-96eb-a1f3c2a300c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:38.826726 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c9357-6ccf-4a8f-96eb-a1f3c2a300c0 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:38.826929 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c9357-6ccf-4a8f-96eb-a1f3c2a300c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:38.827484 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c9357-6ccf-4a8f-96eb-a1f3c2a300c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:38.839556 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec40a1-0e3c-409f-892a-07a67d19f0fe None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:38.852259 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c9357-6ccf-4a8f-96eb-a1f3c2a300c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:38.859438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:38.861351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-cb4c9357-6ccf-4a8f-96eb-a1f3c2a300c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:38.861351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:38.861351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:38.861351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:38.861351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:38.861351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:38.861351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:38.861351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:38.861351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:38.861351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:38.861351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:38.861351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:38.861351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:38.861351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:38.861351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:38.861351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:38.862415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:38.862415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:38.862415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:38.862415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:38.862415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:38.862415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:38.862415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:38.862415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:38.862415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:38.862415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:38.862415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:38.862415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:38.862415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:38.862415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:38.862415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:38.862415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:38.863392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:38.863392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:38.863392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:38.863392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:38.863392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:38.863392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:38.863392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:38.863392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:38.863392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:38.863392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:38.863392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:38.863392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:38.865499 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 187/360] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:40:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:38.866454 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c9357-6ccf-4a8f-96eb-a1f3c2a300c0 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:38.885941 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259216a-b7bb-477e-b8f8-9dc7551c67a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:38.886694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259216a-b7bb-477e-b8f8-9dc7551c67a1 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:38.886979 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259216a-b7bb-477e-b8f8-9dc7551c67a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:38.887254 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259216a-b7bb-477e-b8f8-9dc7551c67a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:38.902306 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259216a-b7bb-477e-b8f8-9dc7551c67a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:38.907245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:38.910054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-1259216a-b7bb-477e-b8f8-9dc7551c67a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:38.910054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:38.910054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:38.910054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:38.910054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:38.910054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:38.910054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:38.910054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:38.910054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:38.910054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:38.910054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:38.910054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:38.910054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:38.910054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:38.910054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:38.910054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:38.915357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:38.915357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:38.915357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:38.915357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:38.915357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:38.915357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:38.915357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:38.915357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:38.915357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:38.915357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:38.915357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:38.915357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:38.915357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:38.915357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:38.915357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:38.915357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:38.916187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:38.916187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:38.916187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:38.916187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:38.916187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:38.916187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:38.916187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:38.916187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:38.916187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:38.916187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:38.916187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:38.916187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:38.916187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 174/361] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:38.916187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a013ecb-36ac-4765-bcc8-1fa2d7ff1a84 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:38.916894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a013ecb-36ac-4765-bcc8-1fa2d7ff1a84 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:38.916894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a013ecb-36ac-4765-bcc8-1fa2d7ff1a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:38.932700 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-3a013ecb-36ac-4765-bcc8-1fa2d7ff1a84 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:38.933890 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-3a013ecb-36ac-4765-bcc8-1fa2d7ff1a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:38.999377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c9357-6ccf-4a8f-96eb-a1f3c2a300c0 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:39.010512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 175/362] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:39.011655 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a013ecb-36ac-4765-bcc8-1fa2d7ff1a84 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:39.046360 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29234036-d1de-4293-9f82-de74ab19883b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:39.047313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29234036-d1de-4293-9f82-de74ab19883b None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:39.047740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29234036-d1de-4293-9f82-de74ab19883b None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:39.047946 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29234036-d1de-4293-9f82-de74ab19883b None admin] PATH_INFO: `/v3/groups/96f14487db2f4fa39a598cdabca81a49` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:39.049160 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29234036-d1de-4293-9f82-de74ab19883b None admin] RBAC: Authorizing `identity:get_group(group_id=96f14487db2f4fa39a598cdabca81a49)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:39.050626 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29234036-d1de-4293-9f82-de74ab19883b None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:39.052683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 188/363] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 16:40:38 2022] GET /identity/v3/groups/96f14487db2f4fa39a598cdabca81a49 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:39.054129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29234036-d1de-4293-9f82-de74ab19883b None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:39.142029 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a013ecb-36ac-4765-bcc8-1fa2d7ff1a84 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:39.145131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:39.183746 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:39.193448 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70972bde-722b-4340-b602-097bfb11ff7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:39.193993 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29234036-d1de-4293-9f82-de74ab19883b None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:39.194446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70972bde-722b-4340-b602-097bfb11ff7f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:39.194446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70972bde-722b-4340-b602-097bfb11ff7f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:39.194774 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70972bde-722b-4340-b602-097bfb11ff7f None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:39.196241 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70972bde-722b-4340-b602-097bfb11ff7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:39.196475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70972bde-722b-4340-b602-097bfb11ff7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:39.197874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70972bde-722b-4340-b602-097bfb11ff7f None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:39.211934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 176/364] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:40:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:39.213582 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70972bde-722b-4340-b602-097bfb11ff7f None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:39.245472 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f3df5-d55f-4052-af71-c5e3246f0676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:39.246280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f3df5-d55f-4052-af71-c5e3246f0676 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:39.246655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f3df5-d55f-4052-af71-c5e3246f0676 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:39.246834 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f3df5-d55f-4052-af71-c5e3246f0676 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:39.247589 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f3df5-d55f-4052-af71-c5e3246f0676 None admin] RBAC: Adding query filter params (name=member) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:39.247967 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f3df5-d55f-4052-af71-c5e3246f0676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:39.249772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f3df5-d55f-4052-af71-c5e3246f0676 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:39.258483 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 189/365] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:39.259515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f3df5-d55f-4052-af71-c5e3246f0676 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:39.353514 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70972bde-722b-4340-b602-097bfb11ff7f None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:39.381549 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f3df5-d55f-4052-af71-c5e3246f0676 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:39.400425 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3847b7-c6f9-4fb0-826e-d25e234fe54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:39.401221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3847b7-c6f9-4fb0-826e-d25e234fe54b None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:39.401504 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3847b7-c6f9-4fb0-826e-d25e234fe54b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:39.402081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3847b7-c6f9-4fb0-826e-d25e234fe54b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:39.415724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3847b7-c6f9-4fb0-826e-d25e234fe54b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:39.423475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-3f3847b7-c6f9-4fb0-826e-d25e234fe54b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:40:39.423475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:39.423475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:39.423475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:39.423475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:39.423475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:39.423475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:39.423475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:39.423475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:39.423475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:39.423475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:39.423475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:39.423475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:39.423475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:39.423475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:39.423475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:39.424492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:39.424492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:39.424492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:39.424492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:39.424492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:39.424492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:39.424492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:39.424492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:39.424492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:39.424492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:39.424492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:39.424492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:39.424492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:39.424492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:39.424492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:39.424492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:39.425282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:39.425282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:39.425282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:39.425282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:39.425282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:39.425282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:39.425282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:39.425282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:39.425282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:39.425282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:39.425282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:40:39.425282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:39.425282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 177/366] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:40:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:39.425931 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef1bd5-51a8-4e81-8a89-97cfa5343359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:39.426016 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3847b7-c6f9-4fb0-826e-d25e234fe54b None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:39.426083 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef1bd5-51a8-4e81-8a89-97cfa5343359 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:39.426815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef1bd5-51a8-4e81-8a89-97cfa5343359 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:39.426815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef1bd5-51a8-4e81-8a89-97cfa5343359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:39.431703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef1bd5-51a8-4e81-8a89-97cfa5343359 None admin] RBAC: Adding query filter params (group.id=96f14487db2f4fa39a598cdabca81a49, role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2, scope.project.id=d81536229a89416692cd909ecd4bd4ec) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:39.431703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef1bd5-51a8-4e81-8a89-97cfa5343359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:39.431703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef1bd5-51a8-4e81-8a89-97cfa5343359 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:39.444435 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 190/367] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jun 22 16:40:39 2022] GET /identity/v3/role_assignments?group.id=96f14487db2f4fa39a598cdabca81a49&scope.project.id=d81536229a89416692cd909ecd4bd4ec&role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:39.446473 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef1bd5-51a8-4e81-8a89-97cfa5343359 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:39.483999 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:39.486548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:39.548319 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3847b7-c6f9-4fb0-826e-d25e234fe54b None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:39.585872 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef1bd5-51a8-4e81-8a89-97cfa5343359 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:39.592520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca8100-d8c0-4732-8002-9c5a231d8f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:39.593255 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca8100-d8c0-4732-8002-9c5a231d8f2b None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:39.593545 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca8100-d8c0-4732-8002-9c5a231d8f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:39.593828 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca8100-d8c0-4732-8002-9c5a231d8f2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:39.635292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92e624-f79d-48b5-99b4-ad4197cca527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:39.636619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92e624-f79d-48b5-99b4-ad4197cca527 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:39.636619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92e624-f79d-48b5-99b4-ad4197cca527 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:39.636619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92e624-f79d-48b5-99b4-ad4197cca527 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:39.678625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca8100-d8c0-4732-8002-9c5a231d8f2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:39.678625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca8100-d8c0-4732-8002-9c5a231d8f2b None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:39.710680 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:39.725327 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92e624-f79d-48b5-99b4-ad4197cca527 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:39.727764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92e624-f79d-48b5-99b4-ad4197cca527 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:39.758526 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:39.805873 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 178/368] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:39.806861 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca8100-d8c0-4732-8002-9c5a231d8f2b None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:39.854455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 191/369] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:39.856151 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92e624-f79d-48b5-99b4-ad4197cca527 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:39.927319 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca8100-d8c0-4732-8002-9c5a231d8f2b None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:39.957605 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:39.966906 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff130cfd-42b6-44fa-840e-f999118a8b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:39.967626 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff130cfd-42b6-44fa-840e-f999118a8b89 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:39.967783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff130cfd-42b6-44fa-840e-f999118a8b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:39.968068 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff130cfd-42b6-44fa-840e-f999118a8b89 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:39.968858 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff130cfd-42b6-44fa-840e-f999118a8b89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:39.969158 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff130cfd-42b6-44fa-840e-f999118a8b89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:39.973900 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff130cfd-42b6-44fa-840e-f999118a8b89 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:39.980263 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 179/370] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:39.981189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff130cfd-42b6-44fa-840e-f999118a8b89 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:39.984192 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92e624-f79d-48b5-99b4-ad4197cca527 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:40.023933 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c80efe-6daf-45d7-a378-f065cfeaf43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:40.032165 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:40.032562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c80efe-6daf-45d7-a378-f065cfeaf43e None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:40.033005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c80efe-6daf-45d7-a378-f065cfeaf43e None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:40.033412 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c80efe-6daf-45d7-a378-f065cfeaf43e None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:40.035078 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c80efe-6daf-45d7-a378-f065cfeaf43e None admin] RBAC: Authorizing `identity:get_project(project_id=1d92be9a7941425d9b66dc77739c5443)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:40.036935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c80efe-6daf-45d7-a378-f065cfeaf43e None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:40.039176 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 192/371] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:39 2022] GET /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:40.040097 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c80efe-6daf-45d7-a378-f065cfeaf43e None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:40.101616 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff130cfd-42b6-44fa-840e-f999118a8b89 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:40.141898 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad42de-df6e-4964-8188-6bdd8f28fce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:40.142854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad42de-df6e-4964-8188-6bdd8f28fce5 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:40.143141 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad42de-df6e-4964-8188-6bdd8f28fce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:40.143415 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad42de-df6e-4964-8188-6bdd8f28fce5 None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:40.144653 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad42de-df6e-4964-8188-6bdd8f28fce5 None admin] RBAC: Authorizing `identity:get_project(project_id=1d92be9a7941425d9b66dc77739c5443)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:40.146285 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad42de-df6e-4964-8188-6bdd8f28fce5 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:40.148879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 180/372] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:39 2022] GET /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:40.149718 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad42de-df6e-4964-8188-6bdd8f28fce5 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:40.198257 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c80efe-6daf-45d7-a378-f065cfeaf43e None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:40.219183 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:40.246348 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaff228-7074-427c-8e2d-62ed79c31ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:40.247008 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaff228-7074-427c-8e2d-62ed79c31ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:40.247290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaff228-7074-427c-8e2d-62ed79c31ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:40.247561 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaff228-7074-427c-8e2d-62ed79c31ec0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:40.279760 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad42de-df6e-4964-8188-6bdd8f28fce5 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:40.316947 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e669d1-2e0f-4c0f-8204-91aeb7bc6a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:40.317805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e669d1-2e0f-4c0f-8204-91aeb7bc6a58 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:40.318088 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e669d1-2e0f-4c0f-8204-91aeb7bc6a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:40.318361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e669d1-2e0f-4c0f-8204-91aeb7bc6a58 None admin] PATH_INFO: `/v3/groups/96f14487db2f4fa39a598cdabca81a49` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:40.319566 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e669d1-2e0f-4c0f-8204-91aeb7bc6a58 None admin] RBAC: Authorizing `identity:get_group(group_id=96f14487db2f4fa39a598cdabca81a49)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:40.321653 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e669d1-2e0f-4c0f-8204-91aeb7bc6a58 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:40.325415 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 181/373] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 16:40:40 2022] GET /identity/v3/groups/96f14487db2f4fa39a598cdabca81a49 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:40.325555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e669d1-2e0f-4c0f-8204-91aeb7bc6a58 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:40.332463 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:40.340752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaff228-7074-427c-8e2d-62ed79c31ec0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:40.342504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaff228-7074-427c-8e2d-62ed79c31ec0 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:40.435808 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e669d1-2e0f-4c0f-8204-91aeb7bc6a58 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:40.455528 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 193/374] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:40.457171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaff228-7074-427c-8e2d-62ed79c31ec0 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:40.461129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:40.480871 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1831fe-594e-4086-adc7-9825801f3002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:40.480871 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1831fe-594e-4086-adc7-9825801f3002 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:40.480871 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1831fe-594e-4086-adc7-9825801f3002 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:40.480871 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1831fe-594e-4086-adc7-9825801f3002 None admin] PATH_INFO: `/v3/groups/96f14487db2f4fa39a598cdabca81a49` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:40.482264 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1831fe-594e-4086-adc7-9825801f3002 None admin] RBAC: Authorizing `identity:get_group(group_id=96f14487db2f4fa39a598cdabca81a49)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:40.482264 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1831fe-594e-4086-adc7-9825801f3002 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:40.482264 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 182/375] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 16:40:40 2022] GET /identity/v3/groups/96f14487db2f4fa39a598cdabca81a49 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:40.482264 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1831fe-594e-4086-adc7-9825801f3002 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:40.564067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:40.571791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaff228-7074-427c-8e2d-62ed79c31ec0 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:40.589266 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1831fe-594e-4086-adc7-9825801f3002 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:40.610192 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8988ce-8a82-41a5-96a5-2a7ad4150e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:40.611324 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8988ce-8a82-41a5-96a5-2a7ad4150e4e None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:40.611996 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8988ce-8a82-41a5-96a5-2a7ad4150e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:40.612563 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8988ce-8a82-41a5-96a5-2a7ad4150e4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:40.613602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8988ce-8a82-41a5-96a5-2a7ad4150e4e None admin] RBAC: Adding query filter params (group.id=96f14487db2f4fa39a598cdabca81a49, role.id=885a05785a714822b2012deb56880a73, scope.project.id=1d92be9a7941425d9b66dc77739c5443) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:40.614120 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8988ce-8a82-41a5-96a5-2a7ad4150e4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:40.615775 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8988ce-8a82-41a5-96a5-2a7ad4150e4e None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:40.624412 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b569f0e-588c-4ec8-bd45-0482ea5823e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:40.624986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 194/376] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jun 22 16:40:40 2022] GET /identity/v3/role_assignments?group.id=96f14487db2f4fa39a598cdabca81a49&scope.project.id=1d92be9a7941425d9b66dc77739c5443&role.id=885a05785a714822b2012deb56880a73 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:40.625174 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b569f0e-588c-4ec8-bd45-0482ea5823e6 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:40.625440 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b569f0e-588c-4ec8-bd45-0482ea5823e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:40.625714 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b569f0e-588c-4ec8-bd45-0482ea5823e6 None admin] PATH_INFO: `/v3/projects/591e7cfe38c74f35852c3e0ac79addb7` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:40.626707 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8988ce-8a82-41a5-96a5-2a7ad4150e4e None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:40.633660 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b569f0e-588c-4ec8-bd45-0482ea5823e6 None admin] RBAC: Authorizing `identity:get_project(project_id=591e7cfe38c74f35852c3e0ac79addb7)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:40.635128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b569f0e-588c-4ec8-bd45-0482ea5823e6 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:40.645473 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 183/377] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:40 2022] GET /identity/v3/projects/591e7cfe38c74f35852c3e0ac79addb7 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:40.650706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b569f0e-588c-4ec8-bd45-0482ea5823e6 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:40.743351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8988ce-8a82-41a5-96a5-2a7ad4150e4e None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:40.777592 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:40.786651 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6df13-ab3a-449f-bf39-d61ac95a2228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:40.787670 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6df13-ab3a-449f-bf39-d61ac95a2228 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:40.793488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6df13-ab3a-449f-bf39-d61ac95a2228 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:40.793488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6df13-ab3a-449f-bf39-d61ac95a2228 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:40.793488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6df13-ab3a-449f-bf39-d61ac95a2228 None admin] RBAC: Adding query filter params (group.id=96f14487db2f4fa39a598cdabca81a49, role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2, scope.project.id=1d92be9a7941425d9b66dc77739c5443) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:40.793488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6df13-ab3a-449f-bf39-d61ac95a2228 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:40.794115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6df13-ab3a-449f-bf39-d61ac95a2228 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:40.801883 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 195/378] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jun 22 16:40:40 2022] GET /identity/v3/role_assignments?group.id=96f14487db2f4fa39a598cdabca81a49&scope.project.id=1d92be9a7941425d9b66dc77739c5443&role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:40.881393 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b569f0e-588c-4ec8-bd45-0482ea5823e6 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:40.933947 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fb890-67c4-4bcd-8914-b2dbeda1e0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:40.935239 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fb890-67c4-4bcd-8914-b2dbeda1e0bf None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:40.935760 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fb890-67c4-4bcd-8914-b2dbeda1e0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:40.936272 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fb890-67c4-4bcd-8914-b2dbeda1e0bf None admin] PATH_INFO: `/v3/groups/6c70e009332c48cbba2a034a41d03c23` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:40.942551 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fb890-67c4-4bcd-8914-b2dbeda1e0bf None admin] RBAC: Authorizing `identity:get_group(group_id=6c70e009332c48cbba2a034a41d03c23)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:40.944387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fb890-67c4-4bcd-8914-b2dbeda1e0bf None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:40.946865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 184/379] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 16:40:40 2022] GET /identity/v3/groups/6c70e009332c48cbba2a034a41d03c23 => generated 229 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:40.952254 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6df13-ab3a-449f-bf39-d61ac95a2228 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:40.957834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6900-bc4c-48ae-94d1-0a5ebd2168e9 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:40.958123 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6900-bc4c-48ae-94d1-0a5ebd2168e9 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:40.958399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd6900-bc4c-48ae-94d1-0a5ebd2168e9 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:40.960121 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 185/380] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:40.967390 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da02708-afc9-4cd1-a63a-a44481be28f9 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:40.967887 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da02708-afc9-4cd1-a63a-a44481be28f9 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:40.968392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da02708-afc9-4cd1-a63a-a44481be28f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:40.994957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:40.996650 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-7da02708-afc9-4cd1-a63a-a44481be28f9 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:40.997878 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-7da02708-afc9-4cd1-a63a-a44481be28f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:41.094151 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 186/381] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:41.118841 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da02708-afc9-4cd1-a63a-a44481be28f9 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:41.138336 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6df13-ab3a-449f-bf39-d61ac95a2228 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:41.206448 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a523c0-fcf5-4e62-a1d4-31c1daac2838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:41.207481 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a523c0-fcf5-4e62-a1d4-31c1daac2838 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:41.207955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a523c0-fcf5-4e62-a1d4-31c1daac2838 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:41.208442 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a523c0-fcf5-4e62-a1d4-31c1daac2838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:41.209477 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a523c0-fcf5-4e62-a1d4-31c1daac2838 None admin] RBAC: Adding query filter params (group.id=6c70e009332c48cbba2a034a41d03c23, role.id=459b0e5c21c94fb1b81f76c65780fdb5, scope.project.id=591e7cfe38c74f35852c3e0ac79addb7) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:41.210001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a523c0-fcf5-4e62-a1d4-31c1daac2838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:41.212478 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a523c0-fcf5-4e62-a1d4-31c1daac2838 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:41.218404 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:41.222674 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 196/382] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jun 22 16:40:40 2022] GET /identity/v3/role_assignments?group.id=6c70e009332c48cbba2a034a41d03c23&scope.project.id=591e7cfe38c74f35852c3e0ac79addb7&role.id=459b0e5c21c94fb1b81f76c65780fdb5 => generated 260 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:41.288496 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da02708-afc9-4cd1-a63a-a44481be28f9 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:41.339720 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca9aaa-7c33-490d-8378-1b17b6935b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:41.340601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca9aaa-7c33-490d-8378-1b17b6935b97 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:41.340880 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca9aaa-7c33-490d-8378-1b17b6935b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:41.341150 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca9aaa-7c33-490d-8378-1b17b6935b97 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:41.356892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca9aaa-7c33-490d-8378-1b17b6935b97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:41.365310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-a4ca9aaa-7c33-490d-8378-1b17b6935b97 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:41.365310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:41.365310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:41.365310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:41.365310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:41.365310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:41.365310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:41.365310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:41.365310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:41.365310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:41.365310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:41.365310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:41.365310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:41.365310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:41.365310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:41.365310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:41.366245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:41.366245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:41.366245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:41.366245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:41.366245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:41.366245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:41.366245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:41.366245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:41.366245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:41.366245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:41.366245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:41.366245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:41.366245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:41.366245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:41.366245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:41.366245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:41.367552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:41.367552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:41.367552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:41.367552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:41.367552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:41.367552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:41.367552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:41.367552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:41.367552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:41.367552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:41.367552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:41.367552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:41.367552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 187/383] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:40:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:41.372984 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a523c0-fcf5-4e62-a1d4-31c1daac2838 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:41.478642 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:41.499756 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a523c0-fcf5-4e62-a1d4-31c1daac2838 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:41.544268 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cda38a-498b-49b8-8d89-4835b5584037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:41.544868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cda38a-498b-49b8-8d89-4835b5584037 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:41.545152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cda38a-498b-49b8-8d89-4835b5584037 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:41.545430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cda38a-498b-49b8-8d89-4835b5584037 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:41.546192 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cda38a-498b-49b8-8d89-4835b5584037 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:41.546500 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cda38a-498b-49b8-8d89-4835b5584037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:41.547881 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cda38a-498b-49b8-8d89-4835b5584037 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:41.556957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 197/384] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:40:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:41.562279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca9aaa-7c33-490d-8378-1b17b6935b97 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:41.699851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca9aaa-7c33-490d-8378-1b17b6935b97 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:41.718915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:41.745439 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bdfd7-7ab2-40b2-a300-c6fe25ee66e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:41.746295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bdfd7-7ab2-40b2-a300-c6fe25ee66e5 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:41.746576 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bdfd7-7ab2-40b2-a300-c6fe25ee66e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:41.746845 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bdfd7-7ab2-40b2-a300-c6fe25ee66e5 None admin] PATH_INFO: `/v3/groups/96f14487db2f4fa39a598cdabca81a49` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:41.748031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bdfd7-7ab2-40b2-a300-c6fe25ee66e5 None admin] RBAC: Authorizing `identity:get_group(group_id=96f14487db2f4fa39a598cdabca81a49)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:41.749506 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bdfd7-7ab2-40b2-a300-c6fe25ee66e5 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:41.751413 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 188/385] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 16:40:41 2022] GET /identity/v3/groups/96f14487db2f4fa39a598cdabca81a49 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:41.756906 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cda38a-498b-49b8-8d89-4835b5584037 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:41.880265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cda38a-498b-49b8-8d89-4835b5584037 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:41.914570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b7b46-311f-49f8-b914-27f0d9769efb None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:41.914908 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b7b46-311f-49f8-b914-27f0d9769efb None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:41.915101 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b7b46-311f-49f8-b914-27f0d9769efb None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:41.916909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 189/386] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:41.921666 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c0026-ac27-4fcf-a096-3a0fec57b4fc None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:41.921954 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c0026-ac27-4fcf-a096-3a0fec57b4fc None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:41.922236 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c0026-ac27-4fcf-a096-3a0fec57b4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:41.931392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db7197-44dc-4a68-be2f-a35ed0396c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:41.932617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db7197-44dc-4a68-be2f-a35ed0396c41 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:41.933105 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db7197-44dc-4a68-be2f-a35ed0396c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:41.933597 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db7197-44dc-4a68-be2f-a35ed0396c41 None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:41.935014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db7197-44dc-4a68-be2f-a35ed0396c41 None admin] RBAC: Authorizing `identity:get_project(project_id=d81536229a89416692cd909ecd4bd4ec)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:41.937543 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db7197-44dc-4a68-be2f-a35ed0396c41 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:41.942030 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 198/387] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:41 2022] GET /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:41.943190 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-064c0026-ac27-4fcf-a096-3a0fec57b4fc None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:41.944281 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-064c0026-ac27-4fcf-a096-3a0fec57b4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:41.948463 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db7197-44dc-4a68-be2f-a35ed0396c41 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:41.983329 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:42.068465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 190/388] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:40:42.092059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c0026-ac27-4fcf-a096-3a0fec57b4fc None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:42.103832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db7197-44dc-4a68-be2f-a35ed0396c41 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:42.140045 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21509a33-4017-4c88-9a1c-7e31052412a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:42.141029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21509a33-4017-4c88-9a1c-7e31052412a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:42.141309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21509a33-4017-4c88-9a1c-7e31052412a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:42.141581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21509a33-4017-4c88-9a1c-7e31052412a6 None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec/groups/96f14487db2f4fa39a598cdabca81a49/roles/885a05785a714822b2012deb56880a73` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:42.143943 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21509a33-4017-4c88-9a1c-7e31052412a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d81536229a89416692cd909ecd4bd4ec, group_id=96f14487db2f4fa39a598cdabca81a49, role_id=885a05785a714822b2012deb56880a73)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:42.145641 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21509a33-4017-4c88-9a1c-7e31052412a6 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:42.203097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c0026-ac27-4fcf-a096-3a0fec57b4fc None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:42.212129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 199/389] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Jun 22 16:40:41 2022] PUT /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec/groups/96f14487db2f4fa39a598cdabca81a49/roles/885a05785a714822b2012deb56880a73 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:40:42.227594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:42.261070 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef01eb-7fe2-4333-863a-f80d2cc5c184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:42.261904 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef01eb-7fe2-4333-863a-f80d2cc5c184 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:42.262188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef01eb-7fe2-4333-863a-f80d2cc5c184 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:42.262726 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef01eb-7fe2-4333-863a-f80d2cc5c184 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:42.281559 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef01eb-7fe2-4333-863a-f80d2cc5c184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:42.289844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-baef01eb-7fe2-4333-863a-f80d2cc5c184 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:42.289844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:42.289844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:42.289844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:42.289844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:42.289844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:42.289844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:42.289844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:42.289844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:42.289844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:42.289844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:42.289844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:42.289844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:42.289844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:42.289844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:42.289844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:42.290827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:42.290827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:42.290827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:42.290827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:42.290827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:42.290827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:42.290827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:42.290827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:42.290827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:42.290827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:42.290827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:42.290827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:42.290827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:42.290827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:42.290827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:42.290827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:42.291709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:42.291709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:42.291709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:42.291709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:42.291709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:42.291709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:42.291709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:42.291709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:42.291709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:42.291709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:42.291709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:42.291709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:42.291709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 191/390] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:40:42.297716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21509a33-4017-4c88-9a1c-7e31052412a6 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:42.419528 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:42.455093 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21509a33-4017-4c88-9a1c-7e31052412a6 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:42.492352 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4f324-c5ca-4e60-aa9a-6f9fff192d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:42.493082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4f324-c5ca-4e60-aa9a-6f9fff192d97 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:42.493312 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4f324-c5ca-4e60-aa9a-6f9fff192d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:42.493651 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4f324-c5ca-4e60-aa9a-6f9fff192d97 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:42.494420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4f324-c5ca-4e60-aa9a-6f9fff192d97 None admin] RBAC: Adding query filter params (name=member) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:42.494780 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4f324-c5ca-4e60-aa9a-6f9fff192d97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:42.496191 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4f324-c5ca-4e60-aa9a-6f9fff192d97 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:42.505068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 200/391] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:42.515860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef01eb-7fe2-4333-863a-f80d2cc5c184 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:42.661319 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef01eb-7fe2-4333-863a-f80d2cc5c184 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:42.696011 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757080e2-0c69-4afb-be2f-bbcf757bcf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:42.696873 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757080e2-0c69-4afb-be2f-bbcf757bcf3e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:42.697163 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757080e2-0c69-4afb-be2f-bbcf757bcf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:42.697442 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757080e2-0c69-4afb-be2f-bbcf757bcf3e None admin] PATH_INFO: `/v3/groups/96f14487db2f4fa39a598cdabca81a49` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:42.698629 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757080e2-0c69-4afb-be2f-bbcf757bcf3e None admin] RBAC: Authorizing `identity:get_group(group_id=96f14487db2f4fa39a598cdabca81a49)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:42.700057 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757080e2-0c69-4afb-be2f-bbcf757bcf3e None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:42.702072 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 192/392] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 16:40:42 2022] GET /identity/v3/groups/96f14487db2f4fa39a598cdabca81a49 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:42.709222 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4f324-c5ca-4e60-aa9a-6f9fff192d97 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:42.836535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4f324-c5ca-4e60-aa9a-6f9fff192d97 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:42.870745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43ea54-787b-457e-b537-3a6af7ba9d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:42.871602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43ea54-787b-457e-b537-3a6af7ba9d76 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:42.871887 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43ea54-787b-457e-b537-3a6af7ba9d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:42.872191 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43ea54-787b-457e-b537-3a6af7ba9d76 None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:42.873389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43ea54-787b-457e-b537-3a6af7ba9d76 None admin] RBAC: Authorizing `identity:get_project(project_id=d81536229a89416692cd909ecd4bd4ec)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:42.874829 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43ea54-787b-457e-b537-3a6af7ba9d76 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:42.876906 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 201/393] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:42 2022] GET /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:42.885137 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757080e2-0c69-4afb-be2f-bbcf757bcf3e None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:42.929014 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:42.988627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757080e2-0c69-4afb-be2f-bbcf757bcf3e None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:43.027633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479148f-7a80-40e9-af93-4b69a7ee8acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:43.028558 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479148f-7a80-40e9-af93-4b69a7ee8acf None admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:43.028846 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479148f-7a80-40e9-af93-4b69a7ee8acf None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:43.029123 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479148f-7a80-40e9-af93-4b69a7ee8acf None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec/groups/96f14487db2f4fa39a598cdabca81a49/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:43.031093 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479148f-7a80-40e9-af93-4b69a7ee8acf None admin] RBAC: Authorizing `identity:create_grant(project_id=d81536229a89416692cd909ecd4bd4ec, group_id=96f14487db2f4fa39a598cdabca81a49, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:43.032571 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479148f-7a80-40e9-af93-4b69a7ee8acf None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:43.123173 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 193/394] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Jun 22 16:40:42 2022] PUT /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec/groups/96f14487db2f4fa39a598cdabca81a49/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:40:43.389451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed683c7a-01b1-44be-949a-ca31d19fbb4e None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:43.389771 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed683c7a-01b1-44be-949a-ca31d19fbb4e None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:43.389995 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed683c7a-01b1-44be-949a-ca31d19fbb4e None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:43.391520 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 202/395] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:43.396968 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e755f-7d59-4679-8463-4621b9983c67 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:43.397257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e755f-7d59-4679-8463-4621b9983c67 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:43.397538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e755f-7d59-4679-8463-4621b9983c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:43.417769 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-aa9e755f-7d59-4679-8463-4621b9983c67 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:43.418964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-aa9e755f-7d59-4679-8463-4621b9983c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:43.500917 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 194/396] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:43.535294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed683c7a-01b1-44be-949a-ca31d19fbb4e None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:43.546068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:43.671896 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed683c7a-01b1-44be-949a-ca31d19fbb4e None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:43.683569 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6c1b2-bc38-4dff-810f-2d9b1477c740 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:43.684086 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6c1b2-bc38-4dff-810f-2d9b1477c740 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:43.684347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6c1b2-bc38-4dff-810f-2d9b1477c740 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:43.686371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 195/397] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:43.693059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6863993-0cce-486d-826e-87579418331f None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:43.693346 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6863993-0cce-486d-826e-87579418331f None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:43.693623 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6863993-0cce-486d-826e-87579418331f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:43.715508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc0ead-66e1-4d80-a772-8165ed957a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:43.716715 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc0ead-66e1-4d80-a772-8165ed957a5d None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:43.717207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc0ead-66e1-4d80-a772-8165ed957a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:43.717685 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fc0ead-66e1-4d80-a772-8165ed957a5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:43.728956 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fc0ead-66e1-4d80-a772-8165ed957a5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:43.737117 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-a6863993-0cce-486d-826e-87579418331f None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:43.737530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-b3fc0ead-66e1-4d80-a772-8165ed957a5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:43.737530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:43.737530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:43.737530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:43.737530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:43.737530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:43.737530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:43.737530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:43.737530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:43.737530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:43.737530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:43.737530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:43.737530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:43.737530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:43.737530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:43.737530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:43.738529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:43.738529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:43.738529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:43.738529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:43.738529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:43.738529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:43.738529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:43.738529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:43.738529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:43.738529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:43.738529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:43.738529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:43.738529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:43.738529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:43.738529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:43.738529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:43.739368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:43.739368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:43.739368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:43.739368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:43.739368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:43.739368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:43.739368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:43.739368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:43.739368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:43.739368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:43.739368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:43.739368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:43.740004 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-a6863993-0cce-486d-826e-87579418331f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:43.742171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 203/398] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:43.753051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc0ead-66e1-4d80-a772-8165ed957a5d None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:43.810793 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:43.825977 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:43.883331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fc0ead-66e1-4d80-a772-8165ed957a5d None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:43.913132 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 196/399] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:43.933339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aeff39-5ddb-4f82-af9b-3cde76eb8c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:43.933944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aeff39-5ddb-4f82-af9b-3cde76eb8c1b None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:43.934238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aeff39-5ddb-4f82-af9b-3cde76eb8c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:43.934569 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aeff39-5ddb-4f82-af9b-3cde76eb8c1b None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:43.935332 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aeff39-5ddb-4f82-af9b-3cde76eb8c1b None admin] RBAC: Adding query filter params (name=member) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:43.935695 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aeff39-5ddb-4f82-af9b-3cde76eb8c1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:43.937167 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aeff39-5ddb-4f82-af9b-3cde76eb8c1b None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:43.946397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 204/400] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:43.951950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6863993-0cce-486d-826e-87579418331f None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:43.958097 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aeff39-5ddb-4f82-af9b-3cde76eb8c1b None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:44.082910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6863993-0cce-486d-826e-87579418331f None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:44.100187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aeff39-5ddb-4f82-af9b-3cde76eb8c1b None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:44.120356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666a53f-93db-4308-ad36-7e0e0f77ab9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:44.121309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666a53f-93db-4308-ad36-7e0e0f77ab9e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:44.121659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666a53f-93db-4308-ad36-7e0e0f77ab9e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:44.122002 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666a53f-93db-4308-ad36-7e0e0f77ab9e None admin] PATH_INFO: `/v3/groups/96f14487db2f4fa39a598cdabca81a49` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:44.123357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666a53f-93db-4308-ad36-7e0e0f77ab9e None admin] RBAC: Authorizing `identity:get_group(group_id=96f14487db2f4fa39a598cdabca81a49)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:44.125000 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666a53f-93db-4308-ad36-7e0e0f77ab9e None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:44.126841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:44.128319 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 197/401] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 16:40:43 2022] GET /identity/v3/groups/96f14487db2f4fa39a598cdabca81a49 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:44.129719 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be0e31-a7a2-4496-9f0a-921bfedbaed9 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:44.130194 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be0e31-a7a2-4496-9f0a-921bfedbaed9 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:44.130663 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be0e31-a7a2-4496-9f0a-921bfedbaed9 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:44.133058 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 198/402] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:44.139987 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be0e31-a7a2-4496-9f0a-921bfedbaed9 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:44.141549 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237f304-d1a5-45c0-927a-2209d6f87fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:44.142369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237f304-d1a5-45c0-927a-2209d6f87fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:44.142658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237f304-d1a5-45c0-927a-2209d6f87fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:44.142935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237f304-d1a5-45c0-927a-2209d6f87fa3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:44.153516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237f304-d1a5-45c0-927a-2209d6f87fa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:44.161564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-f237f304-d1a5-45c0-927a-2209d6f87fa3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:44.161564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:44.161564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:44.161564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:44.161564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:44.161564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:44.161564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:44.161564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:44.161564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:44.161564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:44.161564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:44.161564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:44.161564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:44.161564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:44.161564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:44.161564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:44.162457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:44.162457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:44.162457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:44.162457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:44.162457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:44.162457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:44.162457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:44.162457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:44.162457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:44.162457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:44.162457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:44.162457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:44.162457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:44.162457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:44.162457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:44.162457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:44.163255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:44.163255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:44.163255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:44.163255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:44.163255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:44.163255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:44.163255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:44.163255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:44.163255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:44.163255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:44.163255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:44.163255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:44.163255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 205/403] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:40:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:40:44.164335 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bab06-0499-4199-8008-bc04c60ef27d None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:44.164632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bab06-0499-4199-8008-bc04c60ef27d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:44.164920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bab06-0499-4199-8008-bc04c60ef27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:44.166599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:44.184413 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-3b2bab06-0499-4199-8008-bc04c60ef27d None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:44.185856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3b2bab06-0499-4199-8008-bc04c60ef27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:44.264290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 206/404] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:44.265433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bab06-0499-4199-8008-bc04c60ef27d None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:44.265868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be0e31-a7a2-4496-9f0a-921bfedbaed9 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:44.310144 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa586a-4f69-4aba-916d-b09c8848873e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:44.311638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa586a-4f69-4aba-916d-b09c8848873e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:44.312023 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa586a-4f69-4aba-916d-b09c8848873e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:44.312368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa586a-4f69-4aba-916d-b09c8848873e None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:44.313850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa586a-4f69-4aba-916d-b09c8848873e None admin] RBAC: Authorizing `identity:get_project(project_id=1d92be9a7941425d9b66dc77739c5443)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:44.316071 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa586a-4f69-4aba-916d-b09c8848873e None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:44.324534 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 199/405] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:44 2022] GET /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:44.325441 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa586a-4f69-4aba-916d-b09c8848873e None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:44.389912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bab06-0499-4199-8008-bc04c60ef27d None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:44.408214 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:44.426848 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2fc16-6c71-4bac-947d-c6d8a219f1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:44.433463 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2fc16-6c71-4bac-947d-c6d8a219f1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:44.433463 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2fc16-6c71-4bac-947d-c6d8a219f1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:44.433463 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2fc16-6c71-4bac-947d-c6d8a219f1e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:44.433463 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2fc16-6c71-4bac-947d-c6d8a219f1e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:44.433463 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2fc16-6c71-4bac-947d-c6d8a219f1e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:44.433463 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2fc16-6c71-4bac-947d-c6d8a219f1e0 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:44.439987 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 207/406] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:40:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:44.440926 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2fc16-6c71-4bac-947d-c6d8a219f1e0 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:44.455655 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:44.463576 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa586a-4f69-4aba-916d-b09c8848873e None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:44.510217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fb584-1fce-49fe-966a-39656864777b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:44.511047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fb584-1fce-49fe-966a-39656864777b None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:44.512039 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fb584-1fce-49fe-966a-39656864777b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:44.512611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fb584-1fce-49fe-966a-39656864777b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:44.528708 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fb584-1fce-49fe-966a-39656864777b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:44.539403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-e54fb584-1fce-49fe-966a-39656864777b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:40:44.539403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:44.539403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:44.539403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:44.539403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:44.539403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:44.539403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:44.539403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:44.539403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:44.539403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:44.539403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:44.539403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:44.539403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:44.539403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:44.539403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:44.539403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:44.540307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:44.540307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:44.540307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:44.540307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:44.540307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:44.540307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:44.540307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:44.540307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:44.540307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:44.540307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:44.540307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:44.540307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:44.540307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:44.540307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:44.540307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:44.540307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:44.541727 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:44.541727 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:44.541727 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:44.541727 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:44.541727 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:44.541727 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:44.541727 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:44.541727 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:44.541727 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:44.541727 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:44.541727 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:40:44.541727 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:44.541727 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 200/407] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:40:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:44.542545 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fb584-1fce-49fe-966a-39656864777b None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:44.561194 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2fc16-6c71-4bac-947d-c6d8a219f1e0 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:44.600079 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee20c6-1cad-45d3-9a83-26ab7a7e96a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:44.601545 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee20c6-1cad-45d3-9a83-26ab7a7e96a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:44.602038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee20c6-1cad-45d3-9a83-26ab7a7e96a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:44.602432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee20c6-1cad-45d3-9a83-26ab7a7e96a3 None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443/groups/96f14487db2f4fa39a598cdabca81a49/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:44.604676 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee20c6-1cad-45d3-9a83-26ab7a7e96a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=1d92be9a7941425d9b66dc77739c5443, group_id=96f14487db2f4fa39a598cdabca81a49, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:44.606219 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee20c6-1cad-45d3-9a83-26ab7a7e96a3 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:44.662196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fb584-1fce-49fe-966a-39656864777b None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:44.701634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 208/408] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Jun 22 16:40:44 2022] PUT /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443/groups/96f14487db2f4fa39a598cdabca81a49/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:40:44.702384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee20c6-1cad-45d3-9a83-26ab7a7e96a3 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:44.702983 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6151238-c568-40b5-9597-3700ba0242a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:44.704703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6151238-c568-40b5-9597-3700ba0242a6 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:44.705570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6151238-c568-40b5-9597-3700ba0242a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:44.707109 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6151238-c568-40b5-9597-3700ba0242a6 None admin] PATH_INFO: `/v3/groups/96f14487db2f4fa39a598cdabca81a49` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:44.708904 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6151238-c568-40b5-9597-3700ba0242a6 None admin] RBAC: Authorizing `identity:get_group(group_id=96f14487db2f4fa39a598cdabca81a49)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:44.710784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6151238-c568-40b5-9597-3700ba0242a6 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:44.714016 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 201/409] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 16:40:44 2022] GET /identity/v3/groups/96f14487db2f4fa39a598cdabca81a49 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:44.719770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6151238-c568-40b5-9597-3700ba0242a6 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:44.769301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:44.774199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:44.852976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee20c6-1cad-45d3-9a83-26ab7a7e96a3 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:44.862094 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6151238-c568-40b5-9597-3700ba0242a6 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:44.897299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ea928-2eb3-4353-9616-3605dfd3b733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:44.898505 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ea928-2eb3-4353-9616-3605dfd3b733 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:44.898795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ea928-2eb3-4353-9616-3605dfd3b733 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:44.899074 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ea928-2eb3-4353-9616-3605dfd3b733 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:44.899838 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ea928-2eb3-4353-9616-3605dfd3b733 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:44.900251 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ea928-2eb3-4353-9616-3605dfd3b733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:44.901565 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ea928-2eb3-4353-9616-3605dfd3b733 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:44.901669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4439f-dc66-41de-b0e0-eec6b8318e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:44.902537 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4439f-dc66-41de-b0e0-eec6b8318e3f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:44.902820 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4439f-dc66-41de-b0e0-eec6b8318e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:44.903095 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4439f-dc66-41de-b0e0-eec6b8318e3f None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:44.904316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4439f-dc66-41de-b0e0-eec6b8318e3f None admin] RBAC: Authorizing `identity:get_project(project_id=1d92be9a7941425d9b66dc77739c5443)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:44.905739 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4439f-dc66-41de-b0e0-eec6b8318e3f None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:44.907728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 202/410] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:44 2022] GET /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:44.908940 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34428a-4e34-475c-a8bf-3a6631b72a74 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:44.909221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34428a-4e34-475c-a8bf-3a6631b72a74 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:44.909495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34428a-4e34-475c-a8bf-3a6631b72a74 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:44.910299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 209/411] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:44.910719 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 203/412] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:44.916405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ea928-2eb3-4353-9616-3605dfd3b733 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:44.916926 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a43d69-fcc3-4365-8d1a-93d8234ff398 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:44.917215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a43d69-fcc3-4365-8d1a-93d8234ff398 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:44.917495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a43d69-fcc3-4365-8d1a-93d8234ff398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:44.936897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-e3a43d69-fcc3-4365-8d1a-93d8234ff398 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:44.938785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e3a43d69-fcc3-4365-8d1a-93d8234ff398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:45.016757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 204/413] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:45.017468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a43d69-fcc3-4365-8d1a-93d8234ff398 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:45.059275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:45.065886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ea928-2eb3-4353-9616-3605dfd3b733 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:45.071127 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:45.111949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab51c52-2110-45be-95ed-4e201a4bd891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:45.112868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab51c52-2110-45be-95ed-4e201a4bd891 None admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:45.113159 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab51c52-2110-45be-95ed-4e201a4bd891 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:45.113471 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab51c52-2110-45be-95ed-4e201a4bd891 None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443/groups/96f14487db2f4fa39a598cdabca81a49/roles/885a05785a714822b2012deb56880a73` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:45.116955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab51c52-2110-45be-95ed-4e201a4bd891 None admin] RBAC: Authorizing `identity:create_grant(project_id=1d92be9a7941425d9b66dc77739c5443, group_id=96f14487db2f4fa39a598cdabca81a49, role_id=885a05785a714822b2012deb56880a73)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:45.119216 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab51c52-2110-45be-95ed-4e201a4bd891 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:45.140882 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a43d69-fcc3-4365-8d1a-93d8234ff398 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:45.176590 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 210/414] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Jun 22 16:40:44 2022] PUT /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443/groups/96f14487db2f4fa39a598cdabca81a49/roles/885a05785a714822b2012deb56880a73 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:40:45.179793 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab51c52-2110-45be-95ed-4e201a4bd891 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:45.180506 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b0c47-12c5-4287-a5f3-4c6371a0c8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:45.181505 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b0c47-12c5-4287-a5f3-4c6371a0c8fc None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:45.181853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b0c47-12c5-4287-a5f3-4c6371a0c8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:45.182268 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b0c47-12c5-4287-a5f3-4c6371a0c8fc None admin] PATH_INFO: `/v3/groups/6c70e009332c48cbba2a034a41d03c23` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:45.183789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b0c47-12c5-4287-a5f3-4c6371a0c8fc None admin] RBAC: Authorizing `identity:get_group(group_id=6c70e009332c48cbba2a034a41d03c23)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:45.186622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b0c47-12c5-4287-a5f3-4c6371a0c8fc None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:45.189100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 205/415] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 16:40:45 2022] GET /identity/v3/groups/6c70e009332c48cbba2a034a41d03c23 => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:45.199887 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b0c47-12c5-4287-a5f3-4c6371a0c8fc None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:45.303503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:45.315197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b0c47-12c5-4287-a5f3-4c6371a0c8fc None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:45.354965 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58f220-f7ab-4c54-add4-addbae676755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:45.356358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58f220-f7ab-4c54-add4-addbae676755 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:45.356857 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58f220-f7ab-4c54-add4-addbae676755 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:45.357359 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58f220-f7ab-4c54-add4-addbae676755 None admin] PATH_INFO: `/v3/projects/591e7cfe38c74f35852c3e0ac79addb7` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:45.358997 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58f220-f7ab-4c54-add4-addbae676755 None admin] RBAC: Authorizing `identity:get_project(project_id=591e7cfe38c74f35852c3e0ac79addb7)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:45.360662 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58f220-f7ab-4c54-add4-addbae676755 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:45.361573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab51c52-2110-45be-95ed-4e201a4bd891 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:45.363155 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 206/416] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:45 2022] GET /identity/v3/projects/591e7cfe38c74f35852c3e0ac79addb7 => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:45.382084 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58f220-f7ab-4c54-add4-addbae676755 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:45.411019 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aa394-a3a0-42e5-bb70-ae14c3d839f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:45.413617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aa394-a3a0-42e5-bb70-ae14c3d839f3 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:45.413926 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aa394-a3a0-42e5-bb70-ae14c3d839f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:45.414208 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aa394-a3a0-42e5-bb70-ae14c3d839f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:45.440685 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771aa394-a3a0-42e5-bb70-ae14c3d839f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:45.458005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-771aa394-a3a0-42e5-bb70-ae14c3d839f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:45.458005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:45.458005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:45.458005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:45.458005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:45.458005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:45.458005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:45.458005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:45.458005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:45.458005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:45.458005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:45.458005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:45.458005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:45.458005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:45.458005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:45.458005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:45.458997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:45.458997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:45.458997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:45.458997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:45.458997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:45.458997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:45.458997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:45.458997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:45.458997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:45.458997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:45.458997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:45.458997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:45.458997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:45.458997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:45.458997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:45.458997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:45.459781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:45.459781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:45.459781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:45.459781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:45.459781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:45.459781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:45.459781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:45.459781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:45.459781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:45.459781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:45.459781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:45.459781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:45.459781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 211/417] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:40:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:45.467136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aa394-a3a0-42e5-bb70-ae14c3d839f3 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:45.497258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:45.543126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58f220-f7ab-4c54-add4-addbae676755 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:45.580247 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e56b1-d2e9-4d96-a7dc-3a648a5d540d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:45.581640 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e56b1-d2e9-4d96-a7dc-3a648a5d540d None admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:45.582178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e56b1-d2e9-4d96-a7dc-3a648a5d540d None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:45.582642 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e56b1-d2e9-4d96-a7dc-3a648a5d540d None admin] PATH_INFO: `/v3/projects/591e7cfe38c74f35852c3e0ac79addb7/groups/6c70e009332c48cbba2a034a41d03c23/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:45.584361 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aa394-a3a0-42e5-bb70-ae14c3d839f3 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:45.585453 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e56b1-d2e9-4d96-a7dc-3a648a5d540d None admin] RBAC: Authorizing `identity:create_grant(project_id=591e7cfe38c74f35852c3e0ac79addb7, group_id=6c70e009332c48cbba2a034a41d03c23, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:45.587249 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e56b1-d2e9-4d96-a7dc-3a648a5d540d None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:45.620907 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62494a4c-b933-454c-9d4d-155bef7a3b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:45.621575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62494a4c-b933-454c-9d4d-155bef7a3b04 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:45.621861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62494a4c-b933-454c-9d4d-155bef7a3b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:45.622136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62494a4c-b933-454c-9d4d-155bef7a3b04 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:45.622887 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62494a4c-b933-454c-9d4d-155bef7a3b04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:45.623196 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62494a4c-b933-454c-9d4d-155bef7a3b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:45.624838 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62494a4c-b933-454c-9d4d-155bef7a3b04 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:45.633863 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 212/418] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:40:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:45.638217 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1cc8b-40b7-4436-b585-b9da18bd71b3 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:45.638217 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1cc8b-40b7-4436-b585-b9da18bd71b3 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:45.638217 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1cc8b-40b7-4436-b585-b9da18bd71b3 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:45.638217 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 213/419] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:45.641298 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1cc8b-40b7-4436-b585-b9da18bd71b3 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:45.664852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 207/420] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Jun 22 16:40:45 2022] PUT /identity/v3/projects/591e7cfe38c74f35852c3e0ac79addb7/groups/6c70e009332c48cbba2a034a41d03c23/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 16:40:45.665910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f9a07-e2e5-4d9c-9a76-fb06737474b4 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:45.666214 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f9a07-e2e5-4d9c-9a76-fb06737474b4 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:45.666470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f9a07-e2e5-4d9c-9a76-fb06737474b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:45.690142 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-473f9a07-e2e5-4d9c-9a76-fb06737474b4 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:45.696792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-473f9a07-e2e5-4d9c-9a76-fb06737474b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:45.709828 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:45.761403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:45.781621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1cc8b-40b7-4436-b585-b9da18bd71b3 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:45.791501 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 208/421] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:45.819606 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679d17a-1a96-4921-8528-0a8cff72b114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:45.820863 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679d17a-1a96-4921-8528-0a8cff72b114 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:45.821142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679d17a-1a96-4921-8528-0a8cff72b114 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:45.821445 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679d17a-1a96-4921-8528-0a8cff72b114 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:45.841742 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f9a07-e2e5-4d9c-9a76-fb06737474b4 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:45.905576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679d17a-1a96-4921-8528-0a8cff72b114 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:45.907103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679d17a-1a96-4921-8528-0a8cff72b114 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:45.991361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f9a07-e2e5-4d9c-9a76-fb06737474b4 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:46.021473 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:46.034725 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce9849-2e89-4716-b3fe-2ca61f9c7be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:46.035702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce9849-2e89-4716-b3fe-2ca61f9c7be4 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:46.036225 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce9849-2e89-4716-b3fe-2ca61f9c7be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:46.036712 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce9849-2e89-4716-b3fe-2ca61f9c7be4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:46.048403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce9849-2e89-4716-b3fe-2ca61f9c7be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:46.057307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-f8ce9849-2e89-4716-b3fe-2ca61f9c7be4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:46.057307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:46.057307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:46.057307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:46.057307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:46.057307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:46.057307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:46.057307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:46.057307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:46.057307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:46.057307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:46.057307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:46.057307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:46.057307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:46.057307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:46.057307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:46.058245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:46.058245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:46.058245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:46.058245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:46.058245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:46.058245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:46.058245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:46.058245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:46.058245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:46.058245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:46.058245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:46.058245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:46.058245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:46.058245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:46.058245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:46.058245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:46.059047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:46.059047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:46.059047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:46.059047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:46.059047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:46.059047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:46.059047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:46.059047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:46.059047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:46.059047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:46.059047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:46.059047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:46.061914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 209/422] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:46.070635 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce9849-2e89-4716-b3fe-2ca61f9c7be4 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:46.077077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 214/423] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:46.080732 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679d17a-1a96-4921-8528-0a8cff72b114 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:46.088351 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:46.245052 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679d17a-1a96-4921-8528-0a8cff72b114 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:46.248148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce9849-2e89-4716-b3fe-2ca61f9c7be4 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:46.304931 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a7db8-83ba-4083-8f40-8f975dfbffd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:46.305603 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a7db8-83ba-4083-8f40-8f975dfbffd9 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:46.305891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a7db8-83ba-4083-8f40-8f975dfbffd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:46.306176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a7db8-83ba-4083-8f40-8f975dfbffd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:46.306941 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a7db8-83ba-4083-8f40-8f975dfbffd9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:46.307252 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a7db8-83ba-4083-8f40-8f975dfbffd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:46.308676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a7db8-83ba-4083-8f40-8f975dfbffd9 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:46.310547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a5132-16d1-44de-a693-5a0a36c4bdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:46.311406 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a5132-16d1-44de-a693-5a0a36c4bdf0 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:46.311691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a5132-16d1-44de-a693-5a0a36c4bdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:46.311969 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a5132-16d1-44de-a693-5a0a36c4bdf0 None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:46.313956 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a5132-16d1-44de-a693-5a0a36c4bdf0 None admin] RBAC: Authorizing `identity:get_project(project_id=d81536229a89416692cd909ecd4bd4ec)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:46.315391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a5132-16d1-44de-a693-5a0a36c4bdf0 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:46.321029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 215/424] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:46 2022] GET /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:46.323330 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a5132-16d1-44de-a693-5a0a36c4bdf0 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:46.333026 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 210/425] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:46.334356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a7db8-83ba-4083-8f40-8f975dfbffd9 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:46.410924 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:46.473085 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a5132-16d1-44de-a693-5a0a36c4bdf0 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:46.495138 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:46.544272 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d49a04-8073-4265-b68d-b000625edcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:46.545771 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d49a04-8073-4265-b68d-b000625edcd9 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:46.546484 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d49a04-8073-4265-b68d-b000625edcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:46.547303 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d49a04-8073-4265-b68d-b000625edcd9 None admin] PATH_INFO: `/v3/groups/96f14487db2f4fa39a598cdabca81a49` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:46.552847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d49a04-8073-4265-b68d-b000625edcd9 None admin] RBAC: Authorizing `identity:get_group(group_id=96f14487db2f4fa39a598cdabca81a49)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:46.556189 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d49a04-8073-4265-b68d-b000625edcd9 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:46.561777 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 216/426] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 16:40:46 2022] GET /identity/v3/groups/96f14487db2f4fa39a598cdabca81a49 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:46.570592 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d49a04-8073-4265-b68d-b000625edcd9 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:46.585596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a7db8-83ba-4083-8f40-8f975dfbffd9 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:46.648577 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62b1e1-f37a-4a56-8444-7e1890f8a49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:46.650218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62b1e1-f37a-4a56-8444-7e1890f8a49b None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:46.650510 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62b1e1-f37a-4a56-8444-7e1890f8a49b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:46.650791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62b1e1-f37a-4a56-8444-7e1890f8a49b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:46.734981 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62b1e1-f37a-4a56-8444-7e1890f8a49b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:46.736457 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62b1e1-f37a-4a56-8444-7e1890f8a49b None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:46.770418 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d49a04-8073-4265-b68d-b000625edcd9 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:46.809232 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:46.811944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:46.841870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 211/427] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 16:40:46.847556 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62b1e1-f37a-4a56-8444-7e1890f8a49b None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:46.849812 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba967831-9ea0-4bdb-bf9c-cf2cfd6f546a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:46.850522 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba967831-9ea0-4bdb-bf9c-cf2cfd6f546a None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:46.850816 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba967831-9ea0-4bdb-bf9c-cf2cfd6f546a None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:46.851636 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba967831-9ea0-4bdb-bf9c-cf2cfd6f546a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:46.852518 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba967831-9ea0-4bdb-bf9c-cf2cfd6f546a None admin] RBAC: Adding query filter params (group.id=96f14487db2f4fa39a598cdabca81a49, role.id=885a05785a714822b2012deb56880a73, scope.project.id=d81536229a89416692cd909ecd4bd4ec) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:46.852836 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba967831-9ea0-4bdb-bf9c-cf2cfd6f546a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:46.854295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba967831-9ea0-4bdb-bf9c-cf2cfd6f546a None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:46.860725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 217/428] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jun 22 16:40:46 2022] GET /identity/v3/role_assignments?group.id=96f14487db2f4fa39a598cdabca81a49&scope.project.id=d81536229a89416692cd909ecd4bd4ec&role.id=885a05785a714822b2012deb56880a73 => generated 611 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:46.909953 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b5076-f91b-49ad-ac18-2d68e7d483ad None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:46.910423 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b5076-f91b-49ad-ac18-2d68e7d483ad None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:46.911330 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908b5076-f91b-49ad-ac18-2d68e7d483ad None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:46.913795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 218/429] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:46.920535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d151bc-0b4e-4268-bd6f-1b0f8ea99797 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:46.921017 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d151bc-0b4e-4268-bd6f-1b0f8ea99797 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:46.921435 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d151bc-0b4e-4268-bd6f-1b0f8ea99797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:46.974083 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-f4d151bc-0b4e-4268-bd6f-1b0f8ea99797 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:46.975530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f4d151bc-0b4e-4268-bd6f-1b0f8ea99797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:46.977794 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62b1e1-f37a-4a56-8444-7e1890f8a49b None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:47.015984 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1cc4c-d5de-4cce-bfb2-4122f646c357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:47.017141 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1cc4c-d5de-4cce-bfb2-4122f646c357 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:47.017568 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1cc4c-d5de-4cce-bfb2-4122f646c357 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:47.018003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1cc4c-d5de-4cce-bfb2-4122f646c357 None admin] PATH_INFO: `/v3/projects/d81536229a89416692cd909ecd4bd4ec` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:47.019400 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1cc4c-d5de-4cce-bfb2-4122f646c357 None admin] RBAC: Authorizing `identity:get_project(project_id=d81536229a89416692cd909ecd4bd4ec)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:47.021190 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1cc4c-d5de-4cce-bfb2-4122f646c357 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:47.024255 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 212/430] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:46 2022] GET /identity/v3/projects/d81536229a89416692cd909ecd4bd4ec => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:47.029281 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1cc4c-d5de-4cce-bfb2-4122f646c357 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:47.074649 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:47.112128 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 219/431] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:47.138025 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d151bc-0b4e-4268-bd6f-1b0f8ea99797 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:47.138643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1cc4c-d5de-4cce-bfb2-4122f646c357 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:47.175673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12719094-9720-4ff4-9d76-4296a39ec065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:47.176929 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12719094-9720-4ff4-9d76-4296a39ec065 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:47.177412 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12719094-9720-4ff4-9d76-4296a39ec065 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:47.177880 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12719094-9720-4ff4-9d76-4296a39ec065 None admin] PATH_INFO: `/v3/groups/96f14487db2f4fa39a598cdabca81a49` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:47.179822 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12719094-9720-4ff4-9d76-4296a39ec065 None admin] RBAC: Authorizing `identity:get_group(group_id=96f14487db2f4fa39a598cdabca81a49)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:47.181524 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12719094-9720-4ff4-9d76-4296a39ec065 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:47.183733 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 213/432] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 16:40:47 2022] GET /identity/v3/groups/96f14487db2f4fa39a598cdabca81a49 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:47.190025 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12719094-9720-4ff4-9d76-4296a39ec065 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:47.247477 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d151bc-0b4e-4268-bd6f-1b0f8ea99797 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:47.265319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:47.286654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc16ef9-1727-4c63-88c9-9bbeb43a57bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:47.287452 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc16ef9-1727-4c63-88c9-9bbeb43a57bd None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:47.287647 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc16ef9-1727-4c63-88c9-9bbeb43a57bd None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:47.287924 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc16ef9-1727-4c63-88c9-9bbeb43a57bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:47.298983 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12719094-9720-4ff4-9d76-4296a39ec065 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:47.299293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc16ef9-1727-4c63-88c9-9bbeb43a57bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:47.307618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:47.309351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-edc16ef9-1727-4c63-88c9-9bbeb43a57bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:47.309351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:47.309351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:47.309351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:47.309351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:47.309351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:47.309351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:47.309351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:47.309351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:47.309351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:47.309351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:47.309351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:47.309351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:47.309351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:47.309351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:47.309351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:47.310239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:47.310239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:47.310239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:47.310239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:47.310239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:47.310239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:47.310239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:47.310239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:47.310239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:47.310239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:47.310239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:47.310239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:47.310239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:47.310239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:47.310239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:47.310239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:47.311103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:47.311103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:47.311103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:47.311103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:47.311103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:47.311103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:47.311103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:47.311103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:47.311103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:47.311103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:47.311103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 22 16:40:47.311103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:47.313879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 220/433] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:40:47.320315 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc16ef9-1727-4c63-88c9-9bbeb43a57bd None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:47.337461 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57cbb0-3539-41d1-b703-d947da8e2792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:47.338198 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57cbb0-3539-41d1-b703-d947da8e2792 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:47.338555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57cbb0-3539-41d1-b703-d947da8e2792 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:47.339062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57cbb0-3539-41d1-b703-d947da8e2792 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:47.340311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57cbb0-3539-41d1-b703-d947da8e2792 None admin] RBAC: Adding query filter params (group.id=96f14487db2f4fa39a598cdabca81a49, role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2, scope.project.id=d81536229a89416692cd909ecd4bd4ec) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:47.340716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57cbb0-3539-41d1-b703-d947da8e2792 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:47.342244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57cbb0-3539-41d1-b703-d947da8e2792 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:47.350668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 214/434] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jun 22 16:40:47 2022] GET /identity/v3/role_assignments?group.id=96f14487db2f4fa39a598cdabca81a49&scope.project.id=d81536229a89416692cd909ecd4bd4ec&role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:47.441594 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc16ef9-1727-4c63-88c9-9bbeb43a57bd None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:47.479446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe8096-9b04-4d35-a24c-85f0b5de5185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:47.480516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe8096-9b04-4d35-a24c-85f0b5de5185 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:47.480949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe8096-9b04-4d35-a24c-85f0b5de5185 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:47.481373 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe8096-9b04-4d35-a24c-85f0b5de5185 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:47.482302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe8096-9b04-4d35-a24c-85f0b5de5185 None admin] RBAC: Adding query filter params (name=member) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:47.482778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe8096-9b04-4d35-a24c-85f0b5de5185 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:47.484362 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe8096-9b04-4d35-a24c-85f0b5de5185 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:47.499337 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 221/435] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:40:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:47.505235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57cbb0-3539-41d1-b703-d947da8e2792 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:47.620238 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57cbb0-3539-41d1-b703-d947da8e2792 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:47.655939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aee454-4a63-42a6-a121-811910935f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:47.656623 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aee454-4a63-42a6-a121-811910935f84 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:47.656909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aee454-4a63-42a6-a121-811910935f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:47.657184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aee454-4a63-42a6-a121-811910935f84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:47.697966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd5af0-fedc-4231-a4d5-3465cb651838 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:47.698290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd5af0-fedc-4231-a4d5-3465cb651838 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:47.698536 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd5af0-fedc-4231-a4d5-3465cb651838 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:47.699788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:47.700649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 222/436] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:40:47.714569 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404e296-41fb-43b9-86d3-2721da27730d None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:47.715462 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404e296-41fb-43b9-86d3-2721da27730d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:47.715757 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404e296-41fb-43b9-86d3-2721da27730d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:47.733184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aee454-4a63-42a6-a121-811910935f84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:47.734644 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aee454-4a63-42a6-a121-811910935f84 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:47.739192 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-e404e296-41fb-43b9-86d3-2721da27730d None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:47.740630 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e404e296-41fb-43b9-86d3-2721da27730d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:47.781933 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:47.838859 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 223/437] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:47.864127 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404e296-41fb-43b9-86d3-2721da27730d None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:47.869688 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 215/438] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:47.880223 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aee454-4a63-42a6-a121-811910935f84 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:47.956770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:47.989279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404e296-41fb-43b9-86d3-2721da27730d None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:48.003539 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aee454-4a63-42a6-a121-811910935f84 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:48.033906 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a880d-2236-42a9-84d8-fc6dc01afc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:48.034723 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a880d-2236-42a9-84d8-fc6dc01afc23 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:48.036650 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a880d-2236-42a9-84d8-fc6dc01afc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:48.036650 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a880d-2236-42a9-84d8-fc6dc01afc23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:48.052278 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a7a18-852e-4b11-87e5-fe1d17fd9588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:48.053170 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a7a18-852e-4b11-87e5-fe1d17fd9588 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:48.053450 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a7a18-852e-4b11-87e5-fe1d17fd9588 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:48.053721 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a7a18-852e-4b11-87e5-fe1d17fd9588 None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:48.055067 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a7a18-852e-4b11-87e5-fe1d17fd9588 None admin] RBAC: Authorizing `identity:get_project(project_id=1d92be9a7941425d9b66dc77739c5443)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:48.056549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a7a18-852e-4b11-87e5-fe1d17fd9588 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:48.057281 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a880d-2236-42a9-84d8-fc6dc01afc23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:48.058434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 216/439] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:47 2022] GET /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:48.063602 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a7a18-852e-4b11-87e5-fe1d17fd9588 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:48.065384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-7d4a880d-2236-42a9-84d8-fc6dc01afc23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:48.065384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:48.065384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:48.065384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:48.065384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:48.065384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:48.065384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:48.065384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:48.065384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:48.065384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:48.065384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:48.065384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:48.065384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:48.065384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:48.065384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:48.065384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:48.066249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:48.066249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:48.066249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:48.066249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:48.066249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:48.066249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:48.066249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:48.066249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:48.066249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:48.066249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:48.066249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:48.066249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:48.066249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:48.066249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:48.066249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:48.066249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:48.067044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:48.067044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:48.067044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:48.067044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:48.067044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:48.067044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:48.067044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:48.067044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:48.067044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:48.067044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:48.067044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:48.067044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:48.068249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 224/440] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:40:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:48.072242 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a880d-2236-42a9-84d8-fc6dc01afc23 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:48.102034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:48.170579 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a7a18-852e-4b11-87e5-fe1d17fd9588 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:48.182079 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a880d-2236-42a9-84d8-fc6dc01afc23 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:48.202888 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a392fd-3c35-45cd-b695-0ed9b43cdcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:48.203731 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a392fd-3c35-45cd-b695-0ed9b43cdcf3 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:48.204011 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a392fd-3c35-45cd-b695-0ed9b43cdcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:48.204322 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a392fd-3c35-45cd-b695-0ed9b43cdcf3 None admin] PATH_INFO: `/v3/groups/96f14487db2f4fa39a598cdabca81a49` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:48.205482 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a392fd-3c35-45cd-b695-0ed9b43cdcf3 None admin] RBAC: Authorizing `identity:get_group(group_id=96f14487db2f4fa39a598cdabca81a49)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:48.206909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a392fd-3c35-45cd-b695-0ed9b43cdcf3 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:48.208546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 217/441] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 16:40:48 2022] GET /identity/v3/groups/96f14487db2f4fa39a598cdabca81a49 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:48.209672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f4b44-75d5-4a79-a870-3a8b43d2f856 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:48.209952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f4b44-75d5-4a79-a870-3a8b43d2f856 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:48.210228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f4b44-75d5-4a79-a870-3a8b43d2f856 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:48.212039 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 218/442] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:48.216624 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f4b44-75d5-4a79-a870-3a8b43d2f856 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:48.219394 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc712b7-49f4-4913-9680-13a55e5393aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:48.220057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc712b7-49f4-4913-9680-13a55e5393aa None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:48.220372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc712b7-49f4-4913-9680-13a55e5393aa None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:48.220648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc712b7-49f4-4913-9680-13a55e5393aa None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:48.221401 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc712b7-49f4-4913-9680-13a55e5393aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:48.221710 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc712b7-49f4-4913-9680-13a55e5393aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:48.223082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc712b7-49f4-4913-9680-13a55e5393aa None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:48.224794 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:48.231530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 225/443] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:40:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:48.237160 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb313fe5-3f11-4ea2-85f9-991728364e14 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:48.237458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb313fe5-3f11-4ea2-85f9-991728364e14 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:48.237744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb313fe5-3f11-4ea2-85f9-991728364e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:48.253587 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-fb313fe5-3f11-4ea2-85f9-991728364e14 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:48.254770 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-fb313fe5-3f11-4ea2-85f9-991728364e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:48.315594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f4b44-75d5-4a79-a870-3a8b43d2f856 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:48.317989 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 226/444] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:48.318626 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb313fe5-3f11-4ea2-85f9-991728364e14 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:48.337931 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:48.351050 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75281213-7e52-4f96-a19d-90b624e78d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:48.351737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75281213-7e52-4f96-a19d-90b624e78d52 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:48.352017 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75281213-7e52-4f96-a19d-90b624e78d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:48.352321 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75281213-7e52-4f96-a19d-90b624e78d52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:48.353160 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75281213-7e52-4f96-a19d-90b624e78d52 None admin] RBAC: Adding query filter params (group.id=96f14487db2f4fa39a598cdabca81a49, role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2, scope.project.id=1d92be9a7941425d9b66dc77739c5443) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:48.353469 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75281213-7e52-4f96-a19d-90b624e78d52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:48.354951 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75281213-7e52-4f96-a19d-90b624e78d52 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:48.360759 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 219/445] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jun 22 16:40:48 2022] GET /identity/v3/role_assignments?group.id=96f14487db2f4fa39a598cdabca81a49&scope.project.id=1d92be9a7941425d9b66dc77739c5443&role.id=86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:48.361525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75281213-7e52-4f96-a19d-90b624e78d52 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:48.425648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb313fe5-3f11-4ea2-85f9-991728364e14 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:48.451292 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:48.465693 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bd514-cff1-4e3e-a501-e83b698a52b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:48.466350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bd514-cff1-4e3e-a501-e83b698a52b6 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:48.466636 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bd514-cff1-4e3e-a501-e83b698a52b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:48.466914 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bd514-cff1-4e3e-a501-e83b698a52b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:48.484616 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75281213-7e52-4f96-a19d-90b624e78d52 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:48.527902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fb41c-bfa7-4881-ab5b-67d6835588f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:48.527902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fb41c-bfa7-4881-ab5b-67d6835588f6 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:48.527902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fb41c-bfa7-4881-ab5b-67d6835588f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:48.527902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fb41c-bfa7-4881-ab5b-67d6835588f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:48.540920 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fb41c-bfa7-4881-ab5b-67d6835588f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:48.549814 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bd514-cff1-4e3e-a501-e83b698a52b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:48.549956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-2a8fb41c-bfa7-4881-ab5b-67d6835588f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:40:48.549956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:48.549956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:48.549956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:48.549956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:48.549956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:48.549956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:48.549956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:48.549956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:48.549956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:48.549956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:48.549956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:48.549956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:48.549956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:48.549956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:48.549956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:48.550833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:48.550833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:48.550833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:48.550833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:48.550833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:48.550833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:48.550833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:48.550833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:48.550833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:48.550833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:48.550833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:48.550833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:48.550833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:48.550833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:48.550833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:48.550833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:48.551641 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:48.551641 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:48.551641 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:48.551641 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:48.551641 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:48.551641 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:48.551641 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:48.551641 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:48.551641 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:48.551641 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:48.551641 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:40:48.551641 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:48.552300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bd514-cff1-4e3e-a501-e83b698a52b6 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:48.552383 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 220/446] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:40:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:48.557104 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fb41c-bfa7-4881-ab5b-67d6835588f6 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:48.570591 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:48.668216 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 227/447] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:48.673929 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bd514-cff1-4e3e-a501-e83b698a52b6 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:48.687969 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fb41c-bfa7-4881-ab5b-67d6835588f6 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:48.723302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:48.731013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745e67a-c6bb-4984-a5cd-0c86e5d17487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:48.731677 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745e67a-c6bb-4984-a5cd-0c86e5d17487 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:48.731964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745e67a-c6bb-4984-a5cd-0c86e5d17487 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:48.736116 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745e67a-c6bb-4984-a5cd-0c86e5d17487 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:48.736116 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745e67a-c6bb-4984-a5cd-0c86e5d17487 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:48.736116 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745e67a-c6bb-4984-a5cd-0c86e5d17487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:48.736116 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745e67a-c6bb-4984-a5cd-0c86e5d17487 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:48.744773 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 221/448] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:48.750570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745e67a-c6bb-4984-a5cd-0c86e5d17487 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:48.783111 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bd514-cff1-4e3e-a501-e83b698a52b6 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:48.800077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:48.816434 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e0056-6f8d-4db1-9c06-400795a10556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:48.817286 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e0056-6f8d-4db1-9c06-400795a10556 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:48.817661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e0056-6f8d-4db1-9c06-400795a10556 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:48.817940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e0056-6f8d-4db1-9c06-400795a10556 None admin] PATH_INFO: `/v3/projects/1d92be9a7941425d9b66dc77739c5443` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:48.819138 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e0056-6f8d-4db1-9c06-400795a10556 None admin] RBAC: Authorizing `identity:get_project(project_id=1d92be9a7941425d9b66dc77739c5443)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:48.820659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e0056-6f8d-4db1-9c06-400795a10556 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:48.822349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 228/449] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:48 2022] GET /identity/v3/projects/1d92be9a7941425d9b66dc77739c5443 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:48.827750 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e0056-6f8d-4db1-9c06-400795a10556 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:48.848834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745e67a-c6bb-4984-a5cd-0c86e5d17487 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:48.881167 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fbc4b-afb5-43f3-b251-b48ff7b40ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:48.881797 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fbc4b-afb5-43f3-b251-b48ff7b40ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:48.882103 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fbc4b-afb5-43f3-b251-b48ff7b40ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:48.882374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fbc4b-afb5-43f3-b251-b48ff7b40ed2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:48.924621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e0056-6f8d-4db1-9c06-400795a10556 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:48.941091 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:48.950642 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fbc4b-afb5-43f3-b251-b48ff7b40ed2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:48.952076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fbc4b-afb5-43f3-b251-b48ff7b40ed2 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:48.957686 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4c17c-8c6a-4109-9f3e-420336c49d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:48.958516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4c17c-8c6a-4109-9f3e-420336c49d75 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:48.958800 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4c17c-8c6a-4109-9f3e-420336c49d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:48.959074 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4c17c-8c6a-4109-9f3e-420336c49d75 None admin] PATH_INFO: `/v3/groups/96f14487db2f4fa39a598cdabca81a49` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:48.960866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4c17c-8c6a-4109-9f3e-420336c49d75 None admin] RBAC: Authorizing `identity:get_group(group_id=96f14487db2f4fa39a598cdabca81a49)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:48.962302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4c17c-8c6a-4109-9f3e-420336c49d75 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:48.963916 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 229/450] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 16:40:48 2022] GET /identity/v3/groups/96f14487db2f4fa39a598cdabca81a49 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:48.969554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4c17c-8c6a-4109-9f3e-420336c49d75 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:49.023839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:49.048714 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 222/451] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 22 16:40:49.054118 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fbc4b-afb5-43f3-b251-b48ff7b40ed2 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:49.066642 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4c17c-8c6a-4109-9f3e-420336c49d75 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:49.099914 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484c022-99e8-4163-8b66-24a86170b779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:49.100587 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484c022-99e8-4163-8b66-24a86170b779 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:49.100864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484c022-99e8-4163-8b66-24a86170b779 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:49.101144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484c022-99e8-4163-8b66-24a86170b779 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:49.101975 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484c022-99e8-4163-8b66-24a86170b779 None admin] RBAC: Adding query filter params (group.id=96f14487db2f4fa39a598cdabca81a49, role.id=885a05785a714822b2012deb56880a73, scope.project.id=1d92be9a7941425d9b66dc77739c5443) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:49.102287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484c022-99e8-4163-8b66-24a86170b779 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:49.103704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484c022-99e8-4163-8b66-24a86170b779 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:49.109724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 230/452] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jun 22 16:40:48 2022] GET /identity/v3/role_assignments?group.id=96f14487db2f4fa39a598cdabca81a49&scope.project.id=1d92be9a7941425d9b66dc77739c5443&role.id=885a05785a714822b2012deb56880a73 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:49.146958 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:49.156080 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fbc4b-afb5-43f3-b251-b48ff7b40ed2 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:49.192622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce633f-413f-46e1-be45-08bb3b4eeb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:49.193399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce633f-413f-46e1-be45-08bb3b4eeb29 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:49.193682 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce633f-413f-46e1-be45-08bb3b4eeb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:49.193960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce633f-413f-46e1-be45-08bb3b4eeb29 None admin] PATH_INFO: `/v3/projects/591e7cfe38c74f35852c3e0ac79addb7` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:49.195706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce633f-413f-46e1-be45-08bb3b4eeb29 None admin] RBAC: Authorizing `identity:get_project(project_id=591e7cfe38c74f35852c3e0ac79addb7)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:49.197207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce633f-413f-46e1-be45-08bb3b4eeb29 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:49.198936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 223/453] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:40:49 2022] GET /identity/v3/projects/591e7cfe38c74f35852c3e0ac79addb7 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:49.204760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484c022-99e8-4163-8b66-24a86170b779 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:49.307780 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484c022-99e8-4163-8b66-24a86170b779 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:49.326464 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:49.342893 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e75b11-0749-4a6b-8677-d032afc85e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:49.343800 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e75b11-0749-4a6b-8677-d032afc85e33 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:49.344087 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e75b11-0749-4a6b-8677-d032afc85e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:49.344395 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e75b11-0749-4a6b-8677-d032afc85e33 None admin] PATH_INFO: `/v3/groups/6c70e009332c48cbba2a034a41d03c23` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:49.345566 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e75b11-0749-4a6b-8677-d032afc85e33 None admin] RBAC: Authorizing `identity:get_group(group_id=6c70e009332c48cbba2a034a41d03c23)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:49.347098 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e75b11-0749-4a6b-8677-d032afc85e33 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:49.348797 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 231/454] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jun 22 16:40:49 2022] GET /identity/v3/groups/6c70e009332c48cbba2a034a41d03c23 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:49.354617 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce633f-413f-46e1-be45-08bb3b4eeb29 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:49.455432 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce633f-413f-46e1-be45-08bb3b4eeb29 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:49.487743 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bc615-07d2-47b3-9554-1629394734cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:49.488425 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bc615-07d2-47b3-9554-1629394734cc None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:49.488715 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bc615-07d2-47b3-9554-1629394734cc None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:49.488994 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bc615-07d2-47b3-9554-1629394734cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:49.489827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4bc615-07d2-47b3-9554-1629394734cc None admin] RBAC: Adding query filter params (group.id=6c70e009332c48cbba2a034a41d03c23, role.id=459b0e5c21c94fb1b81f76c65780fdb5, scope.project.id=591e7cfe38c74f35852c3e0ac79addb7) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:49.490143 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4bc615-07d2-47b3-9554-1629394734cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:49.492094 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4bc615-07d2-47b3-9554-1629394734cc None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:49.497784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 224/455] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jun 22 16:40:49 2022] GET /identity/v3/role_assignments?group.id=6c70e009332c48cbba2a034a41d03c23&scope.project.id=591e7cfe38c74f35852c3e0ac79addb7&role.id=459b0e5c21c94fb1b81f76c65780fdb5 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:51.844448 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee19ef-ada2-419e-8577-c9d93bfd948e None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:51.845459 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee19ef-ada2-419e-8577-c9d93bfd948e None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:51.845946 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee19ef-ada2-419e-8577-c9d93bfd948e None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:51.847892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 232/456] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:51.853488 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56020a51-c041-4464-aa6f-f8c785354e00 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:51.854271 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56020a51-c041-4464-aa6f-f8c785354e00 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:51.854705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56020a51-c041-4464-aa6f-f8c785354e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:51.877121 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-56020a51-c041-4464-aa6f-f8c785354e00 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:51.878681 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-56020a51-c041-4464-aa6f-f8c785354e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:51.899335 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:51.971746 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 225/457] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:52.009115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee19ef-ada2-419e-8577-c9d93bfd948e None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:52.112778 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4c3e3-1437-4057-ab4b-6f92becb92bb None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:52.113496 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4c3e3-1437-4057-ab4b-6f92becb92bb None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:52.114289 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4c3e3-1437-4057-ab4b-6f92becb92bb None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:52.116154 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 226/458] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:52.121329 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28d5e3-867a-4564-92bb-4df915dec16a None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:52.121891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28d5e3-867a-4564-92bb-4df915dec16a None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:52.122400 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28d5e3-867a-4564-92bb-4df915dec16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:52.140616 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-bd28d5e3-867a-4564-92bb-4df915dec16a None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:52.142102 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-bd28d5e3-867a-4564-92bb-4df915dec16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:52.146018 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee19ef-ada2-419e-8577-c9d93bfd948e None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:52.215717 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2205f9-981c-4268-8661-f9cf6f2ba8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:52.216921 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2205f9-981c-4268-8661-f9cf6f2ba8bc None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:52.217426 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2205f9-981c-4268-8661-f9cf6f2ba8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:52.217896 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2205f9-981c-4268-8661-f9cf6f2ba8bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:52.242164 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2205f9-981c-4268-8661-f9cf6f2ba8bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:52.243620 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2205f9-981c-4268-8661-f9cf6f2ba8bc None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:52.256209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 227/459] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:40:52.263541 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb8511-483d-4515-988f-480900ff3c0e None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:52.264085 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb8511-483d-4515-988f-480900ff3c0e None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:52.264584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb8511-483d-4515-988f-480900ff3c0e None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:52.267062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 228/460] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:52.270810 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde088f7-a103-4efe-8ae4-8ac63585cd49 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:52.271307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde088f7-a103-4efe-8ae4-8ac63585cd49 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:52.271800 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde088f7-a103-4efe-8ae4-8ac63585cd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:52.272402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-3d2205f9-981c-4268-8661-f9cf6f2ba8bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:52.272402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:52.272402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:52.272402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:52.272402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:52.272402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:52.272402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:52.272402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:52.272402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:52.272402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:52.272402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:52.272402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:52.272402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:40:52.272402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:40:52.272402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:40:52.274020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:40:52.274020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:52.274020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:52.274020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:52.274020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:52.274020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:52.274020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:52.274020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:52.274020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:52.274020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:52.274020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:52.274020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:52.274020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:52.274020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:52.274020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:52.274020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:52.274020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:52.275064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:40:52.275064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:40:52.275064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:52.275064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:52.277002 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 233/461] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:52.282221 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2205f9-981c-4268-8661-f9cf6f2ba8bc None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:52.298550 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-dde088f7-a103-4efe-8ae4-8ac63585cd49 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:52.299846 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-dde088f7-a103-4efe-8ae4-8ac63585cd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:52.332449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:52.390471 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 229/462] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:40:52.391597 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde088f7-a103-4efe-8ae4-8ac63585cd49 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:52.401869 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2205f9-981c-4268-8661-f9cf6f2ba8bc None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:52.407893 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:52.455624 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c650e09-8308-4d08-85b1-7b131a07c1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:52.456665 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c650e09-8308-4d08-85b1-7b131a07c1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:52.457131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c650e09-8308-4d08-85b1-7b131a07c1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:52.457588 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c650e09-8308-4d08-85b1-7b131a07c1b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:52.458483 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c650e09-8308-4d08-85b1-7b131a07c1b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:52.458990 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c650e09-8308-4d08-85b1-7b131a07c1b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:52.460660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c650e09-8308-4d08-85b1-7b131a07c1b8 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:52.483639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 234/463] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:52.484976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c650e09-8308-4d08-85b1-7b131a07c1b8 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:52.516247 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde088f7-a103-4efe-8ae4-8ac63585cd49 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:52.566268 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a6855-bd93-42cc-a3b6-82e0ab9010e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:52.567384 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a6855-bd93-42cc-a3b6-82e0ab9010e2 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:52.567807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a6855-bd93-42cc-a3b6-82e0ab9010e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:52.568652 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a6855-bd93-42cc-a3b6-82e0ab9010e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:52.583881 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a6855-bd93-42cc-a3b6-82e0ab9010e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:52.586502 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a6855-bd93-42cc-a3b6-82e0ab9010e2 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:52.589185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:52.593666 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c650e09-8308-4d08-85b1-7b131a07c1b8 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:52.609784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-119a6855-bd93-42cc-a3b6-82e0ab9010e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:52.609784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:52.609784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:52.609784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:52.609784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:52.609784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:52.609784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:52.609784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:52.609784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:52.609784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:52.609784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:52.609784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:52.609784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:40:52.609784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:40:52.609784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:40:52.610850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:40:52.610850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:52.610850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:52.610850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:52.610850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:52.610850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:52.610850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:52.610850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:52.610850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:52.610850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:52.610850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:52.610850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:52.610850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:52.610850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:52.610850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:52.610850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:52.610850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:52.612258 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:40:52.612258 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:40:52.612258 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:52.612258 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:52.614319 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 230/464] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:52.615542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a6855-bd93-42cc-a3b6-82e0ab9010e2 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:52.642255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9302922-bcec-4f3e-bc61-e8c9f05db405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:52.643119 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9302922-bcec-4f3e-bc61-e8c9f05db405 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:52.643507 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9302922-bcec-4f3e-bc61-e8c9f05db405 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:52.643884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9302922-bcec-4f3e-bc61-e8c9f05db405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:52.658212 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9302922-bcec-4f3e-bc61-e8c9f05db405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:52.659883 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9302922-bcec-4f3e-bc61-e8c9f05db405 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:52.681391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-c9302922-bcec-4f3e-bc61-e8c9f05db405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:52.681391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:52.681391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:52.681391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:52.681391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:52.681391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:52.681391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:52.681391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:52.681391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:52.681391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:52.681391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:52.681391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:52.681391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:40:52.681391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:40:52.681391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:40:52.682302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:40:52.682302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:52.682302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:52.682302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:52.682302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:52.682302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:52.682302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:52.682302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:52.682302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:52.682302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:52.682302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:52.682302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:52.682302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:52.682302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:52.682302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:52.682302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:52.682302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:52.683141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:40:52.683141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:40:52.683141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:52.683141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:52.685459 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 235/465] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:52.686554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9302922-bcec-4f3e-bc61-e8c9f05db405 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:52.698841 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:52.740226 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a6855-bd93-42cc-a3b6-82e0ab9010e2 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:52.776512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6ea29-58c8-4c3e-ab9f-66bb6b5fa85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:52.777239 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6ea29-58c8-4c3e-ab9f-66bb6b5fa85d None admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:52.777567 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6ea29-58c8-4c3e-ab9f-66bb6b5fa85d None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:52.777842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6ea29-58c8-4c3e-ab9f-66bb6b5fa85d None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:52.778541 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6ea29-58c8-4c3e-ab9f-66bb6b5fa85d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:52.780261 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6ea29-58c8-4c3e-ab9f-66bb6b5fa85d None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:52.788767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9302922-bcec-4f3e-bc61-e8c9f05db405 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:52.821254 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0e2b7-67c8-4530-a103-227ac0b42278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:52.821902 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0e2b7-67c8-4530-a103-227ac0b42278 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:52.822183 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0e2b7-67c8-4530-a103-227ac0b42278 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:52.822458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0e2b7-67c8-4530-a103-227ac0b42278 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:52.823175 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0e2b7-67c8-4530-a103-227ac0b42278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:52.823476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0e2b7-67c8-4530-a103-227ac0b42278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:52.824860 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0e2b7-67c8-4530-a103-227ac0b42278 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:52.835597 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 236/466] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:52.836388 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0e2b7-67c8-4530-a103-227ac0b42278 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:52.849571 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:52.889820 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 231/467] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 16:40:52 2022] POST /identity/v3/users => generated 246 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:40:52.892647 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6bf64-15a2-479e-b35a-0cdb01218322 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:52.893210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6bf64-15a2-479e-b35a-0cdb01218322 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:52.893866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6bf64-15a2-479e-b35a-0cdb01218322 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:52.900675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 232/468] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:52.902494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6bf64-15a2-479e-b35a-0cdb01218322 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:52.959075 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0e2b7-67c8-4530-a103-227ac0b42278 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:53.012813 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f900f53-1bb5-4b33-970d-b5b8384d3570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:53.014130 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f900f53-1bb5-4b33-970d-b5b8384d3570 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:53.014622 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f900f53-1bb5-4b33-970d-b5b8384d3570 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:53.015380 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f900f53-1bb5-4b33-970d-b5b8384d3570 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:53.016978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f900f53-1bb5-4b33-970d-b5b8384d3570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:53.017811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f900f53-1bb5-4b33-970d-b5b8384d3570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:53.019464 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f900f53-1bb5-4b33-970d-b5b8384d3570 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:53.041898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 237/469] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:53.041898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692d2c1-8a85-4f99-b37e-9f01b2de754b None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:53.041898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692d2c1-8a85-4f99-b37e-9f01b2de754b None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:53.041898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692d2c1-8a85-4f99-b37e-9f01b2de754b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:53.050185 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6bf64-15a2-479e-b35a-0cdb01218322 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:53.061560 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-a692d2c1-8a85-4f99-b37e-9f01b2de754b None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:53.063043 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-a692d2c1-8a85-4f99-b37e-9f01b2de754b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:53.077092 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:53.095305 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe3427-d208-4ac6-88a5-8fbe780e2ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:53.095982 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe3427-d208-4ac6-88a5-8fbe780e2ebd None admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:53.096297 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe3427-d208-4ac6-88a5-8fbe780e2ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:53.096578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe3427-d208-4ac6-88a5-8fbe780e2ebd None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:53.097290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe3427-d208-4ac6-88a5-8fbe780e2ebd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:53.098836 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe3427-d208-4ac6-88a5-8fbe780e2ebd None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:53.141030 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:53.147225 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 238/470] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:53.148591 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692d2c1-8a85-4f99-b37e-9f01b2de754b None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:53.190427 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 233/471] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 16:40:52 2022] POST /identity/v3/users => generated 248 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:40:53.192127 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe3427-d208-4ac6-88a5-8fbe780e2ebd None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:53.347341 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692d2c1-8a85-4f99-b37e-9f01b2de754b None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:53.395666 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7847e9-4e90-4827-b67b-a1dfa96ea012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:53.396652 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7847e9-4e90-4827-b67b-a1dfa96ea012 None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:53.396938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7847e9-4e90-4827-b67b-a1dfa96ea012 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:53.397222 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7847e9-4e90-4827-b67b-a1dfa96ea012 None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:53.398804 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7847e9-4e90-4827-b67b-a1dfa96ea012 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:53.400930 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7847e9-4e90-4827-b67b-a1dfa96ea012 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:53.409130 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe3427-d208-4ac6-88a5-8fbe780e2ebd None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:53.450972 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc84ceb-46ca-48b2-93dd-d49d466dc1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:53.451878 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc84ceb-46ca-48b2-93dd-d49d466dc1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:53.452258 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc84ceb-46ca-48b2-93dd-d49d466dc1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:53.452601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc84ceb-46ca-48b2-93dd-d49d466dc1b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:53.467482 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc84ceb-46ca-48b2-93dd-d49d466dc1b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:53.469918 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc84ceb-46ca-48b2-93dd-d49d466dc1b9 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:53.489178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-fbc84ceb-46ca-48b2-93dd-d49d466dc1b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:53.489178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:53.489178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:53.489178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:53.489178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:53.489178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:53.489178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:53.489178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:53.489178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:53.489178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:53.489178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:53.489178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:53.489178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:40:53.489178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:40:53.489178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:40:53.490176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:40:53.490176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:53.490176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:53.490176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:53.490176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:53.490176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:53.490176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:53.490176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:53.490176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:53.490176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:53.490176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:53.490176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:53.490176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:53.490176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:53.490176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:53.490176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:53.490176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:53.491037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:40:53.491037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:40:53.491037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:53.491037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:53.491037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 234/472] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:40:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:53.492711 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 239/473] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 16:40:53 2022] POST /identity/v3/users => generated 248 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:40:53.496222 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc84ceb-46ca-48b2-93dd-d49d466dc1b9 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:53.533611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:53.567438 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91284c13-bbca-416c-95a4-7ec80ab64179 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:53.568136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91284c13-bbca-416c-95a4-7ec80ab64179 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:53.568616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91284c13-bbca-416c-95a4-7ec80ab64179 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:53.571102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 240/474] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:40:53.576289 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e59759-3d82-4ed2-b961-637125582c58 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:53.576846 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e59759-3d82-4ed2-b961-637125582c58 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:53.577346 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e59759-3d82-4ed2-b961-637125582c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:53.599253 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-05e59759-3d82-4ed2-b961-637125582c58 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:53.600985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-05e59759-3d82-4ed2-b961-637125582c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:53.612931 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc84ceb-46ca-48b2-93dd-d49d466dc1b9 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:53.652030 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87aaef-bb37-4355-9e07-3a02cb557a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:53.652663 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87aaef-bb37-4355-9e07-3a02cb557a19 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:53.652952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87aaef-bb37-4355-9e07-3a02cb557a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:53.653236 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87aaef-bb37-4355-9e07-3a02cb557a19 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:53.653994 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87aaef-bb37-4355-9e07-3a02cb557a19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:53.654800 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87aaef-bb37-4355-9e07-3a02cb557a19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:53.655832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87aaef-bb37-4355-9e07-3a02cb557a19 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:53.669707 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 235/475] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:53.670934 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:53.674763 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87aaef-bb37-4355-9e07-3a02cb557a19 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:53.686689 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 241/476] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:40:53.712597 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e59759-3d82-4ed2-b961-637125582c58 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:53.802161 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87aaef-bb37-4355-9e07-3a02cb557a19 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:53.804902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:53.826561 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e59759-3d82-4ed2-b961-637125582c58 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:53.842504 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6b88a-384b-47d5-84e0-8c1098c66ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:53.843311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6b88a-384b-47d5-84e0-8c1098c66ff9 None admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:53.843691 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6b88a-384b-47d5-84e0-8c1098c66ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:53.844250 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6b88a-384b-47d5-84e0-8c1098c66ff9 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:53.845472 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6b88a-384b-47d5-84e0-8c1098c66ff9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:53.847565 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6b88a-384b-47d5-84e0-8c1098c66ff9 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:53.870677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaeb98-d8ab-4418-8b4a-7003a88f39d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:53.871370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaeb98-d8ab-4418-8b4a-7003a88f39d8 None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:53.871717 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaeb98-d8ab-4418-8b4a-7003a88f39d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:53.871986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafaeb98-d8ab-4418-8b4a-7003a88f39d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:53.872723 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafaeb98-d8ab-4418-8b4a-7003a88f39d8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:53.874118 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafaeb98-d8ab-4418-8b4a-7003a88f39d8 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:53.921999 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.sql.core [None req-eafaeb98-d8ab-4418-8b4a-7003a88f39d8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 16:40:53.921999 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 22 16:40:53.921999 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [parameters: {'id': '4ab04513d92d4d26950f8fd3c61f4544', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 22 16:40:53.921999 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80542) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 16:40:53.931334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 236/477] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 16:40:53 2022] POST /identity/v3/users => generated 249 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 16:40:53.940774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-eafaeb98-d8ab-4418-8b4a-7003a88f39d8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 22 16:40:53.940774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:53.940774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 16:40:53.940774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 16:40:53.940774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 16:40:53.940774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 16:40:53.940774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 16:40:53.940774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 16:40:53.940774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 16:40:53.940774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application conn.query(q) Jun 22 16:40:53.940774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 16:40:53.940774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 16:40:53.940774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 16:40:53.940774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application result.read() Jun 22 16:40:53.940774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 16:40:53.941735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 16:40:53.941735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 16:40:53.941735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 16:40:53.941735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 16:40:53.941735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 16:40:53.941735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 16:40:53.941735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 16:40:53.941735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 16:40:53.941735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:53.941735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 16:40:53.941735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:53.941735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:53.941735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 16:40:53.941735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 16:40:53.941735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 22 16:40:53.941735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return ref.to_dict() Jun 22 16:40:53.941735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 16:40:53.941735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application next(self.gen) Jun 22 16:40:53.942679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 16:40:53.942679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application yield resource Jun 22 16:40:53.942679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 16:40:53.942679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application next(self.gen) Jun 22 16:40:53.942679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 16:40:53.942679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 16:40:53.942679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 16:40:53.942679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 16:40:53.942679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 16:40:53.942679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise self.value Jun 22 16:40:53.942679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 16:40:53.942679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 16:40:53.942679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 16:40:53.942679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application session.commit() Jun 22 16:40:53.942679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 16:40:53.942679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 16:40:53.942679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 16:40:53.943618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 16:40:53.943618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 16:40:53.943618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self.session.flush() Jun 22 16:40:53.943618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 16:40:53.943618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 16:40:53.943618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 16:40:53.943618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 16:40:53.943618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 16:40:53.943618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application compat.raise_( Jun 22 16:40:53.943618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 16:40:53.943618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception Jun 22 16:40:53.943618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 16:40:53.943618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 16:40:53.943618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 16:40:53.943618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 16:40:53.943618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 16:40:53.943618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 16:40:53.946064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 16:40:53.946064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 16:40:53.946064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 22 16:40:53.946064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 22 16:40:53.946064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 16:40:53.946064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 16:40:53.946064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 16:40:53.946064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 16:40:53.946064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 16:40:53.946064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 16:40:53.946064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 16:40:53.946064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 16:40:53.946064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 16:40:53.946064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 16:40:53.946064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 16:40:53.946064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception Jun 22 16:40:53.948039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 16:40:53.948039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 16:40:53.948039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 16:40:53.948039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 16:40:53.948039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 16:40:53.948039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 16:40:53.948039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 16:40:53.948039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application conn.query(q) Jun 22 16:40:53.948039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 16:40:53.948039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 16:40:53.948039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 16:40:53.948039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application result.read() Jun 22 16:40:53.948039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 16:40:53.948039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 16:40:53.948039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 16:40:53.948039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 16:40:53.950537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 16:40:53.950537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 16:40:53.950537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 16:40:53.950537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 16:40:53.950537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 22 16:40:53.950537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 22 16:40:53.950537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [parameters: {'id': '4ab04513d92d4d26950f8fd3c61f4544', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 22 16:40:53.950537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 16:40:53.950537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:53.950537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:40:53.950537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:53.950537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:53.950537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:53.950537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:53.950537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:53.950537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:53.952599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:53.952599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:53.952599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:53.952599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:53.952599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:53.952599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:53.952599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 22 16:40:53.952599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 22 16:40:53.952599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:53.952599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:53.952599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 22 16:40:53.952599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 22 16:40:53.952599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 16:40:53.952599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 16:40:53.952599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 22 16:40:53.952599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:53.956317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 242/478] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Jun 22 16:40:53 2022] POST /identity/v3/roles => generated 144 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:40:53.956458 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6b88a-384b-47d5-84e0-8c1098c66ff9 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:54.072331 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6b88a-384b-47d5-84e0-8c1098c66ff9 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:54.109850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fbc47-e3d6-401e-ac29-4fe1dd6ba828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:54.110667 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fbc47-e3d6-401e-ac29-4fe1dd6ba828 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:54.110954 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fbc47-e3d6-401e-ac29-4fe1dd6ba828 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:54.111225 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fbc47-e3d6-401e-ac29-4fe1dd6ba828 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:54.123125 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0fbc47-e3d6-401e-ac29-4fe1dd6ba828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:54.131307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-bc0fbc47-e3d6-401e-ac29-4fe1dd6ba828 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:54.131307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:54.131307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:54.131307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:54.131307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:54.131307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:54.131307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:54.131307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:54.131307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:54.131307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:54.131307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:54.131307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:54.131307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:54.131307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:54.131307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:54.131307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:54.132805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:54.132805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:54.132805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:54.132805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:54.132805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:54.132805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:54.132805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:54.132805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:54.132805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:54.132805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:54.132805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:54.132805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:54.132805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:54.132805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:54.132805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:54.132805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:54.133611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:54.133611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:54.133611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:54.133611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:54.133611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:54.133611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:54.133611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:54.133611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:54.133611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:54.133611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:54.133611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 22 16:40:54.133611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:54.133611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 237/479] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:40:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:54.139989 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaeb98-d8ab-4418-8b4a-7003a88f39d8 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:54.214313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:54.271454 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafaeb98-d8ab-4418-8b4a-7003a88f39d8 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:54.310536 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66badd1-111f-4279-88c6-65347b638c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:54.311214 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66badd1-111f-4279-88c6-65347b638c46 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:54.311504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66badd1-111f-4279-88c6-65347b638c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:54.311794 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66badd1-111f-4279-88c6-65347b638c46 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:54.312587 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66badd1-111f-4279-88c6-65347b638c46 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:54.312903 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66badd1-111f-4279-88c6-65347b638c46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:54.314282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66badd1-111f-4279-88c6-65347b638c46 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:54.326515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 243/480] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:40:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:55.266665 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa707c2-300a-43fe-8965-3d9a66b7d66d None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:55.267164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa707c2-300a-43fe-8965-3d9a66b7d66d None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:55.267238 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa707c2-300a-43fe-8965-3d9a66b7d66d None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:55.268916 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 238/481] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:55.281425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41f8a4-dc40-42a7-8849-8042b2ba25b2 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:55.281820 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41f8a4-dc40-42a7-8849-8042b2ba25b2 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:55.281909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41f8a4-dc40-42a7-8849-8042b2ba25b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:55.308379 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-cb41f8a4-dc40-42a7-8849-8042b2ba25b2 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:55.309582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-cb41f8a4-dc40-42a7-8849-8042b2ba25b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:55.384951 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 244/482] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:40:55.420706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa707c2-300a-43fe-8965-3d9a66b7d66d None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:55.437135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:55.559255 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa707c2-300a-43fe-8965-3d9a66b7d66d None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:55.610353 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2cfe7-070f-4d6e-a406-d7edbe6d89fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:55.611170 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2cfe7-070f-4d6e-a406-d7edbe6d89fb None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:55.611456 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2cfe7-070f-4d6e-a406-d7edbe6d89fb None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:55.611728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2cfe7-070f-4d6e-a406-d7edbe6d89fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:55.626104 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2cfe7-070f-4d6e-a406-d7edbe6d89fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:55.634395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-d9c2cfe7-070f-4d6e-a406-d7edbe6d89fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:40:55.634395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:55.634395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:55.634395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:55.634395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:55.634395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:55.634395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:55.634395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:55.634395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:55.634395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:55.634395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:55.634395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:55.634395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:55.634395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:55.634395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:55.634395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:55.635371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:55.635371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:55.635371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:55.635371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:55.635371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:55.635371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:55.635371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:55.635371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:55.635371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:55.635371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:55.635371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:55.635371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:55.635371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:55.635371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:55.635371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:55.635371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:55.636188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:55.636188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:55.636188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:55.636188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:55.636188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:55.636188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:55.636188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:55.636188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:55.636188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:55.636188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:55.636188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:40:55.636188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:55.636188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 239/483] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:40:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:55.641630 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41f8a4-dc40-42a7-8849-8042b2ba25b2 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:55.711573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:55.783025 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41f8a4-dc40-42a7-8849-8042b2ba25b2 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:55.833433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f12bc-e338-4183-9d35-77149abdcba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:55.834030 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f12bc-e338-4183-9d35-77149abdcba3 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:55.834319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f12bc-e338-4183-9d35-77149abdcba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:55.834598 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f12bc-e338-4183-9d35-77149abdcba3 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:55.835389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f12bc-e338-4183-9d35-77149abdcba3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:55.835700 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f12bc-e338-4183-9d35-77149abdcba3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:55.837106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f12bc-e338-4183-9d35-77149abdcba3 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:55.847298 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 245/484] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 16:40:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:55.853223 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2cfe7-070f-4d6e-a406-d7edbe6d89fb None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:55.911445 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece15a31-26b6-44a0-a9a4-7bb0bd404412 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:55.912129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece15a31-26b6-44a0-a9a4-7bb0bd404412 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:55.912609 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece15a31-26b6-44a0-a9a4-7bb0bd404412 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:55.915086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 246/485] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:55.919540 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732e074-392e-40ef-8ee2-6b225f364f4d None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:55.920044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732e074-392e-40ef-8ee2-6b225f364f4d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:55.920555 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732e074-392e-40ef-8ee2-6b225f364f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:55.949929 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-3732e074-392e-40ef-8ee2-6b225f364f4d None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:55.951127 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3732e074-392e-40ef-8ee2-6b225f364f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:55.968501 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:56.041981 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 247/486] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:56.046699 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2cfe7-070f-4d6e-a406-d7edbe6d89fb None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:56.082594 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732e074-392e-40ef-8ee2-6b225f364f4d None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:56.088959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4bf78-00b2-46a8-b7a6-75908f2436d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:56.089686 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4bf78-00b2-46a8-b7a6-75908f2436d3 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:56.089963 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4bf78-00b2-46a8-b7a6-75908f2436d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:56.090229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b4bf78-00b2-46a8-b7a6-75908f2436d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:56.112719 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4bf78-00b2-46a8-b7a6-75908f2436d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:56.114188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b4bf78-00b2-46a8-b7a6-75908f2436d3 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:56.122672 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:56.156464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-45b4bf78-00b2-46a8-b7a6-75908f2436d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:56.156464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:56.156464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:56.156464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:56.156464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:56.156464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:56.156464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:56.156464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:56.156464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:56.156464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:56.156464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:56.156464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:56.156464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:40:56.156464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:40:56.156464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:40:56.157374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:40:56.157374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:56.157374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:56.157374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:56.157374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:56.157374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:56.157374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:56.157374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:56.157374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:56.157374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:56.157374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:56.157374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:56.157374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:56.157374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:56.157374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:56.157374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:56.157374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:56.158241 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:40:56.158241 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:40:56.158241 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:56.158241 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:56.158241 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 240/487] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:56.163036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4bf78-00b2-46a8-b7a6-75908f2436d3 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:56.198367 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732e074-392e-40ef-8ee2-6b225f364f4d None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:56.237273 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c83086-c6cb-497d-89b5-e98a5879398d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:56.238426 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c83086-c6cb-497d-89b5-e98a5879398d None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:56.238921 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c83086-c6cb-497d-89b5-e98a5879398d None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:56.239389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c83086-c6cb-497d-89b5-e98a5879398d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:56.250825 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c83086-c6cb-497d-89b5-e98a5879398d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:56.259646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-08c83086-c6cb-497d-89b5-e98a5879398d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:40:56.259646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:56.259646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:56.259646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:56.259646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:56.259646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:56.259646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:56.259646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:56.259646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:56.259646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:56.259646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:56.259646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:56.259646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:56.259646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:56.259646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:56.259646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:56.260581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:56.260581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:56.260581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:56.260581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:56.260581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:56.260581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:56.260581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:56.260581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:56.260581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:56.260581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:56.260581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:56.260581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:56.260581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:56.260581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:56.260581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:56.260581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:56.261378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:56.261378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:56.261378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:56.261378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:56.261378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:56.261378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:56.261378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:56.261378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:56.261378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:56.261378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:56.261378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:40:56.261378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:56.263863 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 248/488] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:40:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:40:56.268143 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3e683-2d80-4682-907c-5108a1a8af87 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:56.268143 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3e683-2d80-4682-907c-5108a1a8af87 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:56.268143 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3e683-2d80-4682-907c-5108a1a8af87 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:56.268143 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 249/489] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:56.273374 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261257d6-5bd6-4310-949f-517ba115c962 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:56.273903 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261257d6-5bd6-4310-949f-517ba115c962 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:56.274375 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261257d6-5bd6-4310-949f-517ba115c962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:56.291429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-261257d6-5bd6-4310-949f-517ba115c962 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:56.293341 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-261257d6-5bd6-4310-949f-517ba115c962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:56.332394 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b4bf78-00b2-46a8-b7a6-75908f2436d3 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:56.356475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:56.366569 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 250/490] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:56.367622 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261257d6-5bd6-4310-949f-517ba115c962 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:56.373903 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e822e-213e-4b63-83fc-14b5a3814052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:56.375186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e822e-213e-4b63-83fc-14b5a3814052 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:56.379713 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e822e-213e-4b63-83fc-14b5a3814052 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:56.380258 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e822e-213e-4b63-83fc-14b5a3814052 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:56.381197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e822e-213e-4b63-83fc-14b5a3814052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:56.381704 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e822e-213e-4b63-83fc-14b5a3814052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:56.383404 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e822e-213e-4b63-83fc-14b5a3814052 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:56.400637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 241/491] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:40:56.401936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e822e-213e-4b63-83fc-14b5a3814052 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:56.415670 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:56.514937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261257d6-5bd6-4310-949f-517ba115c962 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:56.531904 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e822e-213e-4b63-83fc-14b5a3814052 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:56.563868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bc103-16e6-4361-a0e7-4123b449c7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:56.564556 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bc103-16e6-4361-a0e7-4123b449c7bd None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:56.564850 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bc103-16e6-4361-a0e7-4123b449c7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:56.565371 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bc103-16e6-4361-a0e7-4123b449c7bd None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:56.566602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bc103-16e6-4361-a0e7-4123b449c7bd None admin] RBAC: Adding query filter params (name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:56.566922 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bc103-16e6-4361-a0e7-4123b449c7bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:56.568600 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bc103-16e6-4361-a0e7-4123b449c7bd None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:56.572454 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc9b12-521c-42c5-8b44-8793fdd9715e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:56.573461 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc9b12-521c-42c5-8b44-8793fdd9715e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:56.573897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc9b12-521c-42c5-8b44-8793fdd9715e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:56.576838 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc9b12-521c-42c5-8b44-8793fdd9715e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:56.582572 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 251/492] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 16:40:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:56.582572 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bc103-16e6-4361-a0e7-4123b449c7bd None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:56.590115 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc9b12-521c-42c5-8b44-8793fdd9715e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:56.600301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-6ccc9b12-521c-42c5-8b44-8793fdd9715e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:40:56.600301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:56.600301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:56.600301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:56.600301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:56.600301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:56.600301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:56.600301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:56.600301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:56.600301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:56.600301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:56.600301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:56.600301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:56.600301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:56.600301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:56.600301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:56.601257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:56.601257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:56.601257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:56.601257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:56.601257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:56.601257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:56.601257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:56.601257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:56.601257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:56.601257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:56.601257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:56.601257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:56.601257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:56.601257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:56.601257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:56.601257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:56.602066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:56.602066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:56.602066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:56.602066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:56.602066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:56.602066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:56.602066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:56.602066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:56.602066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:56.602066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:56.602066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:40:56.602066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:56.602693 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 242/493] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:40:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:56.608383 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc9b12-521c-42c5-8b44-8793fdd9715e None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:56.652165 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:56.692589 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:56.707648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bc103-16e6-4361-a0e7-4123b449c7bd None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:56.720300 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc9b12-521c-42c5-8b44-8793fdd9715e None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:56.742592 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e996f-2f22-44fd-84d3-79e040a86494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:56.743373 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e996f-2f22-44fd-84d3-79e040a86494 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:56.743666 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e996f-2f22-44fd-84d3-79e040a86494 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:56.743953 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e996f-2f22-44fd-84d3-79e040a86494 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:56.751501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e996f-2f22-44fd-84d3-79e040a86494 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:56.752978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e996f-2f22-44fd-84d3-79e040a86494 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:56.754671 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca9d3b-02fe-48f8-b7af-52d15479d2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:56.755442 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca9d3b-02fe-48f8-b7af-52d15479d2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:56.755730 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca9d3b-02fe-48f8-b7af-52d15479d2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:56.756008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca9d3b-02fe-48f8-b7af-52d15479d2a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:56.767288 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca9d3b-02fe-48f8-b7af-52d15479d2a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:56.768764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca9d3b-02fe-48f8-b7af-52d15479d2a7 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:56.769576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-2e3e996f-2f22-44fd-84d3-79e040a86494 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 16:40:56.769576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:56.769576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:56.769576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:56.769576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:56.769576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:56.769576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:56.769576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:56.769576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:56.769576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:56.769576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:56.769576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:56.769576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:40:56.769576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:40:56.769576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:40:56.769576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:40:56.770475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:56.770475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:56.770475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:40:56.770475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:40:56.770475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:40:56.770475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:40:56.770475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:56.770475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:56.770475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:56.770475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:56.770475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:56.770475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:56.770475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:56.770475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:56.770475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:56.770475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:56.770475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:56.770475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:56.771372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:56.771372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:56.771372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:40:56.771372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:40:56.771372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:40:56.771372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:40:56.771372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:40:56.771372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:40:56.771372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 16:40:56.771372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:56.771372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 252/494] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jun 22 16:40:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:56.773125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e996f-2f22-44fd-84d3-79e040a86494 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:56.791950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-25ca9d3b-02fe-48f8-b7af-52d15479d2a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:56.791950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:56.791950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:56.791950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:56.791950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:56.791950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:56.791950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:56.791950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:56.791950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:56.791950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:56.791950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:56.791950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:56.791950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:40:56.791950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:40:56.791950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:40:56.792854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:40:56.792854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:56.792854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:56.792854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:56.792854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:56.792854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:56.792854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:56.792854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:56.792854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:56.792854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:56.792854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:56.792854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:56.792854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:56.792854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:56.792854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:56.792854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:56.792854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:56.798407 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:40:56.798407 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:40:56.798407 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:56.798407 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:56.798407 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 243/495] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:56.798407 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff536e-d101-48b7-9a9a-7dbf0057afd9 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:56.798407 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff536e-d101-48b7-9a9a-7dbf0057afd9 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:56.798407 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff536e-d101-48b7-9a9a-7dbf0057afd9 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:56.798407 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 244/496] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:56.798915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff536e-d101-48b7-9a9a-7dbf0057afd9 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:56.896619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e996f-2f22-44fd-84d3-79e040a86494 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:56.903823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:56.915801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff536e-d101-48b7-9a9a-7dbf0057afd9 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:56.931342 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12896cf-1eba-46df-bf01-14b397778397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:56.932050 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12896cf-1eba-46df-bf01-14b397778397 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:56.932489 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12896cf-1eba-46df-bf01-14b397778397 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:56.932656 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12896cf-1eba-46df-bf01-14b397778397 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:56.933414 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12896cf-1eba-46df-bf01-14b397778397 None admin] RBAC: Adding query filter params (name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:56.933728 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12896cf-1eba-46df-bf01-14b397778397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:56.935112 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12896cf-1eba-46df-bf01-14b397778397 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:56.943333 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 253/497] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 16:40:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:56.946830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12896cf-1eba-46df-bf01-14b397778397 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:56.952858 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b2e4c-ecac-4675-b9d3-5f786f12f538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:56.953528 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b2e4c-ecac-4675-b9d3-5f786f12f538 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:56.953810 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b2e4c-ecac-4675-b9d3-5f786f12f538 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:56.954087 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b2e4c-ecac-4675-b9d3-5f786f12f538 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:56.954931 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b2e4c-ecac-4675-b9d3-5f786f12f538 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:56.955244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b2e4c-ecac-4675-b9d3-5f786f12f538 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:56.956724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b2e4c-ecac-4675-b9d3-5f786f12f538 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:56.958665 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:56.996409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 245/498] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jun 22 16:40:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:56.998041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf9d4c-149c-46a5-a4c2-65e793281a84 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:56.998401 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf9d4c-149c-46a5-a4c2-65e793281a84 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:56.998754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf9d4c-149c-46a5-a4c2-65e793281a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:57.015663 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-89cf9d4c-149c-46a5-a4c2-65e793281a84 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:57.016889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-89cf9d4c-149c-46a5-a4c2-65e793281a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:57.063180 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12896cf-1eba-46df-bf01-14b397778397 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:57.096254 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 246/499] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:57.097771 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf9d4c-149c-46a5-a4c2-65e793281a84 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:57.099151 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4ef0e-3f2e-40ca-b06e-9108918461e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:57.099959 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4ef0e-3f2e-40ca-b06e-9108918461e6 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:57.100360 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4ef0e-3f2e-40ca-b06e-9108918461e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:57.101315 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4ef0e-3f2e-40ca-b06e-9108918461e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:57.102143 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4ef0e-3f2e-40ca-b06e-9108918461e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:57.102544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4ef0e-3f2e-40ca-b06e-9108918461e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:57.104019 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4ef0e-3f2e-40ca-b06e-9108918461e6 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:57.121867 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 254/500] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:57.122833 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4ef0e-3f2e-40ca-b06e-9108918461e6 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:57.185348 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:57.189368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:57.205987 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf9d4c-149c-46a5-a4c2-65e793281a84 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:57.222385 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4ef0e-3f2e-40ca-b06e-9108918461e6 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:57.239897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ef4b3-109a-419c-91f9-f4265508b7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:57.240718 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ef4b3-109a-419c-91f9-f4265508b7ad None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:57.241006 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ef4b3-109a-419c-91f9-f4265508b7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:57.241289 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ef4b3-109a-419c-91f9-f4265508b7ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:57.251110 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ef4b3-109a-419c-91f9-f4265508b7ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:57.252613 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ef4b3-109a-419c-91f9-f4265508b7ad None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:57.255315 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfaa940-8954-4c46-ae2a-e3dedb0d4fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:57.255952 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaa940-8954-4c46-ae2a-e3dedb0d4fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:57.256267 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaa940-8954-4c46-ae2a-e3dedb0d4fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:57.256554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaa940-8954-4c46-ae2a-e3dedb0d4fb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:57.271738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-233ef4b3-109a-419c-91f9-f4265508b7ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:57.271738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:57.271738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:57.271738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:57.271738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:57.271738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:57.271738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:57.271738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:57.271738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:57.271738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:57.271738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:57.271738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:57.271738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:40:57.271738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:40:57.271738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:40:57.273221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:40:57.273221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:57.273221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:57.273221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:57.273221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:57.273221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:57.273221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:57.273221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:57.273221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:57.273221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:57.273221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:57.273221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:57.273221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:57.273221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:57.273221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:57.273221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:57.273221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:57.274077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:40:57.274077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:40:57.274077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:57.274077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:57.274077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 247/501] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:57.274338 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ef4b3-109a-419c-91f9-f4265508b7ad None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:57.326323 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfaa940-8954-4c46-ae2a-e3dedb0d4fb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:57.327773 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfaa940-8954-4c46-ae2a-e3dedb0d4fb0 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:57.370665 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ef4b3-109a-419c-91f9-f4265508b7ad None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:57.392112 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:57.399156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:57.404833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da70762-5f03-4977-928d-e961cd8ef85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:57.406400 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da70762-5f03-4977-928d-e961cd8ef85f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:57.406400 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da70762-5f03-4977-928d-e961cd8ef85f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:57.406400 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da70762-5f03-4977-928d-e961cd8ef85f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:57.415856 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da70762-5f03-4977-928d-e961cd8ef85f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:40:57.423535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-5da70762-5f03-4977-928d-e961cd8ef85f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:40:57.423535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:57.423535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:57.423535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:57.423535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:57.423535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:57.423535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:57.423535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:57.423535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:57.423535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:57.423535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:57.423535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:57.423535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:40:57.423535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:40:57.423535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:40:57.423535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:40:57.424467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:40:57.424467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:40:57.424467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:40:57.424467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:40:57.424467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:57.424467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:57.424467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:57.424467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:57.424467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:57.424467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:57.424467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:57.424467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:57.424467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:57.424467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:57.424467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:57.424467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:57.425337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:57.425337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:57.425337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:57.425337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:57.425337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:40:57.425337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:40:57.425337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:40:57.425337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:40:57.425337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:40:57.425337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:40:57.425337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:40:57.425337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:57.425940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 255/502] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:57.425940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0920d-790a-4eca-bc90-9f7f55bfe457 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:57.426098 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0920d-790a-4eca-bc90-9f7f55bfe457 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:57.426375 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0920d-790a-4eca-bc90-9f7f55bfe457 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:57.427651 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 256/503] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:40:57.428364 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0920d-790a-4eca-bc90-9f7f55bfe457 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:57.429482 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 248/504] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:40:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:57.430586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da70762-5f03-4977-928d-e961cd8ef85f None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:57.530969 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0920d-790a-4eca-bc90-9f7f55bfe457 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:57.539695 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da70762-5f03-4977-928d-e961cd8ef85f None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:57.563245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aaf67c-83cd-4abe-abed-57a23f9a3cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:57.564027 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaf67c-83cd-4abe-abed-57a23f9a3cda None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:57.564333 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaf67c-83cd-4abe-abed-57a23f9a3cda None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:57.564608 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaf67c-83cd-4abe-abed-57a23f9a3cda None admin] PATH_INFO: `/v3/users/glance` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:57.572603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aaf67c-83cd-4abe-abed-57a23f9a3cda None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:57.575010 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c44fc-6001-4e9a-8603-a3364f7224c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:57.575141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aaf67c-83cd-4abe-abed-57a23f9a3cda None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:57.575243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c44fc-6001-4e9a-8603-a3364f7224c2 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:57.575243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c44fc-6001-4e9a-8603-a3364f7224c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:57.575243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c44fc-6001-4e9a-8603-a3364f7224c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:57.575470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c44fc-6001-4e9a-8603-a3364f7224c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:57.575651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c44fc-6001-4e9a-8603-a3364f7224c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:57.577031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c44fc-6001-4e9a-8603-a3364f7224c2 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:57.593030 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 249/505] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:57.593030 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c44fc-6001-4e9a-8603-a3364f7224c2 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:57.593288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-11aaf67c-83cd-4abe-abed-57a23f9a3cda None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 16:40:57.593288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:57.593288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:57.593288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:57.593288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:57.593288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:57.593288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:57.593288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:57.593288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:57.593288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:57.593288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:57.593288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:57.593288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:40:57.593288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:40:57.593288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:40:57.593288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:40:57.594292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:57.594292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:57.594292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:40:57.594292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:40:57.594292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:40:57.594292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:40:57.594292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:57.594292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:57.594292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:57.594292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:57.594292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:57.594292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:57.594292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:57.594292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:57.594292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:57.594292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:57.594292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:57.594292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:57.595390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:57.595390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:57.595390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:40:57.595390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:40:57.595390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:40:57.595390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:40:57.595390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:40:57.595390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:40:57.595390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 16:40:57.595390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:57.595390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 257/506] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:57.595390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b76568-7c19-436c-90d2-f02b4115d0ca None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:57.595390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b76568-7c19-436c-90d2-f02b4115d0ca None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:57.596184 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b76568-7c19-436c-90d2-f02b4115d0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:57.610204 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-06b76568-7c19-436c-90d2-f02b4115d0ca None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:40:57.611413 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-06b76568-7c19-436c-90d2-f02b4115d0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:40:57.634920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:57.643808 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:57.677174 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 258/507] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:40:57.678164 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b76568-7c19-436c-90d2-f02b4115d0ca None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:57.696279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c44fc-6001-4e9a-8603-a3364f7224c2 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:57.731689 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ccc04-309e-431d-b6ef-f57ba5e2fcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:57.732486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ccc04-309e-431d-b6ef-f57ba5e2fcdf None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:57.732772 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ccc04-309e-431d-b6ef-f57ba5e2fcdf None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:57.733051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ccc04-309e-431d-b6ef-f57ba5e2fcdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:57.743414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ccc04-309e-431d-b6ef-f57ba5e2fcdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:57.744884 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ccc04-309e-431d-b6ef-f57ba5e2fcdf None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:57.761902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-399ccc04-309e-431d-b6ef-f57ba5e2fcdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:57.761902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:57.761902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:57.761902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:57.761902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:57.761902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:57.761902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:57.761902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:57.761902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:57.761902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:57.761902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:57.761902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:57.761902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:40:57.761902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:40:57.761902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:40:57.763005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:40:57.763005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:57.763005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:57.763005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:57.763005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:57.763005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:57.763005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:57.763005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:57.763005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:57.763005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:57.763005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:57.763005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:57.763005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:57.763005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:57.763005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:57.763005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:57.763005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:57.764064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:40:57.764064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:40:57.764064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:57.764064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:57.764064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 250/508] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:57.764064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ccc04-309e-431d-b6ef-f57ba5e2fcdf None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:57.777741 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b76568-7c19-436c-90d2-f02b4115d0ca None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:57.810925 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d979e-8930-46ff-a299-beace92f3421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:57.811520 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d979e-8930-46ff-a299-beace92f3421 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:57.811808 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d979e-8930-46ff-a299-beace92f3421 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:57.812088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d979e-8930-46ff-a299-beace92f3421 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:57.812878 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d979e-8930-46ff-a299-beace92f3421 None admin] RBAC: Adding query filter params (name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:57.813191 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d979e-8930-46ff-a299-beace92f3421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:57.814578 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d979e-8930-46ff-a299-beace92f3421 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:57.822320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 259/509] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 16:40:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:57.823096 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d979e-8930-46ff-a299-beace92f3421 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:57.846283 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:57.862522 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ccc04-309e-431d-b6ef-f57ba5e2fcdf None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:57.864004 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:57.895489 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807bec2-7152-47f7-853c-37cadc50db91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:57.896178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807bec2-7152-47f7-853c-37cadc50db91 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:57.896467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807bec2-7152-47f7-853c-37cadc50db91 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:57.896745 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807bec2-7152-47f7-853c-37cadc50db91 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:57.898158 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807bec2-7152-47f7-853c-37cadc50db91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:57.898473 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807bec2-7152-47f7-853c-37cadc50db91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:57.899919 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807bec2-7152-47f7-853c-37cadc50db91 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:57.917589 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 251/510] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jun 22 16:40:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:57.918589 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807bec2-7152-47f7-853c-37cadc50db91 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:57.922371 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d979e-8930-46ff-a299-beace92f3421 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:57.956432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa76eb-310d-4ad2-abb4-e97b69ef088f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:57.957215 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa76eb-310d-4ad2-abb4-e97b69ef088f None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:57.957501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa76eb-310d-4ad2-abb4-e97b69ef088f None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:57.957781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa76eb-310d-4ad2-abb4-e97b69ef088f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:57.965609 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa76eb-310d-4ad2-abb4-e97b69ef088f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:57.967094 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa76eb-310d-4ad2-abb4-e97b69ef088f None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:57.980877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-d9aa76eb-310d-4ad2-abb4-e97b69ef088f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 16:40:57.980877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:57.980877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:57.980877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:57.980877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:57.980877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:57.980877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:57.980877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:57.980877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:57.980877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:57.980877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:57.980877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:57.980877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:40:57.980877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:40:57.980877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:40:57.980877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:40:57.981769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:57.981769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:57.981769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:40:57.981769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:40:57.981769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:40:57.981769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:40:57.981769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:57.981769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:57.981769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:57.981769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:57.981769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:57.981769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:57.981769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:57.981769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:57.981769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:57.981769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:57.981769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:57.981769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:57.982661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:57.982661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:57.982661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:40:57.982661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:40:57.982661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:40:57.982661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:40:57.982661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:40:57.982661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:40:57.982661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 16:40:57.982661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:57.982661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 260/511] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:40:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:57.983221 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa76eb-310d-4ad2-abb4-e97b69ef088f None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:58.020495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807bec2-7152-47f7-853c-37cadc50db91 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:58.054774 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5166d5-4f81-4fd0-8088-ed132af1e088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:58.055551 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5166d5-4f81-4fd0-8088-ed132af1e088 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:58.055837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5166d5-4f81-4fd0-8088-ed132af1e088 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:58.056130 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5166d5-4f81-4fd0-8088-ed132af1e088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:58.062858 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:58.066060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5166d5-4f81-4fd0-8088-ed132af1e088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:58.067565 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5166d5-4f81-4fd0-8088-ed132af1e088 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:58.081871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa76eb-310d-4ad2-abb4-e97b69ef088f None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:58.085544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-da5166d5-4f81-4fd0-8088-ed132af1e088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:58.085544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:58.085544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:58.085544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:58.085544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:58.085544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:58.085544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:58.085544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:58.085544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:58.085544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:58.085544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:58.085544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:58.085544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:40:58.085544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:40:58.085544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:40:58.086530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:40:58.086530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:58.086530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:58.086530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:58.086530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:58.086530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:58.086530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:58.086530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:58.086530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:58.086530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:58.086530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:58.086530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:58.086530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:58.086530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:58.086530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:58.086530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:58.086530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:58.087388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:40:58.087388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:40:58.087388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:58.087388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:58.087388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 252/512] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:58.087662 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5166d5-4f81-4fd0-8088-ed132af1e088 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:58.103397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:58.115095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1176a-d9da-437b-a36b-aacac051e3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:58.115779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1176a-d9da-437b-a36b-aacac051e3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:58.116067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1176a-d9da-437b-a36b-aacac051e3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:58.116396 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1176a-d9da-437b-a36b-aacac051e3c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:58.117111 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1176a-d9da-437b-a36b-aacac051e3c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:58.117417 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1176a-d9da-437b-a36b-aacac051e3c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:58.118778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1176a-d9da-437b-a36b-aacac051e3c5 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:58.130208 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 261/513] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:58.130987 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1176a-d9da-437b-a36b-aacac051e3c5 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:58.188003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5166d5-4f81-4fd0-8088-ed132af1e088 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:58.221802 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1882e-beed-4760-8d10-eb0449141232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:58.222584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1882e-beed-4760-8d10-eb0449141232 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:58.222873 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1882e-beed-4760-8d10-eb0449141232 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:58.223146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1882e-beed-4760-8d10-eb0449141232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:58.228498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1176a-d9da-437b-a36b-aacac051e3c5 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:58.232980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1882e-beed-4760-8d10-eb0449141232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:58.234413 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1882e-beed-4760-8d10-eb0449141232 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:58.251379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-d8a1882e-beed-4760-8d10-eb0449141232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:58.251379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:58.251379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:58.251379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:58.251379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:58.251379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:58.251379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:58.251379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:58.251379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:58.251379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:58.251379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:58.251379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:58.251379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:40:58.251379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:40:58.251379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:40:58.252375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:40:58.252375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:58.252375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:58.252375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:58.252375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:58.252375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:58.252375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:58.252375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:58.252375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:58.252375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:58.252375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:58.252375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:58.252375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:58.252375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:58.252375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:58.252375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:58.252375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:58.253245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:40:58.253245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:40:58.253245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:58.253245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:58.253245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 253/514] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:58.253514 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1882e-beed-4760-8d10-eb0449141232 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:58.266797 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67a681-c5b9-4b2c-8c65-7ba3f679381f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:58.267505 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67a681-c5b9-4b2c-8c65-7ba3f679381f None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:58.267797 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67a681-c5b9-4b2c-8c65-7ba3f679381f None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:58.268081 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67a681-c5b9-4b2c-8c65-7ba3f679381f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:58.278886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:58.314091 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:58.335507 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67a681-c5b9-4b2c-8c65-7ba3f679381f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:58.337026 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67a681-c5b9-4b2c-8c65-7ba3f679381f None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:58.351384 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1882e-beed-4760-8d10-eb0449141232 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:58.384995 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea1475-8096-41ba-aeb3-40a49d0515d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:58.385647 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea1475-8096-41ba-aeb3-40a49d0515d4 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:58.385928 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea1475-8096-41ba-aeb3-40a49d0515d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:58.386207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea1475-8096-41ba-aeb3-40a49d0515d4 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:58.387045 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea1475-8096-41ba-aeb3-40a49d0515d4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:58.387608 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea1475-8096-41ba-aeb3-40a49d0515d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:58.389076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea1475-8096-41ba-aeb3-40a49d0515d4 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:58.405737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 254/515] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jun 22 16:40:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:58.406715 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea1475-8096-41ba-aeb3-40a49d0515d4 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:58.434933 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 262/516] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:58.435759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67a681-c5b9-4b2c-8c65-7ba3f679381f None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:58.477273 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:58.503668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea1475-8096-41ba-aeb3-40a49d0515d4 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:58.526405 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:58.534756 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67a681-c5b9-4b2c-8c65-7ba3f679381f None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:58.537784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c136e7c-2b25-4300-bd8a-5ba2a7765265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:58.538465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c136e7c-2b25-4300-bd8a-5ba2a7765265 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:58.538755 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c136e7c-2b25-4300-bd8a-5ba2a7765265 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:58.539036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c136e7c-2b25-4300-bd8a-5ba2a7765265 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:58.539765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c136e7c-2b25-4300-bd8a-5ba2a7765265 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:58.540075 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c136e7c-2b25-4300-bd8a-5ba2a7765265 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:58.541494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c136e7c-2b25-4300-bd8a-5ba2a7765265 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:58.552982 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 255/517] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:58.554301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c136e7c-2b25-4300-bd8a-5ba2a7765265 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:58.570312 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a594b-d269-4d92-a055-845db9857466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:58.570747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a594b-d269-4d92-a055-845db9857466 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:58.571031 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a594b-d269-4d92-a055-845db9857466 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:58.571303 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a594b-d269-4d92-a055-845db9857466 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:58.577892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a594b-d269-4d92-a055-845db9857466 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:58.579341 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a594b-d269-4d92-a055-845db9857466 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:58.593284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-659a594b-d269-4d92-a055-845db9857466 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:40:58.593284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:58.593284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:58.593284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:58.593284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:58.593284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:58.593284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:58.593284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:58.593284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:58.593284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:58.593284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:58.593284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:58.593284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:40:58.593284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:40:58.593284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:40:58.594154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:40:58.594154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:58.594154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:58.594154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:58.594154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:58.594154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:58.594154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:58.594154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:58.594154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:58.594154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:58.594154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:58.594154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:58.594154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:58.594154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:58.594154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:58.594154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:58.594154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:58.595013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:40:58.595013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:40:58.595013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:40:58.595013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:40:58.595013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:40:58.595013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:40:58.595013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:40:58.595013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:58.595013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 263/518] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:40:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:58.595481 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a594b-d269-4d92-a055-845db9857466 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:58.657369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c136e7c-2b25-4300-bd8a-5ba2a7765265 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:58.692914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07514c-6d92-41e2-8f36-b6005ff86705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:58.693889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07514c-6d92-41e2-8f36-b6005ff86705 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:58.694263 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07514c-6d92-41e2-8f36-b6005ff86705 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:58.694486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07514c-6d92-41e2-8f36-b6005ff86705 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:58.694663 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:58.695225 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07514c-6d92-41e2-8f36-b6005ff86705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:58.695544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07514c-6d92-41e2-8f36-b6005ff86705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:58.696976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07514c-6d92-41e2-8f36-b6005ff86705 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:58.697648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a594b-d269-4d92-a055-845db9857466 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:58.708797 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 256/519] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:58.709596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07514c-6d92-41e2-8f36-b6005ff86705 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:58.730855 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d15e6e-0485-4239-9e54-77c69bb82cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:58.731495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d15e6e-0485-4239-9e54-77c69bb82cbc None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:58.731776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d15e6e-0485-4239-9e54-77c69bb82cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:58.732047 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d15e6e-0485-4239-9e54-77c69bb82cbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:58.751839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:58.796418 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d15e6e-0485-4239-9e54-77c69bb82cbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:58.797863 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d15e6e-0485-4239-9e54-77c69bb82cbc None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:58.806679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07514c-6d92-41e2-8f36-b6005ff86705 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:58.839097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96659a03-f36a-4871-8811-41165f8a663a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:58.839816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96659a03-f36a-4871-8811-41165f8a663a None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:58.840125 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96659a03-f36a-4871-8811-41165f8a663a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:58.840418 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96659a03-f36a-4871-8811-41165f8a663a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:58.850136 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96659a03-f36a-4871-8811-41165f8a663a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:58.852126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96659a03-f36a-4871-8811-41165f8a663a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:58.869807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-96659a03-f36a-4871-8811-41165f8a663a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:58.869807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:58.869807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:58.869807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:58.869807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:58.869807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:58.869807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:58.869807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:58.869807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:58.869807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:58.869807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:58.869807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:58.869807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:40:58.869807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:40:58.869807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:40:58.870676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:40:58.870676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:58.870676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:58.870676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:58.870676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:58.870676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:58.870676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:58.870676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:58.870676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:58.870676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:58.870676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:58.870676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:58.870676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:58.870676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:58.870676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:58.870676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:58.870676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:58.871520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:40:58.871520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:40:58.871520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:58.871520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:58.871520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 257/520] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:58.871788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96659a03-f36a-4871-8811-41165f8a663a None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:58.894914 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:58.898476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 264/521] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:40:58.902272 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d15e6e-0485-4239-9e54-77c69bb82cbc None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:58.966725 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:58.973748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96659a03-f36a-4871-8811-41165f8a663a None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:58.997495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d15e6e-0485-4239-9e54-77c69bb82cbc None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:59.007378 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde7026-f0dc-47be-9d1c-cb4b880035bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:59.008032 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde7026-f0dc-47be-9d1c-cb4b880035bd None admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:59.008347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde7026-f0dc-47be-9d1c-cb4b880035bd None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:59.008624 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde7026-f0dc-47be-9d1c-cb4b880035bd None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:59.009330 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde7026-f0dc-47be-9d1c-cb4b880035bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:59.010750 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde7026-f0dc-47be-9d1c-cb4b880035bd None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:59.032486 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8c388-49c9-4d85-a34f-b9770520004e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:59.033143 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8c388-49c9-4d85-a34f-b9770520004e None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:59.033431 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8c388-49c9-4d85-a34f-b9770520004e None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:59.033712 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8c388-49c9-4d85-a34f-b9770520004e None admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:59.034504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8c388-49c9-4d85-a34f-b9770520004e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:59.034818 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8c388-49c9-4d85-a34f-b9770520004e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:59.036288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8c388-49c9-4d85-a34f-b9770520004e None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:59.053909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 265/522] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:40:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:59.054684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8c388-49c9-4d85-a34f-b9770520004e None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:59.103646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 258/523] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 16:40:58 2022] POST /identity/v3/users => generated 247 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:40:59.103646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde7026-f0dc-47be-9d1c-cb4b880035bd None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:59.123965 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:59.169661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8c388-49c9-4d85-a34f-b9770520004e None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:59.211030 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182919a1-a694-42de-87dc-a196d1091ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:59.211842 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182919a1-a694-42de-87dc-a196d1091ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:59.212153 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182919a1-a694-42de-87dc-a196d1091ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:59.212441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182919a1-a694-42de-87dc-a196d1091ef2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:59.214153 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde7026-f0dc-47be-9d1c-cb4b880035bd None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:59.221412 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182919a1-a694-42de-87dc-a196d1091ef2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:59.222904 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182919a1-a694-42de-87dc-a196d1091ef2 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:59.240001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-182919a1-a694-42de-87dc-a196d1091ef2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 16:40:59.240001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:59.240001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:59.240001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:59.240001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:59.240001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:59.240001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:59.240001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:59.240001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:59.240001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:59.240001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:59.240001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:59.240001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:40:59.240001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:40:59.240001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:40:59.240001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:40:59.241220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:59.241220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:59.241220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:40:59.241220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:40:59.241220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:40:59.241220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:40:59.241220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:59.241220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:59.241220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:59.241220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:59.241220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:59.241220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:59.241220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:59.241220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:59.241220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:59.241220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:59.241220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:59.241220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:59.242319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:59.242319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:59.242319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:40:59.242319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:40:59.242319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:40:59.242319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:40:59.242319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:40:59.242319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:40:59.242319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 16:40:59.242319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:59.242319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 266/524] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:40:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:59.242319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182919a1-a694-42de-87dc-a196d1091ef2 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:59.262837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec77f6-21f8-4f3d-b1a1-3d2e0d741ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:59.263500 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec77f6-21f8-4f3d-b1a1-3d2e0d741ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:59.263782 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec77f6-21f8-4f3d-b1a1-3d2e0d741ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:59.264053 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec77f6-21f8-4f3d-b1a1-3d2e0d741ad8 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:59.264811 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec77f6-21f8-4f3d-b1a1-3d2e0d741ad8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:59.265123 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec77f6-21f8-4f3d-b1a1-3d2e0d741ad8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:59.266486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec77f6-21f8-4f3d-b1a1-3d2e0d741ad8 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:59.280527 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 259/525] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:59.281644 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec77f6-21f8-4f3d-b1a1-3d2e0d741ad8 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:59.300180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:59.354034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182919a1-a694-42de-87dc-a196d1091ef2 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:59.376023 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:59.390066 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fd80a-b49f-43ca-ad35-5969aa9b2b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:59.390851 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fd80a-b49f-43ca-ad35-5969aa9b2b4b None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:59.391141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fd80a-b49f-43ca-ad35-5969aa9b2b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:59.391423 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fd80a-b49f-43ca-ad35-5969aa9b2b4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:59.400683 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec77f6-21f8-4f3d-b1a1-3d2e0d741ad8 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:59.402457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fd80a-b49f-43ca-ad35-5969aa9b2b4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:59.404312 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fd80a-b49f-43ca-ad35-5969aa9b2b4b None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:59.423115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-110fd80a-b49f-43ca-ad35-5969aa9b2b4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:59.423115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:59.423115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:59.423115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:59.423115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:59.423115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:59.423115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:59.423115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:59.423115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:59.423115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:59.423115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:59.423115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:59.423115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:40:59.423115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:40:59.423115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:40:59.424301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:40:59.424301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:59.424301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:59.424301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:59.424301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:59.424301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:59.424301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:59.424301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:59.424301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:59.424301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:59.424301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:59.424301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:59.424301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:59.424301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:59.424301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:59.424301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:59.424301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:59.425188 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:40:59.425188 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:40:59.425188 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:40:59.425188 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:40:59.425188 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 267/526] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:59.425188 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fd80a-b49f-43ca-ad35-5969aa9b2b4b None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:59.442942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6732fe-2075-4faf-b577-99e02138d00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:59.443596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6732fe-2075-4faf-b577-99e02138d00e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:59.443884 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6732fe-2075-4faf-b577-99e02138d00e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:59.444717 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6732fe-2075-4faf-b577-99e02138d00e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:59.445575 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6732fe-2075-4faf-b577-99e02138d00e None admin] RBAC: Adding query filter params (role.id=acb8e1bf2db94178bdd6fc69b191d6b0, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=78e7bdfffdc84465a570d135d1d86380) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:59.445892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6732fe-2075-4faf-b577-99e02138d00e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:59.447330 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6732fe-2075-4faf-b577-99e02138d00e None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:59.460499 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 260/527] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:40:59 2022] GET /identity/v3/role_assignments?user.id=78e7bdfffdc84465a570d135d1d86380&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=acb8e1bf2db94178bdd6fc69b191d6b0 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:59.460499 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6732fe-2075-4faf-b577-99e02138d00e None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:59.553978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fd80a-b49f-43ca-ad35-5969aa9b2b4b None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:59.573836 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:59.597884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e449d3-bbeb-4c7a-a8df-04f45cca3ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:59.599206 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e449d3-bbeb-4c7a-a8df-04f45cca3ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:59.599814 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e449d3-bbeb-4c7a-a8df-04f45cca3ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:59.600637 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e449d3-bbeb-4c7a-a8df-04f45cca3ee2 None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:59.602138 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e449d3-bbeb-4c7a-a8df-04f45cca3ee2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:59.602693 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e449d3-bbeb-4c7a-a8df-04f45cca3ee2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:59.603415 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6732fe-2075-4faf-b577-99e02138d00e None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:59.604756 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e449d3-bbeb-4c7a-a8df-04f45cca3ee2 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:59.644688 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfd930-2878-4283-83aa-1fb916a975cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:59.645496 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfd930-2878-4283-83aa-1fb916a975cf None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:59.645783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfd930-2878-4283-83aa-1fb916a975cf None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:59.646066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfd930-2878-4283-83aa-1fb916a975cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:59.657713 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfd930-2878-4283-83aa-1fb916a975cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:59.658243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfd930-2878-4283-83aa-1fb916a975cf None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:59.658917 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 268/528] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Jun 22 16:40:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:59.659852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e449d3-bbeb-4c7a-a8df-04f45cca3ee2 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:59.677426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-2dbfd930-2878-4283-83aa-1fb916a975cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:40:59.677426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:40:59.677426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:40:59.677426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:40:59.677426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:40:59.677426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:40:59.677426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:40:59.677426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:40:59.677426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:40:59.677426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:40:59.677426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:40:59.677426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:40:59.677426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:40:59.677426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:40:59.677426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:40:59.678327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:40:59.678327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:40:59.678327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:40:59.678327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:40:59.678327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:40:59.678327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:40:59.678327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:40:59.678327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:40:59.678327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:40:59.678327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:40:59.678327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:40:59.678327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:40:59.678327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:40:59.678327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:40:59.678327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:40:59.678327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:40:59.678327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:40:59.679235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:40:59.679235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:40:59.679235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:40:59.679235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:40:59.679235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:40:59.679235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:40:59.679235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:40:59.679235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:40:59.681584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 261/529] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:40:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:40:59.682781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfd930-2878-4283-83aa-1fb916a975cf None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:59.690780 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:59.762306 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e449d3-bbeb-4c7a-a8df-04f45cca3ee2 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:59.798975 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b167f11-83a4-4907-b085-9e558eb62105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:59.799791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfd930-2878-4283-83aa-1fb916a975cf None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:59.800246 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b167f11-83a4-4907-b085-9e558eb62105 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:59.800735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b167f11-83a4-4907-b085-9e558eb62105 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:59.801251 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b167f11-83a4-4907-b085-9e558eb62105 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:59.802089 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b167f11-83a4-4907-b085-9e558eb62105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:59.802504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b167f11-83a4-4907-b085-9e558eb62105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:59.804583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b167f11-83a4-4907-b085-9e558eb62105 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:59.828066 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 269/530] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:59.828066 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b167f11-83a4-4907-b085-9e558eb62105 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:40:59.843001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48ec91-c331-451e-adfd-8590c823816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:59.843906 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48ec91-c331-451e-adfd-8590c823816e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:59.844407 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48ec91-c331-451e-adfd-8590c823816e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:59.844858 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48ec91-c331-451e-adfd-8590c823816e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:59.847959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:59.930677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:40:59.939822 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48ec91-c331-451e-adfd-8590c823816e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:59.944814 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b167f11-83a4-4907-b085-9e558eb62105 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:40:59.944932 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48ec91-c331-451e-adfd-8590c823816e None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:59.977568 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda37cbf-5678-49f7-a3f0-825ccb83bcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:40:59.978589 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda37cbf-5678-49f7-a3f0-825ccb83bcbb None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:40:59.979075 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda37cbf-5678-49f7-a3f0-825ccb83bcbb None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:40:59.979541 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda37cbf-5678-49f7-a3f0-825ccb83bcbb None admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:40:59.980548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda37cbf-5678-49f7-a3f0-825ccb83bcbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:40:59.981174 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda37cbf-5678-49f7-a3f0-825ccb83bcbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:40:59.982838 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda37cbf-5678-49f7-a3f0-825ccb83bcbb None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:40:59.997641 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 270/531] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:40:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:40:59.997641 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda37cbf-5678-49f7-a3f0-825ccb83bcbb None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:00.063167 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 262/532] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:40:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:41:00.064082 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48ec91-c331-451e-adfd-8590c823816e None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:00.102914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:00.115177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda37cbf-5678-49f7-a3f0-825ccb83bcbb None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:00.158990 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d77aa-e918-44fb-a84d-dc22c29ad3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:00.160455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d77aa-e918-44fb-a84d-dc22c29ad3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:00.161148 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d77aa-e918-44fb-a84d-dc22c29ad3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:00.161595 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d77aa-e918-44fb-a84d-dc22c29ad3d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:00.171296 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d77aa-e918-44fb-a84d-dc22c29ad3d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:00.172206 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48ec91-c331-451e-adfd-8590c823816e None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:00.173089 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d77aa-e918-44fb-a84d-dc22c29ad3d6 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:00.191639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-fb1d77aa-e918-44fb-a84d-dc22c29ad3d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:00.191639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:00.191639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:00.191639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:00.191639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:00.191639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:00.191639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:00.191639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:00.191639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:00.191639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:00.191639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:00.191639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:00.191639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:00.191639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:00.191639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:00.192721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:00.192721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:00.192721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:00.192721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:00.192721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:00.192721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:00.192721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:00.192721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:00.192721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:00.192721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:00.192721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:00.192721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:00.192721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:00.192721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:00.192721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:00.192721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:00.192721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:00.193705 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:00.193705 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:00.193705 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:00.193705 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:00.193705 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:00.193705 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:00.193705 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:00.193705 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:00.196593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 271/533] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:40:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:00.197697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d77aa-e918-44fb-a84d-dc22c29ad3d6 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:00.214618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:00.216081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5999b1-f8a2-489f-9c23-bab543d91f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:00.216926 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5999b1-f8a2-489f-9c23-bab543d91f01 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:00.217353 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5999b1-f8a2-489f-9c23-bab543d91f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:00.217796 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5999b1-f8a2-489f-9c23-bab543d91f01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:00.218780 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5999b1-f8a2-489f-9c23-bab543d91f01 None admin] RBAC: Adding query filter params (role.id=acb8e1bf2db94178bdd6fc69b191d6b0, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=144e0074ab4d4e5c8743e4f7d68a89b0) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:00.219237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5999b1-f8a2-489f-9c23-bab543d91f01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:00.220841 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5999b1-f8a2-489f-9c23-bab543d91f01 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:00.227026 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 263/534] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:41:00 2022] GET /identity/v3/role_assignments?user.id=144e0074ab4d4e5c8743e4f7d68a89b0&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=acb8e1bf2db94178bdd6fc69b191d6b0 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:00.236231 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5999b1-f8a2-489f-9c23-bab543d91f01 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:00.367302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d77aa-e918-44fb-a84d-dc22c29ad3d6 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:00.368503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:00.374637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5999b1-f8a2-489f-9c23-bab543d91f01 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:00.439800 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1bdce-9a17-4eb8-a411-9fba1b74e88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:00.440916 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1bdce-9a17-4eb8-a411-9fba1b74e88c None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:00.441343 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1bdce-9a17-4eb8-a411-9fba1b74e88c None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:00.441832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1bdce-9a17-4eb8-a411-9fba1b74e88c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:00.451703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08addec-2dd8-4722-9486-6cb3b96bc31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:00.452917 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08addec-2dd8-4722-9486-6cb3b96bc31b None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:00.453364 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08addec-2dd8-4722-9486-6cb3b96bc31b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:00.453791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08addec-2dd8-4722-9486-6cb3b96bc31b None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:00.454734 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08addec-2dd8-4722-9486-6cb3b96bc31b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:00.455187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08addec-2dd8-4722-9486-6cb3b96bc31b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:00.456891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08addec-2dd8-4722-9486-6cb3b96bc31b None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:00.472568 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1bdce-9a17-4eb8-a411-9fba1b74e88c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:00.474228 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1bdce-9a17-4eb8-a411-9fba1b74e88c None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:00.497648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-f8a1bdce-9a17-4eb8-a411-9fba1b74e88c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:00.497648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:00.497648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:00.497648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:00.497648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:00.497648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:00.497648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:00.497648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:00.497648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:00.497648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:00.497648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:00.497648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:00.497648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:00.497648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:00.497648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:00.498694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:00.498694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:00.498694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:00.498694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:00.498694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:00.498694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:00.498694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:00.498694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:00.498694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:00.498694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:00.498694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:00.498694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:00.498694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:00.498694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:00.498694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:00.498694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:00.498694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:00.499825 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:00.499825 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:00.499825 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:00.499825 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:00.502353 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 264/535] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:00.503984 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 272/536] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:00.513368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08addec-2dd8-4722-9486-6cb3b96bc31b None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:00.514382 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1bdce-9a17-4eb8-a411-9fba1b74e88c None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:00.631945 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:00.680493 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08addec-2dd8-4722-9486-6cb3b96bc31b None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:00.705874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1bdce-9a17-4eb8-a411-9fba1b74e88c None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:00.765212 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed1046-27ec-4aaa-bbcc-8c5919fbd2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:00.766358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed1046-27ec-4aaa-bbcc-8c5919fbd2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:00.766942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed1046-27ec-4aaa-bbcc-8c5919fbd2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:00.767444 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed1046-27ec-4aaa-bbcc-8c5919fbd2d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:00.768909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed1046-27ec-4aaa-bbcc-8c5919fbd2d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:00.769785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed1046-27ec-4aaa-bbcc-8c5919fbd2d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:00.771945 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed1046-27ec-4aaa-bbcc-8c5919fbd2d2 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:00.781437 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1f2cb-502c-4e1b-a86b-13abc16e8309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:00.782410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1f2cb-502c-4e1b-a86b-13abc16e8309 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:00.782910 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1f2cb-502c-4e1b-a86b-13abc16e8309 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:00.783378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1f2cb-502c-4e1b-a86b-13abc16e8309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:00.784450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1f2cb-502c-4e1b-a86b-13abc16e8309 None admin] RBAC: Adding query filter params (role.id=acb8e1bf2db94178bdd6fc69b191d6b0, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=5d28208f3127499a98a9d50f8d63ea6b) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:00.784965 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1f2cb-502c-4e1b-a86b-13abc16e8309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:00.786634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1f2cb-502c-4e1b-a86b-13abc16e8309 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:00.798035 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 265/537] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:00.798519 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 273/538] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:41:00 2022] GET /identity/v3/role_assignments?user.id=5d28208f3127499a98a9d50f8d63ea6b&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=acb8e1bf2db94178bdd6fc69b191d6b0 => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:00.815233 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed1046-27ec-4aaa-bbcc-8c5919fbd2d2 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:00.845465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:00.976975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed1046-27ec-4aaa-bbcc-8c5919fbd2d2 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:01.032325 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eb1ba-6c7d-4e73-b4db-2e1dbbfabe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:01.033125 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eb1ba-6c7d-4e73-b4db-2e1dbbfabe49 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:01.033410 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eb1ba-6c7d-4e73-b4db-2e1dbbfabe49 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:01.033686 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eb1ba-6c7d-4e73-b4db-2e1dbbfabe49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:01.048870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35eb1ba-6c7d-4e73-b4db-2e1dbbfabe49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:01.050323 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35eb1ba-6c7d-4e73-b4db-2e1dbbfabe49 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:01.067939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-a35eb1ba-6c7d-4e73-b4db-2e1dbbfabe49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:01.067939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:01.067939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:01.067939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:01.067939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:01.067939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:01.067939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:01.067939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:01.067939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:01.067939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:01.067939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:01.067939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:01.067939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:01.067939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:01.067939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:01.068853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:01.068853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:01.068853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:01.068853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:01.068853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:01.068853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:01.068853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:01.068853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:01.068853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:01.068853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:01.068853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:01.068853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:01.068853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:01.068853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:01.068853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:01.068853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:01.068853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:01.070823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:01.070823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:01.070823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:01.070823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:01.070823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:01.070823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:01.070823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:01.070823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:01.070823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 266/539] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:01.075502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1f2cb-502c-4e1b-a86b-13abc16e8309 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:01.215412 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1f2cb-502c-4e1b-a86b-13abc16e8309 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:01.231277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea4e69-fa37-4854-a722-e3539b7ef6ea None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:01.231843 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea4e69-fa37-4854-a722-e3539b7ef6ea None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:01.232366 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea4e69-fa37-4854-a722-e3539b7ef6ea None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:01.235131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 267/540] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:01.239243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057f604-eb92-414d-9e28-73fefa2b24c0 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:01.239761 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057f604-eb92-414d-9e28-73fefa2b24c0 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:01.240323 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057f604-eb92-414d-9e28-73fefa2b24c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:01.253838 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:01.259199 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-1057f604-eb92-414d-9e28-73fefa2b24c0 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:01.261109 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-1057f604-eb92-414d-9e28-73fefa2b24c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:01.270881 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6865c-a07a-4b34-b745-fafddb8b7c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:01.274710 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6865c-a07a-4b34-b745-fafddb8b7c2c None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:01.274710 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6865c-a07a-4b34-b745-fafddb8b7c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:01.274710 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6865c-a07a-4b34-b745-fafddb8b7c2c None admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:01.275305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6865c-a07a-4b34-b745-fafddb8b7c2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:01.275813 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6865c-a07a-4b34-b745-fafddb8b7c2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:01.278552 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6865c-a07a-4b34-b745-fafddb8b7c2c None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:01.305879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 274/541] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:01.312255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6865c-a07a-4b34-b745-fafddb8b7c2c None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:01.394723 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 268/542] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:41:01.433573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057f604-eb92-414d-9e28-73fefa2b24c0 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:01.446606 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:01.500573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6865c-a07a-4b34-b745-fafddb8b7c2c None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:01.574113 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057f604-eb92-414d-9e28-73fefa2b24c0 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:01.593376 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda864d7-82e3-4902-a5b1-e1e0bc3cafad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:01.594045 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda864d7-82e3-4902-a5b1-e1e0bc3cafad None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:01.594326 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda864d7-82e3-4902-a5b1-e1e0bc3cafad None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:01.594598 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda864d7-82e3-4902-a5b1-e1e0bc3cafad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:01.595441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda864d7-82e3-4902-a5b1-e1e0bc3cafad None admin] RBAC: Adding query filter params (role.id=acb8e1bf2db94178bdd6fc69b191d6b0, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=9090c22ba9f041e2a8d00750d853435a) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:01.595889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda864d7-82e3-4902-a5b1-e1e0bc3cafad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:01.597375 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda864d7-82e3-4902-a5b1-e1e0bc3cafad None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:01.613894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 275/543] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:41:01 2022] GET /identity/v3/role_assignments?user.id=9090c22ba9f041e2a8d00750d853435a&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=acb8e1bf2db94178bdd6fc69b191d6b0 => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:01.614369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbc78f-6977-4361-af67-38b333ec8f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:01.615157 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbc78f-6977-4361-af67-38b333ec8f9f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:01.615435 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbc78f-6977-4361-af67-38b333ec8f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:01.615707 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbc78f-6977-4361-af67-38b333ec8f9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:01.628585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbc78f-6977-4361-af67-38b333ec8f9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:01.637298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-6efbc78f-6977-4361-af67-38b333ec8f9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:01.637298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:01.637298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:01.637298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:01.637298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:01.637298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:01.637298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:01.637298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:01.637298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:01.637298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:01.637298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:01.637298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:01.637298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:01.637298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:01.637298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:01.637298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:01.638437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:01.638437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:01.638437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:01.638437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:01.638437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:01.638437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:01.638437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:01.638437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:01.638437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:01.638437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:01.638437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:01.638437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:01.638437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:01.638437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:01.638437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:01.638437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:01.639666 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:01.639666 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:01.639666 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:01.639666 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:01.639666 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:01.639666 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:01.639666 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:01.639666 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:01.639666 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:01.639666 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:01.639666 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:01.639666 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:01.639666 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 269/544] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:41:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:01.649310 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda864d7-82e3-4902-a5b1-e1e0bc3cafad None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:01.705842 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:01.764478 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda864d7-82e3-4902-a5b1-e1e0bc3cafad None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:01.818311 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b35998-19eb-4bca-a52b-73d299ec632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:01.819002 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b35998-19eb-4bca-a52b-73d299ec632d None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:01.819321 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b35998-19eb-4bca-a52b-73d299ec632d None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:01.819599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b35998-19eb-4bca-a52b-73d299ec632d None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:01.820440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b35998-19eb-4bca-a52b-73d299ec632d None admin] RBAC: Adding query filter params (name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:01.820754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b35998-19eb-4bca-a52b-73d299ec632d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:01.822241 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b35998-19eb-4bca-a52b-73d299ec632d None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:01.831750 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 276/545] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 16:41:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:01.837124 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbc78f-6977-4361-af67-38b333ec8f9f None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:01.915997 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:01.952265 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbc78f-6977-4361-af67-38b333ec8f9f None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:01.994876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12d4b5-93ba-4ad5-b412-a89bd74c02b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:01.995671 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12d4b5-93ba-4ad5-b412-a89bd74c02b7 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:01.995953 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12d4b5-93ba-4ad5-b412-a89bd74c02b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:01.996261 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12d4b5-93ba-4ad5-b412-a89bd74c02b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:02.006788 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff62305-84ef-4e2e-a560-0c20bf2c7b62 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:02.007067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff62305-84ef-4e2e-a560-0c20bf2c7b62 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:02.007346 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff62305-84ef-4e2e-a560-0c20bf2c7b62 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:02.008931 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 277/546] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:02.012134 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12d4b5-93ba-4ad5-b412-a89bd74c02b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:02.014256 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12d4b5-93ba-4ad5-b412-a89bd74c02b7 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:02.021572 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b50617-4f3d-48f8-a79d-d272f6ec7df0 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:02.022130 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b50617-4f3d-48f8-a79d-d272f6ec7df0 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:02.023144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b50617-4f3d-48f8-a79d-d272f6ec7df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:02.032706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-5d12d4b5-93ba-4ad5-b412-a89bd74c02b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:02.032706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:02.032706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:02.032706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:02.032706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:02.032706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:02.032706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:02.032706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:02.032706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:02.032706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:02.032706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:02.032706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:02.032706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:02.032706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:02.032706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:02.033520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:02.033520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:02.033520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:02.033520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:02.033520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:02.033520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:02.033520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:02.033520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:02.033520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:02.033520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:02.033520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:02.033520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:02.033520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:02.033520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:02.033520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:02.033520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:02.033520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:02.035137 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:02.035137 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:02.035137 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:02.035137 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:02.035137 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 270/547] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:02.045184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12d4b5-93ba-4ad5-b412-a89bd74c02b7 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:02.073141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-04b50617-4f3d-48f8-a79d-d272f6ec7df0 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:02.074355 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-04b50617-4f3d-48f8-a79d-d272f6ec7df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:02.151350 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12d4b5-93ba-4ad5-b412-a89bd74c02b7 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:02.174557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:02.189370 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefb116-a2af-45e9-92d6-4ba21ccc346a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:02.192020 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefb116-a2af-45e9-92d6-4ba21ccc346a None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:02.192020 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefb116-a2af-45e9-92d6-4ba21ccc346a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:02.192020 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefb116-a2af-45e9-92d6-4ba21ccc346a None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:02.192620 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefb116-a2af-45e9-92d6-4ba21ccc346a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:02.192865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefb116-a2af-45e9-92d6-4ba21ccc346a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:02.194313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefb116-a2af-45e9-92d6-4ba21ccc346a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:02.209239 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 271/548] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:02.214801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefb116-a2af-45e9-92d6-4ba21ccc346a None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:02.301882 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 278/549] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:41:02.326065 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefb116-a2af-45e9-92d6-4ba21ccc346a None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:02.342341 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b50617-4f3d-48f8-a79d-d272f6ec7df0 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:02.364987 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a78caf-5818-4a9c-b7a4-6856ddd7f156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:02.365783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a78caf-5818-4a9c-b7a4-6856ddd7f156 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:02.366139 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a78caf-5818-4a9c-b7a4-6856ddd7f156 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:02.366399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a78caf-5818-4a9c-b7a4-6856ddd7f156 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:02.374636 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a78caf-5818-4a9c-b7a4-6856ddd7f156 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:02.376148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a78caf-5818-4a9c-b7a4-6856ddd7f156 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:02.394109 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-85a78caf-5818-4a9c-b7a4-6856ddd7f156 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 16:41:02.394109 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:02.394109 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:02.394109 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:02.394109 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:02.394109 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:02.394109 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:02.394109 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:02.394109 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:02.394109 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:02.394109 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:02.394109 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:02.394109 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:02.394109 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:02.394109 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:02.394109 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:02.396387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:02.396387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:02.396387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:02.396387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:02.396387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:02.396387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:02.396387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:02.396387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:02.396387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:02.396387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:02.396387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:02.396387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:02.396387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:02.396387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:02.396387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:02.396387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:02.396387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:02.396387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:02.399246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:02.399246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:02.399246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:02.399246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:02.399246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:02.399246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:02.399246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:02.399246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:02.399246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 16:41:02.399246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:02.399246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 272/550] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:41:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:02.405651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a78caf-5818-4a9c-b7a4-6856ddd7f156 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:02.436382 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:02.461513 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:02.525139 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a78caf-5818-4a9c-b7a4-6856ddd7f156 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:02.544499 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b50617-4f3d-48f8-a79d-d272f6ec7df0 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:02.598873 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc584a6-22a1-4b88-9a8e-2ff33d5356ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:02.599545 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc584a6-22a1-4b88-9a8e-2ff33d5356ef None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:02.599830 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc584a6-22a1-4b88-9a8e-2ff33d5356ef None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:02.600125 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc584a6-22a1-4b88-9a8e-2ff33d5356ef None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:02.601024 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc584a6-22a1-4b88-9a8e-2ff33d5356ef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:02.601334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc584a6-22a1-4b88-9a8e-2ff33d5356ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:02.602776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc584a6-22a1-4b88-9a8e-2ff33d5356ef None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:02.612314 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb82e1-9f33-479d-802e-51d13c609509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:02.613118 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb82e1-9f33-479d-802e-51d13c609509 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:02.613378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb82e1-9f33-479d-802e-51d13c609509 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:02.613663 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb82e1-9f33-479d-802e-51d13c609509 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:02.633030 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb82e1-9f33-479d-802e-51d13c609509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:02.638981 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 273/551] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jun 22 16:41:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:02.640323 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e846e5a-937c-4ed6-8681-2c7282a57cfc None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:02.640613 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e846e5a-937c-4ed6-8681-2c7282a57cfc None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:02.640945 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e846e5a-937c-4ed6-8681-2c7282a57cfc None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:02.642468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 274/552] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:02.645322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-d9fb82e1-9f33-479d-802e-51d13c609509 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:02.645322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:02.645322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:02.645322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:02.645322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:02.645322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:02.645322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:02.645322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:02.645322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:02.645322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:02.645322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:02.645322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:02.645322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:02.645322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:02.645322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:02.645322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:02.648300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:02.648300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:02.648300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:02.648300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:02.648300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:02.648300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:02.648300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:02.648300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:02.648300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:02.648300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:02.648300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:02.648300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:02.648300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:02.648300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:02.648300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:02.648300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:02.650369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:02.650369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:02.650369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:02.650369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:02.650369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:02.650369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:02.650369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:02.650369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:02.650369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:02.650369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:02.650369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:02.650369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:02.651986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e846e5a-937c-4ed6-8681-2c7282a57cfc None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:02.656269 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 279/553] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:41:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:02.656269 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d256c-6cb3-4f54-a65f-f22de0867560 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:02.656269 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d256c-6cb3-4f54-a65f-f22de0867560 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:02.656269 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d256c-6cb3-4f54-a65f-f22de0867560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:02.683252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-f71d256c-6cb3-4f54-a65f-f22de0867560 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:02.685843 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f71d256c-6cb3-4f54-a65f-f22de0867560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:02.766924 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:02.773542 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 280/554] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:41:02.773910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e846e5a-937c-4ed6-8681-2c7282a57cfc None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:02.774790 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d256c-6cb3-4f54-a65f-f22de0867560 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:02.819028 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:02.830901 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a06ec7-31e1-454e-815f-14ae74635f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:02.831693 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a06ec7-31e1-454e-815f-14ae74635f9e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:02.831982 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a06ec7-31e1-454e-815f-14ae74635f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:02.832285 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a06ec7-31e1-454e-815f-14ae74635f9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:02.895592 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d256c-6cb3-4f54-a65f-f22de0867560 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:02.918674 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a06ec7-31e1-454e-815f-14ae74635f9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:02.921278 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a06ec7-31e1-454e-815f-14ae74635f9e None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:02.937173 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc104577-cc88-4ec4-8916-ea50b904b73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:02.938087 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc104577-cc88-4ec4-8916-ea50b904b73b None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:02.938541 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc104577-cc88-4ec4-8916-ea50b904b73b None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:02.939080 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc104577-cc88-4ec4-8916-ea50b904b73b None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:02.939858 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc104577-cc88-4ec4-8916-ea50b904b73b None admin] RBAC: Adding query filter params (name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:02.940220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc104577-cc88-4ec4-8916-ea50b904b73b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:02.941778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc104577-cc88-4ec4-8916-ea50b904b73b None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:02.956058 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 281/555] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 16:41:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:02.956058 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc104577-cc88-4ec4-8916-ea50b904b73b None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:03.037089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:03.042731 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 275/556] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:41:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:41:03.043621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a06ec7-31e1-454e-815f-14ae74635f9e None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:03.058897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:03.065882 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc104577-cc88-4ec4-8916-ea50b904b73b None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:03.100260 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07beb510-c9d3-4fa1-9646-d9129777249c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:03.101447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beb510-c9d3-4fa1-9646-d9129777249c None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:03.101933 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beb510-c9d3-4fa1-9646-d9129777249c None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:03.102442 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07beb510-c9d3-4fa1-9646-d9129777249c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:03.113574 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07beb510-c9d3-4fa1-9646-d9129777249c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:03.121937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-07beb510-c9d3-4fa1-9646-d9129777249c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:03.121937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:03.121937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:03.121937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:03.121937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:03.121937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:03.121937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:03.121937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:03.121937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:03.121937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:03.121937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:03.121937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:03.121937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:03.121937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:03.121937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:03.121937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:03.122958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:03.122958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:03.122958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:03.122958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:03.122958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:03.122958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:03.122958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:03.122958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:03.122958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:03.122958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:03.122958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:03.122958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:03.122958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:03.122958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:03.122958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:03.122958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:03.123776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:03.123776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:03.123776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:03.123776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:03.123776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:03.123776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:03.123776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:03.123776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:03.123776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:03.123776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:03.123776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:03.123776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:03.126546 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 282/557] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:41:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:03.127689 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07beb510-c9d3-4fa1-9646-d9129777249c None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:03.156735 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a06ec7-31e1-454e-815f-14ae74635f9e None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:03.194233 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e0c6c-3ccd-47d0-b230-d82ed41ac9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:03.195011 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e0c6c-3ccd-47d0-b230-d82ed41ac9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:03.195290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e0c6c-3ccd-47d0-b230-d82ed41ac9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:03.195561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e0c6c-3ccd-47d0-b230-d82ed41ac9b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:03.205932 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e0c6c-3ccd-47d0-b230-d82ed41ac9b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:03.207397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e0c6c-3ccd-47d0-b230-d82ed41ac9b7 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:03.224638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-1e7e0c6c-3ccd-47d0-b230-d82ed41ac9b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:03.224638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:03.224638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:03.224638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:03.224638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:03.224638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:03.224638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:03.224638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:03.224638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:03.224638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:03.224638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:03.224638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:03.224638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:03.224638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:03.224638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:03.226533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:03.226533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:03.226533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:03.226533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:03.226533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:03.226533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:03.226533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:03.226533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:03.226533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:03.226533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:03.226533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:03.226533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:03.226533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:03.226533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:03.226533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:03.226533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:03.226533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:03.227420 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:03.227420 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:03.227420 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:03.227420 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:03.227420 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 276/558] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:03.228460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e0c6c-3ccd-47d0-b230-d82ed41ac9b7 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:03.239749 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07beb510-c9d3-4fa1-9646-d9129777249c None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:03.278840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c248bf0-25c3-4cb1-8bda-bffb78a49586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:03.279894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c248bf0-25c3-4cb1-8bda-bffb78a49586 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:03.280210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c248bf0-25c3-4cb1-8bda-bffb78a49586 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:03.280484 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c248bf0-25c3-4cb1-8bda-bffb78a49586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:03.289947 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:03.292480 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c248bf0-25c3-4cb1-8bda-bffb78a49586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:03.294023 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c248bf0-25c3-4cb1-8bda-bffb78a49586 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:03.314455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-6c248bf0-25c3-4cb1-8bda-bffb78a49586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:03.314455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:03.314455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:03.314455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:03.314455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:03.314455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:03.314455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:03.314455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:03.314455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:03.314455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:03.314455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:03.314455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:03.314455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:03.314455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:03.314455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:03.315377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:03.315377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:03.315377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:03.315377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:03.315377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:03.315377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:03.315377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:03.315377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:03.315377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:03.315377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:03.315377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:03.315377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:03.315377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:03.315377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:03.315377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:03.315377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:03.315377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:03.316375 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:03.316375 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:03.316375 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:03.316375 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:03.317421 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 283/559] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:03.320530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd1253-0792-4931-861b-5e47e161e89f None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:03.320797 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd1253-0792-4931-861b-5e47e161e89f None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:03.321076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd1253-0792-4931-861b-5e47e161e89f None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:03.322624 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 284/560] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:03.324672 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd1253-0792-4931-861b-5e47e161e89f None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:03.336980 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:03.352973 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e0c6c-3ccd-47d0-b230-d82ed41ac9b7 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:03.390586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614c114-8d3b-4fdf-8fa3-a90864099266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:03.391280 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614c114-8d3b-4fdf-8fa3-a90864099266 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:03.391566 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614c114-8d3b-4fdf-8fa3-a90864099266 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:03.391846 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614c114-8d3b-4fdf-8fa3-a90864099266 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:03.394392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614c114-8d3b-4fdf-8fa3-a90864099266 None admin] RBAC: Adding query filter params (name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:03.394707 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614c114-8d3b-4fdf-8fa3-a90864099266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:03.396082 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614c114-8d3b-4fdf-8fa3-a90864099266 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:03.404452 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 277/561] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 16:41:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:03.404986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614c114-8d3b-4fdf-8fa3-a90864099266 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:03.445364 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd1253-0792-4931-861b-5e47e161e89f None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:03.481991 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5cf98-e937-445a-bc7a-597afeeecdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:03.482643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5cf98-e937-445a-bc7a-597afeeecdb2 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:03.482927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5cf98-e937-445a-bc7a-597afeeecdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:03.483200 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5cf98-e937-445a-bc7a-597afeeecdb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:03.483924 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5cf98-e937-445a-bc7a-597afeeecdb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:03.484252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5cf98-e937-445a-bc7a-597afeeecdb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:03.485617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5cf98-e937-445a-bc7a-597afeeecdb2 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:03.502679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 285/562] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:03.502679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e7b20-2003-41e9-886c-4936d71e04f1 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:03.502679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e7b20-2003-41e9-886c-4936d71e04f1 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:03.502679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e7b20-2003-41e9-886c-4936d71e04f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:03.516003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614c114-8d3b-4fdf-8fa3-a90864099266 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:03.519362 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-e01e7b20-2003-41e9-886c-4936d71e04f1 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:03.520611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e01e7b20-2003-41e9-886c-4936d71e04f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:03.529709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:03.552487 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf01ec-0ed5-4b05-be43-f81c597fd138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:03.553199 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf01ec-0ed5-4b05-be43-f81c597fd138 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:03.553482 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf01ec-0ed5-4b05-be43-f81c597fd138 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:03.553798 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf01ec-0ed5-4b05-be43-f81c597fd138 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:03.554534 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf01ec-0ed5-4b05-be43-f81c597fd138 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:03.554843 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf01ec-0ed5-4b05-be43-f81c597fd138 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:03.556342 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf01ec-0ed5-4b05-be43-f81c597fd138 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:03.575372 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 278/563] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:03.575372 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf01ec-0ed5-4b05-be43-f81c597fd138 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:03.592463 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:03.601525 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 286/564] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:41:03.602440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e7b20-2003-41e9-886c-4936d71e04f1 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:03.690983 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf01ec-0ed5-4b05-be43-f81c597fd138 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:03.704395 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e7b20-2003-41e9-886c-4936d71e04f1 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:03.728528 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8887e7-a082-4a5f-aa98-c6a0ca11eb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:03.729474 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8887e7-a082-4a5f-aa98-c6a0ca11eb30 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:03.729779 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8887e7-a082-4a5f-aa98-c6a0ca11eb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:03.730030 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8887e7-a082-4a5f-aa98-c6a0ca11eb30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:03.739086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041fe14-be79-4d3e-ae6d-27ead375aa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:03.739876 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041fe14-be79-4d3e-ae6d-27ead375aa67 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:03.740217 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041fe14-be79-4d3e-ae6d-27ead375aa67 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:03.740384 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8887e7-a082-4a5f-aa98-c6a0ca11eb30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:03.740504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041fe14-be79-4d3e-ae6d-27ead375aa67 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:03.742011 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8887e7-a082-4a5f-aa98-c6a0ca11eb30 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:03.747801 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041fe14-be79-4d3e-ae6d-27ead375aa67 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:03.749292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041fe14-be79-4d3e-ae6d-27ead375aa67 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:03.759891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-ea8887e7-a082-4a5f-aa98-c6a0ca11eb30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:03.759891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:03.759891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:03.759891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:03.759891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:03.759891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:03.759891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:03.759891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:03.759891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:03.759891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:03.759891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:03.759891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:03.759891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:03.759891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:03.759891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:03.761013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:03.761013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:03.761013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:03.761013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:03.761013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:03.761013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:03.761013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:03.761013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:03.761013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:03.761013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:03.761013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:03.761013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:03.761013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:03.761013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:03.761013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:03.761013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:03.761013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:03.767061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:03.767061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:03.767061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:03.767061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:03.767061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 279/565] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:03.767061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8887e7-a082-4a5f-aa98-c6a0ca11eb30 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:03.767488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-8041fe14-be79-4d3e-ae6d-27ead375aa67 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 16:41:03.767488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:03.767488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:03.767488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:03.767488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:03.767488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:03.767488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:03.767488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:03.767488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:03.767488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:03.767488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:03.767488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:03.767488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:03.767488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:03.767488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:03.767488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:03.768524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:03.768524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:03.768524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:03.768524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:03.768524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:03.768524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:03.768524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:03.768524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:03.768524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:03.768524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:03.768524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:03.768524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:03.768524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:03.768524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:03.768524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:03.768524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:03.768524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:03.768524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:03.769498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:03.769498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:03.769498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:03.769498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:03.769498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:03.769498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:03.769498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:03.769498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:03.769498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 16:41:03.769498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:03.772999 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 287/566] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jun 22 16:41:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:03.773762 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041fe14-be79-4d3e-ae6d-27ead375aa67 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:03.798491 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:03.830906 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:03.875951 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041fe14-be79-4d3e-ae6d-27ead375aa67 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:03.881845 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8887e7-a082-4a5f-aa98-c6a0ca11eb30 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:03.911398 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6eb332-8571-48d1-ada1-d9cfeb9e361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:03.912217 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6eb332-8571-48d1-ada1-d9cfeb9e361e None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:03.912512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6eb332-8571-48d1-ada1-d9cfeb9e361e None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:03.912841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6eb332-8571-48d1-ada1-d9cfeb9e361e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:03.916377 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17392c-08f0-4e3a-8467-3d0722fd24f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:03.917157 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17392c-08f0-4e3a-8467-3d0722fd24f1 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:03.917437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17392c-08f0-4e3a-8467-3d0722fd24f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:03.917717 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17392c-08f0-4e3a-8467-3d0722fd24f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:03.923306 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6eb332-8571-48d1-ada1-d9cfeb9e361e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:03.924312 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17392c-08f0-4e3a-8467-3d0722fd24f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:03.925736 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17392c-08f0-4e3a-8467-3d0722fd24f1 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:03.930998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-4c6eb332-8571-48d1-ada1-d9cfeb9e361e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:03.930998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:03.930998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:03.930998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:03.930998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:03.930998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:03.930998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:03.930998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:03.930998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:03.930998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:03.930998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:03.930998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:03.930998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:03.930998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:03.930998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:03.930998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:03.932048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:03.932048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:03.932048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:03.932048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:03.932048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:03.932048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:03.932048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:03.932048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:03.932048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:03.932048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:03.932048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:03.932048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:03.932048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:03.932048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:03.932048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:03.932048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:03.932939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:03.932939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:03.932939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:03.932939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:03.932939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:03.932939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:03.932939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:03.932939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:03.932939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:03.932939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:03.932939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:03.932939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:03.932939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 288/567] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:41:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:03.933628 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6eb332-8571-48d1-ada1-d9cfeb9e361e None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:03.939262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-8b17392c-08f0-4e3a-8467-3d0722fd24f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:03.939262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:03.939262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:03.939262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:03.939262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:03.939262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:03.939262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:03.939262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:03.939262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:03.939262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:03.939262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:03.939262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:03.939262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:03.939262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:03.939262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:03.940478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:03.940478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:03.940478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:03.940478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:03.940478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:03.940478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:03.940478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:03.940478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:03.940478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:03.940478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:03.940478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:03.940478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:03.940478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:03.940478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:03.940478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:03.940478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:03.940478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:03.941626 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:03.941626 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:03.941626 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:03.941626 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:03.941626 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:03.941626 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:03.941626 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:03.941626 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:03.946153 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 280/568] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:03.946153 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17392c-08f0-4e3a-8467-3d0722fd24f1 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:04.031434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:04.031598 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6eb332-8571-48d1-ada1-d9cfeb9e361e None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:04.046798 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17392c-08f0-4e3a-8467-3d0722fd24f1 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:04.047783 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:04.063737 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc895b-e1bd-49dc-af6d-a64940ea18b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:04.064575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc895b-e1bd-49dc-af6d-a64940ea18b4 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:04.064930 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc895b-e1bd-49dc-af6d-a64940ea18b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:04.065293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc895b-e1bd-49dc-af6d-a64940ea18b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:04.066089 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc895b-e1bd-49dc-af6d-a64940ea18b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:04.066400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc895b-e1bd-49dc-af6d-a64940ea18b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:04.067793 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc895b-e1bd-49dc-af6d-a64940ea18b4 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:04.079438 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 289/569] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:04.080244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8332df1-63fe-44f7-a659-ab79a8fa71a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:04.080738 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eae58f-d672-4a78-ad6e-0631a14c68e6 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:04.081026 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eae58f-d672-4a78-ad6e-0631a14c68e6 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:04.081308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eae58f-d672-4a78-ad6e-0631a14c68e6 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:04.081574 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8332df1-63fe-44f7-a659-ab79a8fa71a4 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:04.081991 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8332df1-63fe-44f7-a659-ab79a8fa71a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:04.082415 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8332df1-63fe-44f7-a659-ab79a8fa71a4 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:04.082524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 290/570] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:04.083537 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8332df1-63fe-44f7-a659-ab79a8fa71a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:04.084018 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8332df1-63fe-44f7-a659-ab79a8fa71a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:04.086204 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8332df1-63fe-44f7-a659-ab79a8fa71a4 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:04.087811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eae58f-d672-4a78-ad6e-0631a14c68e6 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:04.103383 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 281/571] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jun 22 16:41:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:04.104200 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8332df1-63fe-44f7-a659-ab79a8fa71a4 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:04.187346 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eae58f-d672-4a78-ad6e-0631a14c68e6 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:04.200771 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8332df1-63fe-44f7-a659-ab79a8fa71a4 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:04.220327 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde86c6-57c0-4aba-bc0c-37020d6b63c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:04.220983 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde86c6-57c0-4aba-bc0c-37020d6b63c6 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:04.221265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde86c6-57c0-4aba-bc0c-37020d6b63c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:04.221542 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde86c6-57c0-4aba-bc0c-37020d6b63c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:04.222288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde86c6-57c0-4aba-bc0c-37020d6b63c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:04.222597 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde86c6-57c0-4aba-bc0c-37020d6b63c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:04.223965 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde86c6-57c0-4aba-bc0c-37020d6b63c6 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:04.231649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 291/572] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 16:41:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:04.232447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde86c6-57c0-4aba-bc0c-37020d6b63c6 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:04.238392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f919244-5f92-4b4d-a8b9-36413dbd82be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:04.239040 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f919244-5f92-4b4d-a8b9-36413dbd82be None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:04.239341 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f919244-5f92-4b4d-a8b9-36413dbd82be None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:04.239601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f919244-5f92-4b4d-a8b9-36413dbd82be None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:04.240431 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f919244-5f92-4b4d-a8b9-36413dbd82be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:04.240742 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f919244-5f92-4b4d-a8b9-36413dbd82be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:04.242163 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f919244-5f92-4b4d-a8b9-36413dbd82be None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:04.253551 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 282/573] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:04.254717 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c85f8-1872-4740-a6db-0c70a1231284 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:04.255005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c85f8-1872-4740-a6db-0c70a1231284 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:04.255285 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c85f8-1872-4740-a6db-0c70a1231284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:04.260541 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:04.272977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-7c8c85f8-1872-4740-a6db-0c70a1231284 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:04.274171 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-7c8c85f8-1872-4740-a6db-0c70a1231284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:04.274290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:04.332941 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde86c6-57c0-4aba-bc0c-37020d6b63c6 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:04.339036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 283/574] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:41:04.339845 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c85f8-1872-4740-a6db-0c70a1231284 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:04.376300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eea3c8-4e57-4024-99a9-7778333e7da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:04.377090 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eea3c8-4e57-4024-99a9-7778333e7da8 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:04.377378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eea3c8-4e57-4024-99a9-7778333e7da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:04.377656 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eea3c8-4e57-4024-99a9-7778333e7da8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:04.385624 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eea3c8-4e57-4024-99a9-7778333e7da8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:04.387055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eea3c8-4e57-4024-99a9-7778333e7da8 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:04.401155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-69eea3c8-4e57-4024-99a9-7778333e7da8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 16:41:04.401155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:04.401155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:04.401155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:04.401155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:04.401155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:04.401155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:04.401155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:04.401155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:04.401155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:04.401155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:04.401155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:04.401155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:04.401155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:04.401155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:04.401155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:04.402117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:04.402117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:04.402117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:04.402117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:04.402117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:04.402117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:04.402117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:04.402117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:04.402117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:04.402117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:04.402117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:04.402117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:04.402117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:04.402117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:04.402117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:04.402117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:04.402117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:04.402117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:04.403055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:04.403055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:04.403055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:04.403055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:04.403055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:04.403055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:04.403055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:04.403055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:04.403055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 16:41:04.403055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:04.403055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 292/575] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:41:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:04.403644 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eea3c8-4e57-4024-99a9-7778333e7da8 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:04.440529 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c85f8-1872-4740-a6db-0c70a1231284 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:04.470409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:04.475133 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befac5f-8d41-42f1-8784-c6411a8f2459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:04.475944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befac5f-8d41-42f1-8784-c6411a8f2459 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:04.481556 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befac5f-8d41-42f1-8784-c6411a8f2459 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:04.481556 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befac5f-8d41-42f1-8784-c6411a8f2459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:04.486351 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befac5f-8d41-42f1-8784-c6411a8f2459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:04.487791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befac5f-8d41-42f1-8784-c6411a8f2459 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:04.495461 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:04.499239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eea3c8-4e57-4024-99a9-7778333e7da8 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:04.507290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-5befac5f-8d41-42f1-8784-c6411a8f2459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:04.507290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:04.507290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:04.507290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:04.507290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:04.507290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:04.507290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:04.507290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:04.507290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:04.507290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:04.507290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:04.507290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:04.507290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:04.507290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:04.507290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:04.508228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:04.508228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:04.508228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:04.508228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:04.508228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:04.508228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:04.508228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:04.508228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:04.508228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:04.508228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:04.508228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:04.508228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:04.508228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:04.508228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:04.508228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:04.508228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:04.508228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:04.509128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:04.509128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:04.509128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:04.509128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:04.509128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 284/576] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:04.509128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befac5f-8d41-42f1-8784-c6411a8f2459 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:04.534878 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490fff7-f5e0-437f-ab6c-5b2232ee2686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:04.535661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490fff7-f5e0-437f-ab6c-5b2232ee2686 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:04.535953 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490fff7-f5e0-437f-ab6c-5b2232ee2686 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:04.536266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490fff7-f5e0-437f-ab6c-5b2232ee2686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:04.546420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490fff7-f5e0-437f-ab6c-5b2232ee2686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:04.547887 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490fff7-f5e0-437f-ab6c-5b2232ee2686 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:04.565000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-d490fff7-f5e0-437f-ab6c-5b2232ee2686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:04.565000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:04.565000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:04.565000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:04.565000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:04.565000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:04.565000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:04.565000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:04.565000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:04.565000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:04.565000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:04.565000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:04.565000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:04.565000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:04.565000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:04.566034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:04.566034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:04.566034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:04.566034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:04.566034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:04.566034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:04.566034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:04.566034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:04.566034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:04.566034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:04.566034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:04.566034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:04.566034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:04.566034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:04.566034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:04.566034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:04.566034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:04.572233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:04.572233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:04.572233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:04.572233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:04.572233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 293/577] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:04.572233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490fff7-f5e0-437f-ab6c-5b2232ee2686 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:04.607920 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befac5f-8d41-42f1-8784-c6411a8f2459 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:04.641958 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca223c66-ef91-4221-927f-37bbc57cf77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:04.642602 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca223c66-ef91-4221-927f-37bbc57cf77e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:04.642887 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca223c66-ef91-4221-927f-37bbc57cf77e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:04.643162 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca223c66-ef91-4221-927f-37bbc57cf77e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:04.644001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca223c66-ef91-4221-927f-37bbc57cf77e None admin] RBAC: Adding query filter params (role.id=acb8e1bf2db94178bdd6fc69b191d6b0, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=861452a1dc634bf69ce630d7dcd8a2d7) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:04.644347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca223c66-ef91-4221-927f-37bbc57cf77e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:04.645770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca223c66-ef91-4221-927f-37bbc57cf77e None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:04.651265 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 285/578] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:41:04 2022] GET /identity/v3/role_assignments?user.id=861452a1dc634bf69ce630d7dcd8a2d7&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=acb8e1bf2db94178bdd6fc69b191d6b0 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:04.651837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca223c66-ef91-4221-927f-37bbc57cf77e None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:04.678082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490fff7-f5e0-437f-ab6c-5b2232ee2686 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:04.719494 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71486522-7852-4d6e-b3f0-ff39ebc7babf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:04.720343 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71486522-7852-4d6e-b3f0-ff39ebc7babf None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:04.720631 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71486522-7852-4d6e-b3f0-ff39ebc7babf None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:04.720918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71486522-7852-4d6e-b3f0-ff39ebc7babf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:04.724370 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:04.733799 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71486522-7852-4d6e-b3f0-ff39ebc7babf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:04.742856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-71486522-7852-4d6e-b3f0-ff39ebc7babf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:04.742856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:04.742856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:04.742856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:04.742856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:04.742856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:04.742856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:04.742856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:04.742856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:04.742856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:04.742856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:04.742856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:04.742856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:04.742856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:04.742856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:04.742856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:04.743866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:04.743866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:04.743866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:04.743866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:04.743866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:04.743866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:04.743866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:04.743866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:04.743866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:04.743866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:04.743866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:04.743866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:04.743866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:04.743866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:04.743866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:04.743866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:04.750106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:04.750106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:04.750106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:04.750106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:04.750106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:04.750106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:04.750106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:04.750106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:04.750106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:04.750106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:04.750106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:04.750106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:04.750106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 294/579] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:41:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:04.750106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71486522-7852-4d6e-b3f0-ff39ebc7babf None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:04.763216 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:04.797650 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca223c66-ef91-4221-927f-37bbc57cf77e None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:04.834984 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe7db4-82ba-425c-a690-202e9ac39d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:04.835649 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe7db4-82ba-425c-a690-202e9ac39d10 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:04.835922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe7db4-82ba-425c-a690-202e9ac39d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:04.836408 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe7db4-82ba-425c-a690-202e9ac39d10 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:04.837080 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe7db4-82ba-425c-a690-202e9ac39d10 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:04.837392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe7db4-82ba-425c-a690-202e9ac39d10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:04.838806 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe7db4-82ba-425c-a690-202e9ac39d10 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:04.861401 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 286/580] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jun 22 16:41:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:04.861401 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe7db4-82ba-425c-a690-202e9ac39d10 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:04.866920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71486522-7852-4d6e-b3f0-ff39ebc7babf None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:04.901568 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9624a2-8a38-4afb-b3b8-eb602c46b0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:04.902228 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9624a2-8a38-4afb-b3b8-eb602c46b0ec None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:04.902522 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9624a2-8a38-4afb-b3b8-eb602c46b0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:04.902800 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9624a2-8a38-4afb-b3b8-eb602c46b0ec None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:04.903529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9624a2-8a38-4afb-b3b8-eb602c46b0ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:04.903840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9624a2-8a38-4afb-b3b8-eb602c46b0ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:04.905265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9624a2-8a38-4afb-b3b8-eb602c46b0ec None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:04.919309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 295/581] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:04.920326 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9624a2-8a38-4afb-b3b8-eb602c46b0ec None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:04.969614 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe7db4-82ba-425c-a690-202e9ac39d10 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:04.977377 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:04.992049 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:05.010097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c82343-3da8-4abc-b8f1-5b59fffcefac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:05.010754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c82343-3da8-4abc-b8f1-5b59fffcefac None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:05.011035 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c82343-3da8-4abc-b8f1-5b59fffcefac None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:05.011309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c82343-3da8-4abc-b8f1-5b59fffcefac None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:05.012701 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c82343-3da8-4abc-b8f1-5b59fffcefac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:05.012934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c82343-3da8-4abc-b8f1-5b59fffcefac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:05.014608 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c82343-3da8-4abc-b8f1-5b59fffcefac None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:05.031440 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 287/582] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:05.031440 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c82343-3da8-4abc-b8f1-5b59fffcefac None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:05.034284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9624a2-8a38-4afb-b3b8-eb602c46b0ec None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:05.070774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443be19-3b45-4be8-9ace-288bd9ea64e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:05.071446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443be19-3b45-4be8-9ace-288bd9ea64e3 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:05.071734 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443be19-3b45-4be8-9ace-288bd9ea64e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:05.072020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443be19-3b45-4be8-9ace-288bd9ea64e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:05.072844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443be19-3b45-4be8-9ace-288bd9ea64e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:05.073159 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443be19-3b45-4be8-9ace-288bd9ea64e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:05.074539 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443be19-3b45-4be8-9ace-288bd9ea64e3 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:05.083061 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 296/583] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 16:41:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:05.083950 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443be19-3b45-4be8-9ace-288bd9ea64e3 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:05.143279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c82343-3da8-4abc-b8f1-5b59fffcefac None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:05.179539 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07bb6c-6d3f-4cc6-a840-e7e9261c605c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:05.180463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07bb6c-6d3f-4cc6-a840-e7e9261c605c None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:05.180753 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07bb6c-6d3f-4cc6-a840-e7e9261c605c None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:05.181029 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07bb6c-6d3f-4cc6-a840-e7e9261c605c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:05.186064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443be19-3b45-4be8-9ace-288bd9ea64e3 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:05.192563 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07bb6c-6d3f-4cc6-a840-e7e9261c605c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:05.194188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07bb6c-6d3f-4cc6-a840-e7e9261c605c None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:05.212675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-2f07bb6c-6d3f-4cc6-a840-e7e9261c605c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:05.212675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:05.212675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:05.212675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:05.212675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:05.212675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:05.212675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:05.212675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:05.212675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:05.212675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:05.212675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:05.212675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:05.212675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:05.212675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:05.212675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:05.213765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:05.213765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:05.213765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:05.213765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:05.213765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:05.213765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:05.213765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:05.213765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:05.213765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:05.213765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:05.213765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:05.213765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:05.213765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:05.213765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:05.213765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:05.213765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:05.213765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:05.214965 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:05.214965 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:05.214965 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:05.214965 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:05.218409 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:05.218687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 288/584] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:05.219909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07bb6c-6d3f-4cc6-a840-e7e9261c605c None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:05.222462 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bfe72-f61d-4ae0-863c-3665871126f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:05.223252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bfe72-f61d-4ae0-863c-3665871126f8 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:05.223539 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bfe72-f61d-4ae0-863c-3665871126f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:05.223831 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bfe72-f61d-4ae0-863c-3665871126f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:05.231626 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13bfe72-f61d-4ae0-863c-3665871126f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:05.233506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13bfe72-f61d-4ae0-863c-3665871126f8 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:05.240801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:05.248067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-d13bfe72-f61d-4ae0-863c-3665871126f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:05.248067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:05.248067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:05.248067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:05.248067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:05.248067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:05.248067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:05.248067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:05.248067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:05.248067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:05.248067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:05.248067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:05.248067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:05.248067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:05.248067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:05.248957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:05.248957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:05.248957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:05.248957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:05.248957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:05.248957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:05.248957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:05.248957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:05.248957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:05.248957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:05.248957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:05.248957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:05.248957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:05.248957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:05.248957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:05.248957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:05.248957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:05.249854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:05.249854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:05.249854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:05.249854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:05.249854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:05.249854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:05.249854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:05.249854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:05.249854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 297/585] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:05.250343 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bfe72-f61d-4ae0-863c-3665871126f8 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:05.328816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07bb6c-6d3f-4cc6-a840-e7e9261c605c None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:05.357663 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bfe72-f61d-4ae0-863c-3665871126f8 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:05.364528 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9b7ee-bdc0-45b2-b836-a4448f36cada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:05.365316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9b7ee-bdc0-45b2-b836-a4448f36cada None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:05.365601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9b7ee-bdc0-45b2-b836-a4448f36cada None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:05.365922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9b7ee-bdc0-45b2-b836-a4448f36cada None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:05.377976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9b7ee-bdc0-45b2-b836-a4448f36cada None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:05.379446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9b7ee-bdc0-45b2-b836-a4448f36cada None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:05.392594 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e4f9d-1ad3-4ac6-95fd-1320b71ef0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:05.393677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e4f9d-1ad3-4ac6-95fd-1320b71ef0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:05.394142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e4f9d-1ad3-4ac6-95fd-1320b71ef0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:05.394613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e4f9d-1ad3-4ac6-95fd-1320b71ef0d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:05.398316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-7fd9b7ee-bdc0-45b2-b836-a4448f36cada None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 16:41:05.398316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:05.398316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:05.398316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:05.398316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:05.398316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:05.398316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:05.398316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:05.398316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:05.398316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:05.398316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:05.398316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:05.398316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:05.398316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:05.398316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:05.398316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:05.399228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:05.399228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:05.399228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:05.399228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:05.399228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:05.399228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:05.399228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:05.399228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:05.399228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:05.399228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:05.399228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:05.399228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:05.399228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:05.399228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:05.399228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:05.399228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:05.399228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:05.399228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:05.400205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:05.400205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:05.400205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:05.400205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:05.400205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:05.400205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:05.400205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:05.400205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:05.400205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 16:41:05.400205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:05.400205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 289/586] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:41:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:05.400800 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9b7ee-bdc0-45b2-b836-a4448f36cada None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:05.410140 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e4f9d-1ad3-4ac6-95fd-1320b71ef0d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:05.411938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e4f9d-1ad3-4ac6-95fd-1320b71ef0d5 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:05.430877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-409e4f9d-1ad3-4ac6-95fd-1320b71ef0d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:05.430877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:05.430877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:05.430877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:05.430877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:05.430877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:05.430877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:05.430877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:05.430877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:05.430877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:05.430877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:05.430877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:05.430877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:05.430877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:05.430877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:05.431772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:05.431772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:05.431772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:05.431772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:05.431772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:05.431772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:05.431772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:05.431772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:05.431772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:05.431772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:05.431772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:05.431772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:05.431772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:05.431772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:05.431772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:05.431772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:05.431772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:05.432702 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:05.432702 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:05.432702 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:05.432702 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:05.438913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 298/587] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:05.440418 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e4f9d-1ad3-4ac6-95fd-1320b71ef0d5 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:05.486838 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:05.488008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:05.509284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9b7ee-bdc0-45b2-b836-a4448f36cada None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:05.543311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132bfc3-066e-4286-9aa7-e8180167dc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:05.544155 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132bfc3-066e-4286-9aa7-e8180167dc34 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:05.544612 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132bfc3-066e-4286-9aa7-e8180167dc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:05.544786 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e4f9d-1ad3-4ac6-95fd-1320b71ef0d5 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:05.544947 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132bfc3-066e-4286-9aa7-e8180167dc34 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:05.546051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132bfc3-066e-4286-9aa7-e8180167dc34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:05.546367 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132bfc3-066e-4286-9aa7-e8180167dc34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:05.547740 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132bfc3-066e-4286-9aa7-e8180167dc34 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:05.560143 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 290/588] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:05.560686 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132bfc3-066e-4286-9aa7-e8180167dc34 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:05.585437 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f88a63-d0d0-4dfa-825c-001e8941da34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:05.586213 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f88a63-d0d0-4dfa-825c-001e8941da34 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:05.586497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f88a63-d0d0-4dfa-825c-001e8941da34 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:05.586777 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f88a63-d0d0-4dfa-825c-001e8941da34 None admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:05.587561 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f88a63-d0d0-4dfa-825c-001e8941da34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:05.587878 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f88a63-d0d0-4dfa-825c-001e8941da34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:05.589585 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f88a63-d0d0-4dfa-825c-001e8941da34 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:05.601519 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 299/589] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:05.602316 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f88a63-d0d0-4dfa-825c-001e8941da34 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:05.676890 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132bfc3-066e-4286-9aa7-e8180167dc34 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:05.711617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f88a63-d0d0-4dfa-825c-001e8941da34 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:05.713685 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9f77b-8572-42dd-b678-ed9f602540ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:05.714016 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:05.715295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9f77b-8572-42dd-b678-ed9f602540ac None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:05.715295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9f77b-8572-42dd-b678-ed9f602540ac None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:05.715295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9f77b-8572-42dd-b678-ed9f602540ac None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:05.715825 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9f77b-8572-42dd-b678-ed9f602540ac None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:05.716026 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9f77b-8572-42dd-b678-ed9f602540ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:05.717488 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9f77b-8572-42dd-b678-ed9f602540ac None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:05.725817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:05.738267 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 291/590] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jun 22 16:41:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:05.739138 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9f77b-8572-42dd-b678-ed9f602540ac None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:05.754116 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cc2b8-d513-4716-814e-5c2863c4b9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:05.754785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cc2b8-d513-4716-814e-5c2863c4b9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:05.755071 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cc2b8-d513-4716-814e-5c2863c4b9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:05.755350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cc2b8-d513-4716-814e-5c2863c4b9f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:05.756079 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8cc2b8-d513-4716-814e-5c2863c4b9f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:05.756418 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8cc2b8-d513-4716-814e-5c2863c4b9f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:05.758292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8cc2b8-d513-4716-814e-5c2863c4b9f9 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:05.775488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 300/591] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:05.775488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cc2b8-d513-4716-814e-5c2863c4b9f9 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:05.852259 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9f77b-8572-42dd-b678-ed9f602540ac None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:05.884078 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cc2b8-d513-4716-814e-5c2863c4b9f9 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:05.886297 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd2067-b6b2-4ea6-9c01-3d76591231b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:05.887085 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd2067-b6b2-4ea6-9c01-3d76591231b5 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:05.887624 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd2067-b6b2-4ea6-9c01-3d76591231b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:05.887905 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd2067-b6b2-4ea6-9c01-3d76591231b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:05.894575 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd2067-b6b2-4ea6-9c01-3d76591231b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:05.896025 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd2067-b6b2-4ea6-9c01-3d76591231b5 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:05.909542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-89bd2067-b6b2-4ea6-9c01-3d76591231b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:05.909542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:05.909542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:05.909542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:05.909542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:05.909542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:05.909542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:05.909542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:05.909542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:05.909542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:05.909542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:05.909542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:05.909542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:05.909542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:05.909542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:05.910447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:05.910447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:05.910447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:05.910447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:05.910447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:05.910447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:05.910447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:05.910447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:05.910447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:05.910447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:05.910447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:05.910447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:05.910447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:05.910447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:05.910447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:05.910447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:05.910447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:05.911368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:05.911368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:05.911368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:05.911368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:05.911368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:05.911368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:05.911368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:05.911368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:05.911368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 292/592] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:05.911882 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd2067-b6b2-4ea6-9c01-3d76591231b5 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:05.926108 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d7ecb-0704-4a9c-a72f-a5dc04c79101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:05.927036 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d7ecb-0704-4a9c-a72f-a5dc04c79101 None admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:05.927329 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d7ecb-0704-4a9c-a72f-a5dc04c79101 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:05.927548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d7ecb-0704-4a9c-a72f-a5dc04c79101 None admin] PATH_INFO: `/v3/projects/59d78923fdef459abaf240bd0975494a/users/78e7bdfffdc84465a570d135d1d86380/roles/acb8e1bf2db94178bdd6fc69b191d6b0` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:05.942362 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d7ecb-0704-4a9c-a72f-a5dc04c79101 None admin] RBAC: Authorizing `identity:create_grant(project_id=59d78923fdef459abaf240bd0975494a, user_id=78e7bdfffdc84465a570d135d1d86380, role_id=acb8e1bf2db94178bdd6fc69b191d6b0)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:05.943913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d7ecb-0704-4a9c-a72f-a5dc04c79101 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:05.970270 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:06.008137 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 301/593] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:41:05 2022] PUT /identity/v3/projects/59d78923fdef459abaf240bd0975494a/users/78e7bdfffdc84465a570d135d1d86380/roles/acb8e1bf2db94178bdd6fc69b191d6b0 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:41:06.008137 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d7ecb-0704-4a9c-a72f-a5dc04c79101 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:06.022902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd2067-b6b2-4ea6-9c01-3d76591231b5 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:06.051652 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:06.070351 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6d49c-07f8-4666-9d33-fea7b215080c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:06.072258 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6d49c-07f8-4666-9d33-fea7b215080c None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:06.072816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6d49c-07f8-4666-9d33-fea7b215080c None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:06.073352 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6d49c-07f8-4666-9d33-fea7b215080c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:06.091229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6d49c-07f8-4666-9d33-fea7b215080c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:06.093799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6d49c-07f8-4666-9d33-fea7b215080c None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:06.120792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-bae6d49c-07f8-4666-9d33-fea7b215080c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:06.120792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:06.120792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:06.120792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:06.120792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:06.120792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:06.120792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:06.120792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:06.120792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:06.120792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:06.120792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:06.120792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:06.120792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:06.120792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:06.120792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:06.121754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:06.121754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:06.121754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:06.121754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:06.121754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:06.121754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:06.121754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:06.121754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:06.121754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:06.121754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:06.121754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:06.121754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:06.121754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:06.121754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:06.121754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:06.121754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:06.121754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:06.122651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:06.122651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:06.122651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:06.122651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:06.129827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 293/594] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:06.129827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6d49c-07f8-4666-9d33-fea7b215080c None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:06.169144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d7ecb-0704-4a9c-a72f-a5dc04c79101 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:06.214038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e635d0-d598-4928-8430-d8d2ce81f9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:06.214762 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e635d0-d598-4928-8430-d8d2ce81f9bd None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:06.215040 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e635d0-d598-4928-8430-d8d2ce81f9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:06.215316 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e635d0-d598-4928-8430-d8d2ce81f9bd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:06.223527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e635d0-d598-4928-8430-d8d2ce81f9bd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:06.226059 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e635d0-d598-4928-8430-d8d2ce81f9bd None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:06.245325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-a7e635d0-d598-4928-8430-d8d2ce81f9bd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 16:41:06.245325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:06.245325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:06.245325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:06.245325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:06.245325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:06.245325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:06.245325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:06.245325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:06.245325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:06.245325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:06.245325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:06.245325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:06.245325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:06.245325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:06.245325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:06.246328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:06.246328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:06.246328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:06.246328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:06.246328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:06.246328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:06.246328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:06.246328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:06.246328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:06.246328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:06.246328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:06.246328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:06.246328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:06.246328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:06.246328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:06.246328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:06.246328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:06.246328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:06.247266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:06.247266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:06.247266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:06.247266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:06.247266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:06.247266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:06.247266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:06.247266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:06.247266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 16:41:06.247266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:06.247266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 302/595] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:41:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:06.247876 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e635d0-d598-4928-8430-d8d2ce81f9bd None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:06.262083 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6d49c-07f8-4666-9d33-fea7b215080c None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:06.272843 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:06.299047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d28d5-196a-4135-9e40-c009d9a2ef0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:06.299980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d28d5-196a-4135-9e40-c009d9a2ef0c None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:06.300439 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d28d5-196a-4135-9e40-c009d9a2ef0c None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:06.300861 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d28d5-196a-4135-9e40-c009d9a2ef0c None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:06.301803 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d28d5-196a-4135-9e40-c009d9a2ef0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:06.302260 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d28d5-196a-4135-9e40-c009d9a2ef0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:06.304516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d28d5-196a-4135-9e40-c009d9a2ef0c None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:06.318148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 294/596] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:06.319216 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d28d5-196a-4135-9e40-c009d9a2ef0c None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:06.341972 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:06.368404 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e635d0-d598-4928-8430-d8d2ce81f9bd None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:06.404724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324e143-4285-4411-9dbf-26e407df4a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:06.405393 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324e143-4285-4411-9dbf-26e407df4a3e None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:06.405725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324e143-4285-4411-9dbf-26e407df4a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:06.406005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324e143-4285-4411-9dbf-26e407df4a3e None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:06.406739 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324e143-4285-4411-9dbf-26e407df4a3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:06.407046 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324e143-4285-4411-9dbf-26e407df4a3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:06.408450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324e143-4285-4411-9dbf-26e407df4a3e None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:06.424240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 303/597] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:06.425262 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324e143-4285-4411-9dbf-26e407df4a3e None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:06.426555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d28d5-196a-4135-9e40-c009d9a2ef0c None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:06.462791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e388b0-620b-4833-bcdd-2d0098da79e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:06.463737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e388b0-620b-4833-bcdd-2d0098da79e4 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:06.464263 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e388b0-620b-4833-bcdd-2d0098da79e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:06.464741 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e388b0-620b-4833-bcdd-2d0098da79e4 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:06.465732 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e388b0-620b-4833-bcdd-2d0098da79e4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:06.466186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e388b0-620b-4833-bcdd-2d0098da79e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:06.467779 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e388b0-620b-4833-bcdd-2d0098da79e4 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:06.486753 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 295/598] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Jun 22 16:41:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:06.487810 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e388b0-620b-4833-bcdd-2d0098da79e4 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:06.516547 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:06.539702 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324e143-4285-4411-9dbf-26e407df4a3e None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:06.576840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559270f-2415-48bd-87c2-296cabe00351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:06.577787 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559270f-2415-48bd-87c2-296cabe00351 None admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:06.578083 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559270f-2415-48bd-87c2-296cabe00351 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:06.578364 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559270f-2415-48bd-87c2-296cabe00351 None admin] PATH_INFO: `/v3/projects/59d78923fdef459abaf240bd0975494a/users/144e0074ab4d4e5c8743e4f7d68a89b0/roles/acb8e1bf2db94178bdd6fc69b191d6b0` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:06.580945 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:06.594644 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559270f-2415-48bd-87c2-296cabe00351 None admin] RBAC: Authorizing `identity:create_grant(project_id=59d78923fdef459abaf240bd0975494a, user_id=144e0074ab4d4e5c8743e4f7d68a89b0, role_id=acb8e1bf2db94178bdd6fc69b191d6b0)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:06.595505 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e388b0-620b-4833-bcdd-2d0098da79e4 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:06.596185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559270f-2415-48bd-87c2-296cabe00351 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:06.631544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e08291-9613-4739-8074-2c0b9d558170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:06.632824 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e08291-9613-4739-8074-2c0b9d558170 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:06.633243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e08291-9613-4739-8074-2c0b9d558170 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:06.633667 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e08291-9613-4739-8074-2c0b9d558170 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:06.641222 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e08291-9613-4739-8074-2c0b9d558170 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:06.642660 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e08291-9613-4739-8074-2c0b9d558170 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:06.656862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-56e08291-9613-4739-8074-2c0b9d558170 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:06.656862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:06.656862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:06.656862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:06.656862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:06.656862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:06.656862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:06.656862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:06.656862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:06.656862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:06.656862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:06.656862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:06.656862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:06.656862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:06.656862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:06.657775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:06.657775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:06.657775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:06.657775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:06.657775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:06.657775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:06.657775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:06.657775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:06.657775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:06.657775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:06.657775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:06.657775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:06.657775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:06.657775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:06.657775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:06.657775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:06.657775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:06.658669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:06.658669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:06.658669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:06.658669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:06.658669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:06.658669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:06.658669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:06.658669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:06.658669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 296/599] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:06.659162 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e08291-9613-4739-8074-2c0b9d558170 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:06.680923 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 304/600] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:41:06 2022] PUT /identity/v3/projects/59d78923fdef459abaf240bd0975494a/users/144e0074ab4d4e5c8743e4f7d68a89b0/roles/acb8e1bf2db94178bdd6fc69b191d6b0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:41:06.681755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559270f-2415-48bd-87c2-296cabe00351 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:06.782976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:06.804282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e08291-9613-4739-8074-2c0b9d558170 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:06.824520 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559270f-2415-48bd-87c2-296cabe00351 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:06.854711 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbc0cb-e281-40e0-ae11-43fc858fd42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:06.855508 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbc0cb-e281-40e0-ae11-43fc858fd42b None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:06.855799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbc0cb-e281-40e0-ae11-43fc858fd42b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:06.856087 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbc0cb-e281-40e0-ae11-43fc858fd42b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:06.869695 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb61a4-e658-4b21-8f56-b00a7762e639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:06.870604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb61a4-e658-4b21-8f56-b00a7762e639 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:06.870604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb61a4-e658-4b21-8f56-b00a7762e639 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:06.870769 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbc0cb-e281-40e0-ae11-43fc858fd42b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:06.870865 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb61a4-e658-4b21-8f56-b00a7762e639 None admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:06.871468 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb61a4-e658-4b21-8f56-b00a7762e639 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:06.871786 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb61a4-e658-4b21-8f56-b00a7762e639 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:06.871880 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbc0cb-e281-40e0-ae11-43fc858fd42b None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:06.873304 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb61a4-e658-4b21-8f56-b00a7762e639 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:06.888096 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 305/601] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:06.889345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344fe28-85d7-4a5b-82d9-d3234ee0bd01 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:06.889641 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344fe28-85d7-4a5b-82d9-d3234ee0bd01 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:06.889922 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344fe28-85d7-4a5b-82d9-d3234ee0bd01 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:06.891266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 306/602] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:06.895201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-9fcbc0cb-e281-40e0-ae11-43fc858fd42b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:06.895201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:06.895201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:06.895201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:06.895201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:06.895201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:06.895201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:06.895201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:06.895201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:06.895201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:06.895201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:06.895201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:06.895201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:06.895201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:06.895201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:06.896098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:06.896098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:06.896098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:06.896098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:06.896098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:06.896098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:06.896098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:06.896098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:06.896098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:06.896098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:06.896098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:06.896098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:06.896098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:06.896098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:06.896098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:06.896098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:06.896098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:06.897030 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:06.897030 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:06.897030 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:06.897030 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:06.897030 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 297/603] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:06.897348 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344fe28-85d7-4a5b-82d9-d3234ee0bd01 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:06.901192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbc0cb-e281-40e0-ae11-43fc858fd42b None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:06.960641 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:07.028869 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344fe28-85d7-4a5b-82d9-d3234ee0bd01 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:07.037513 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbc0cb-e281-40e0-ae11-43fc858fd42b None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:07.072250 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5b400-f351-4b89-bb24-7b98078a3e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:07.073948 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5b400-f351-4b89-bb24-7b98078a3e37 None admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:07.074413 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5b400-f351-4b89-bb24-7b98078a3e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:07.074987 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5b400-f351-4b89-bb24-7b98078a3e37 None admin] PATH_INFO: `/v3/projects/59d78923fdef459abaf240bd0975494a/users/5d28208f3127499a98a9d50f8d63ea6b/roles/acb8e1bf2db94178bdd6fc69b191d6b0` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:07.081780 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb76d23-8101-48a6-b63f-7d44f5ab3948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:07.082525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb76d23-8101-48a6-b63f-7d44f5ab3948 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:07.082886 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb76d23-8101-48a6-b63f-7d44f5ab3948 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:07.083240 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb76d23-8101-48a6-b63f-7d44f5ab3948 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:07.084119 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb76d23-8101-48a6-b63f-7d44f5ab3948 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:07.084512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb76d23-8101-48a6-b63f-7d44f5ab3948 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:07.086528 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb76d23-8101-48a6-b63f-7d44f5ab3948 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:07.093534 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5b400-f351-4b89-bb24-7b98078a3e37 None admin] RBAC: Authorizing `identity:create_grant(project_id=59d78923fdef459abaf240bd0975494a, user_id=5d28208f3127499a98a9d50f8d63ea6b, role_id=acb8e1bf2db94178bdd6fc69b191d6b0)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:07.095228 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5b400-f351-4b89-bb24-7b98078a3e37 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:07.095652 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:07.107881 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 298/604] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:07.107881 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cdbb2-8ad9-4828-b163-5ab13b686a02 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:07.107881 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cdbb2-8ad9-4828-b163-5ab13b686a02 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:07.107881 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419cdbb2-8ad9-4828-b163-5ab13b686a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:07.124368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-419cdbb2-8ad9-4828-b163-5ab13b686a02 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:07.125566 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-419cdbb2-8ad9-4828-b163-5ab13b686a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:07.196136 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 299/605] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:41:07.196991 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cdbb2-8ad9-4828-b163-5ab13b686a02 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:07.201251 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 307/606] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:41:06 2022] PUT /identity/v3/projects/59d78923fdef459abaf240bd0975494a/users/5d28208f3127499a98a9d50f8d63ea6b/roles/acb8e1bf2db94178bdd6fc69b191d6b0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:41:07.256064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5b400-f351-4b89-bb24-7b98078a3e37 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:07.361918 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419cdbb2-8ad9-4828-b163-5ab13b686a02 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:07.424764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:07.425371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:07.432929 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5b400-f351-4b89-bb24-7b98078a3e37 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:07.440622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119d20f-83b3-4f15-b457-2d463387f73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:07.442140 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119d20f-83b3-4f15-b457-2d463387f73b None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:07.442570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119d20f-83b3-4f15-b457-2d463387f73b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:07.443443 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119d20f-83b3-4f15-b457-2d463387f73b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:07.455073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119d20f-83b3-4f15-b457-2d463387f73b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:07.457351 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119d20f-83b3-4f15-b457-2d463387f73b None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:07.476156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-8119d20f-83b3-4f15-b457-2d463387f73b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:07.476156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:07.476156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:07.476156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:07.476156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:07.476156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:07.476156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:07.476156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:07.476156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:07.476156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:07.476156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:07.476156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:07.476156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:07.476156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:07.476156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:07.477076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:07.477076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:07.477076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:07.477076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:07.477076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:07.477076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:07.477076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:07.477076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:07.477076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:07.477076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:07.477076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:07.477076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:07.477076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:07.477076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:07.477076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:07.477076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:07.477076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:07.477959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:07.477959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:07.477959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:07.477959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:07.477959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:07.477959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:07.477959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:07.477959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:07.478387 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191ee2a-2d2f-4503-8057-eb4b1a98a453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:07.478387 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191ee2a-2d2f-4503-8057-eb4b1a98a453 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:07.478387 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191ee2a-2d2f-4503-8057-eb4b1a98a453 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:07.478387 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191ee2a-2d2f-4503-8057-eb4b1a98a453 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:07.481044 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 300/607] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:07.487224 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119d20f-83b3-4f15-b457-2d463387f73b None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:07.494021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191ee2a-2d2f-4503-8057-eb4b1a98a453 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:07.504554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-7191ee2a-2d2f-4503-8057-eb4b1a98a453 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:07.504554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:07.504554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:07.504554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:07.504554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:07.504554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:07.504554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:07.504554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:07.504554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:07.504554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:07.504554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:07.504554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:07.504554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:07.504554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:07.504554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:07.504554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:07.505535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:07.505535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:07.505535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:07.505535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:07.505535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:07.505535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:07.505535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:07.505535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:07.505535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:07.505535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:07.505535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:07.505535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:07.505535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:07.505535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:07.505535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:07.505535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:07.506370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:07.506370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:07.506370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:07.506370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:07.506370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:07.506370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:07.506370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:07.506370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:07.506370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:07.506370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:07.506370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:07.506370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:07.506370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 308/608] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:41:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:07.512040 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191ee2a-2d2f-4503-8057-eb4b1a98a453 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:07.624979 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119d20f-83b3-4f15-b457-2d463387f73b None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:07.661269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d48b88-be59-403e-b365-4c558282586a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:07.661948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d48b88-be59-403e-b365-4c558282586a None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:07.662222 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d48b88-be59-403e-b365-4c558282586a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:07.662502 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d48b88-be59-403e-b365-4c558282586a None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:07.663876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d48b88-be59-403e-b365-4c558282586a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:07.664214 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d48b88-be59-403e-b365-4c558282586a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:07.665712 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d48b88-be59-403e-b365-4c558282586a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:07.678601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 301/609] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:07.684502 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d48b88-be59-403e-b365-4c558282586a None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:07.703850 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191ee2a-2d2f-4503-8057-eb4b1a98a453 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:07.740182 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:07.797381 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5ac76-db89-4482-b029-e7670575f04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:07.798065 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5ac76-db89-4482-b029-e7670575f04c None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:07.798355 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5ac76-db89-4482-b029-e7670575f04c None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:07.798457 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d48b88-be59-403e-b365-4c558282586a None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:07.798863 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5ac76-db89-4482-b029-e7670575f04c None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:07.799401 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5ac76-db89-4482-b029-e7670575f04c None admin] RBAC: Adding query filter params (name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:07.799715 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5ac76-db89-4482-b029-e7670575f04c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:07.801148 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5ac76-db89-4482-b029-e7670575f04c None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:07.819600 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 309/610] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 16:41:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:07.825242 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5ac76-db89-4482-b029-e7670575f04c None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:07.837996 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb25fd-9727-4428-908f-3857738782a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:07.838929 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb25fd-9727-4428-908f-3857738782a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:07.839217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb25fd-9727-4428-908f-3857738782a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:07.839920 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb25fd-9727-4428-908f-3857738782a9 None admin] PATH_INFO: `/v3/projects/59d78923fdef459abaf240bd0975494a/users/9090c22ba9f041e2a8d00750d853435a/roles/acb8e1bf2db94178bdd6fc69b191d6b0` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:07.856937 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb25fd-9727-4428-908f-3857738782a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=59d78923fdef459abaf240bd0975494a, user_id=9090c22ba9f041e2a8d00750d853435a, role_id=acb8e1bf2db94178bdd6fc69b191d6b0)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:07.858399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb25fd-9727-4428-908f-3857738782a9 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:07.864685 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:07.956935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5ac76-db89-4482-b029-e7670575f04c None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:07.986623 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 302/611] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:41:07 2022] PUT /identity/v3/projects/59d78923fdef459abaf240bd0975494a/users/9090c22ba9f041e2a8d00750d853435a/roles/acb8e1bf2db94178bdd6fc69b191d6b0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 16:41:07.995717 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02307b29-f64d-475a-b4a3-62bfd5e05915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:07.996608 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02307b29-f64d-475a-b4a3-62bfd5e05915 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:07.996898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02307b29-f64d-475a-b4a3-62bfd5e05915 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:07.997175 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02307b29-f64d-475a-b4a3-62bfd5e05915 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:08.010630 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02307b29-f64d-475a-b4a3-62bfd5e05915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:08.012148 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02307b29-f64d-475a-b4a3-62bfd5e05915 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:08.051584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-02307b29-f64d-475a-b4a3-62bfd5e05915 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:08.051584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:08.051584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:08.051584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:08.051584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:08.051584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:08.051584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:08.051584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:08.051584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:08.051584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:08.051584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:08.051584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:08.051584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:08.051584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:08.051584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:08.054086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:08.054086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:08.054086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:08.054086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:08.054086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:08.054086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:08.054086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:08.054086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:08.054086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:08.054086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:08.054086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:08.054086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:08.054086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:08.054086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:08.054086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:08.054086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:08.054086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:08.054998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:08.054998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:08.054998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:08.054998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:08.054998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 310/612] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:08.059443 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb25fd-9727-4428-908f-3857738782a9 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:08.195849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:08.199664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb25fd-9727-4428-908f-3857738782a9 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:08.236503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160f729-e05c-47d1-a301-66dc223c2245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:08.237089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160f729-e05c-47d1-a301-66dc223c2245 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:08.237376 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160f729-e05c-47d1-a301-66dc223c2245 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:08.237656 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160f729-e05c-47d1-a301-66dc223c2245 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:08.238392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160f729-e05c-47d1-a301-66dc223c2245 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:08.238704 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160f729-e05c-47d1-a301-66dc223c2245 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:08.240067 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160f729-e05c-47d1-a301-66dc223c2245 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:08.256497 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 303/613] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:08.258215 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02307b29-f64d-475a-b4a3-62bfd5e05915 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:08.327209 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:08.363601 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02307b29-f64d-475a-b4a3-62bfd5e05915 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:08.407292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c617a6-757a-4aaf-b0b1-c8207d8b7839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:08.408163 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c617a6-757a-4aaf-b0b1-c8207d8b7839 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:08.408457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c617a6-757a-4aaf-b0b1-c8207d8b7839 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:08.408736 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c617a6-757a-4aaf-b0b1-c8207d8b7839 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:08.419687 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c617a6-757a-4aaf-b0b1-c8207d8b7839 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:08.421169 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c617a6-757a-4aaf-b0b1-c8207d8b7839 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:08.438451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-64c617a6-757a-4aaf-b0b1-c8207d8b7839 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 16:41:08.438451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:08.438451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:08.438451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:08.438451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:08.438451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:08.438451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:08.438451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:08.438451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:08.438451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:08.438451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:08.438451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:08.438451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:08.438451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:08.438451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:08.438451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:08.439446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:08.439446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:08.439446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:08.439446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:08.439446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:08.439446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:08.439446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:08.439446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:08.439446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:08.439446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:08.439446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:08.439446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:08.439446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:08.439446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:08.439446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:08.439446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:08.439446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:08.439446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:08.440425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:08.440425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:08.440425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:08.440425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:08.440425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:08.440425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:08.440425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:08.440425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:08.440425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 16:41:08.440425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:08.444532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 311/614] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:41:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:08.446269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160f729-e05c-47d1-a301-66dc223c2245 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:08.448531 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5178a-5bf9-4139-aec7-6fc7faa1b87d None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:08.448820 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5178a-5bf9-4139-aec7-6fc7faa1b87d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:08.449155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5178a-5bf9-4139-aec7-6fc7faa1b87d None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:08.453107 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 312/615] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:08.456901 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821654ea-ccdd-4932-a845-567d17559650 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:08.457194 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821654ea-ccdd-4932-a845-567d17559650 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:08.457477 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821654ea-ccdd-4932-a845-567d17559650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:08.494142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-821654ea-ccdd-4932-a845-567d17559650 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:08.495278 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-821654ea-ccdd-4932-a845-567d17559650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:08.578513 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 313/616] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:41:08.613352 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821654ea-ccdd-4932-a845-567d17559650 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:08.656034 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160f729-e05c-47d1-a301-66dc223c2245 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:08.684509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:08.717968 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891bebe-eae3-41db-963c-53aacc494210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:08.718654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891bebe-eae3-41db-963c-53aacc494210 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:08.718947 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891bebe-eae3-41db-963c-53aacc494210 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:08.719235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891bebe-eae3-41db-963c-53aacc494210 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:08.720093 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891bebe-eae3-41db-963c-53aacc494210 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:08.720433 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891bebe-eae3-41db-963c-53aacc494210 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:08.721868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891bebe-eae3-41db-963c-53aacc494210 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:08.726363 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821654ea-ccdd-4932-a845-567d17559650 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:08.758673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 304/617] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jun 22 16:41:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:08.764454 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891bebe-eae3-41db-963c-53aacc494210 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:08.768255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5b045-a5c9-4d55-8557-04cfb0bd3906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:08.769211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5b045-a5c9-4d55-8557-04cfb0bd3906 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:08.769573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5b045-a5c9-4d55-8557-04cfb0bd3906 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:08.769926 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5b045-a5c9-4d55-8557-04cfb0bd3906 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:08.783465 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5b045-a5c9-4d55-8557-04cfb0bd3906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:08.784442 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:08.792211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-80c5b045-a5c9-4d55-8557-04cfb0bd3906 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:08.792211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:08.792211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:08.792211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:08.792211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:08.792211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:08.792211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:08.792211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:08.792211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:08.792211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:08.792211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:08.792211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:08.792211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:08.792211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:08.792211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:08.792211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:08.795968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:08.795968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:08.795968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:08.795968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:08.795968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:08.795968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:08.795968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:08.795968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:08.795968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:08.795968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:08.795968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:08.795968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:08.795968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:08.795968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:08.795968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:08.795968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:08.796868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:08.796868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:08.796868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:08.796868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:08.796868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:08.796868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:08.796868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:08.796868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:08.796868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:08.796868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:08.796868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:08.796868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:08.796868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 314/618] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:41:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:08.799766 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5b045-a5c9-4d55-8557-04cfb0bd3906 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:08.915636 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5b045-a5c9-4d55-8557-04cfb0bd3906 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:08.935554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:08.956752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7f167-ff9a-4ecb-99a2-4502d46ff305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:08.957860 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7f167-ff9a-4ecb-99a2-4502d46ff305 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:08.958330 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7f167-ff9a-4ecb-99a2-4502d46ff305 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:08.958785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7f167-ff9a-4ecb-99a2-4502d46ff305 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:08.960060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7f167-ff9a-4ecb-99a2-4502d46ff305 None admin] RBAC: Adding query filter params (name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:08.960617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7f167-ff9a-4ecb-99a2-4502d46ff305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:08.962723 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7f167-ff9a-4ecb-99a2-4502d46ff305 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:08.972533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 315/619] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 16:41:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:08.982894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7f167-ff9a-4ecb-99a2-4502d46ff305 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:09.004236 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891bebe-eae3-41db-963c-53aacc494210 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:09.059164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cccf22-4079-47bc-bc3e-ae68cd8ed65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:09.060361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cccf22-4079-47bc-bc3e-ae68cd8ed65c None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:09.060849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cccf22-4079-47bc-bc3e-ae68cd8ed65c None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:09.061323 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cccf22-4079-47bc-bc3e-ae68cd8ed65c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:09.086719 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cccf22-4079-47bc-bc3e-ae68cd8ed65c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:09.088550 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cccf22-4079-47bc-bc3e-ae68cd8ed65c None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:09.126229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-39cccf22-4079-47bc-bc3e-ae68cd8ed65c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:09.126229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:09.126229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:09.126229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:09.126229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:09.126229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:09.126229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:09.126229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:09.126229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:09.126229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:09.126229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:09.126229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:09.126229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:09.126229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:09.126229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:09.127211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:09.127211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:09.127211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:09.127211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:09.127211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:09.127211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:09.127211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:09.127211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:09.127211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:09.127211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:09.127211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:09.127211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:09.127211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:09.127211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:09.127211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:09.127211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:09.127211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:09.128552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:09.128552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:09.128552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:09.128552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:09.128552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 305/620] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:09.128852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07192d-6be2-44cd-bae2-df2f81c812c5 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:09.132546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07192d-6be2-44cd-bae2-df2f81c812c5 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:09.132833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07192d-6be2-44cd-bae2-df2f81c812c5 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:09.134281 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 306/621] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:09.140321 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07192d-6be2-44cd-bae2-df2f81c812c5 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:09.183922 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7f167-ff9a-4ecb-99a2-4502d46ff305 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:09.214163 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:09.229710 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc9f7e-a9de-4507-a707-dea1b54c75aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:09.230511 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc9f7e-a9de-4507-a707-dea1b54c75aa None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:09.230799 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc9f7e-a9de-4507-a707-dea1b54c75aa None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:09.231079 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc9f7e-a9de-4507-a707-dea1b54c75aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:09.244123 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc9f7e-a9de-4507-a707-dea1b54c75aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:09.245871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc9f7e-a9de-4507-a707-dea1b54c75aa None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:09.259896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07192d-6be2-44cd-bae2-df2f81c812c5 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:09.269849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-41dc9f7e-a9de-4507-a707-dea1b54c75aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:09.269849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:09.269849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:09.269849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:09.269849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:09.269849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:09.269849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:09.269849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:09.269849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:09.269849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:09.269849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:09.269849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:09.269849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:09.269849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:09.269849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:09.270745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:09.270745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:09.270745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:09.270745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:09.270745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:09.270745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:09.270745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:09.270745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:09.270745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:09.270745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:09.270745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:09.270745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:09.270745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:09.270745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:09.270745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:09.270745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:09.270745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:09.272902 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:09.272902 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:09.272902 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:09.272902 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:09.272902 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 316/622] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:09.273210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f1727-6b0b-476d-9904-951b130c5caf None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:09.273535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f1727-6b0b-476d-9904-951b130c5caf None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:09.274313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f1727-6b0b-476d-9904-951b130c5caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:09.295250 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-b68f1727-6b0b-476d-9904-951b130c5caf None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:09.297111 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-b68f1727-6b0b-476d-9904-951b130c5caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:09.301979 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5fec0-ac61-4793-a8e5-160527b21793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:09.302931 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5fec0-ac61-4793-a8e5-160527b21793 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:09.303477 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5fec0-ac61-4793-a8e5-160527b21793 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:09.304044 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5fec0-ac61-4793-a8e5-160527b21793 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:09.305149 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5fec0-ac61-4793-a8e5-160527b21793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:09.305711 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5fec0-ac61-4793-a8e5-160527b21793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:09.307457 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5fec0-ac61-4793-a8e5-160527b21793 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:09.325948 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:09.327337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 307/623] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:09.328506 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5fec0-ac61-4793-a8e5-160527b21793 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:09.384129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 317/624] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:41:09.384129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f1727-6b0b-476d-9904-951b130c5caf None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:09.473808 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5fec0-ac61-4793-a8e5-160527b21793 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:09.495316 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f1727-6b0b-476d-9904-951b130c5caf None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:09.512693 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:09.526334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c07e1-47fe-4239-bb6a-341c168ed4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:09.527035 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c07e1-47fe-4239-bb6a-341c168ed4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:09.527390 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c07e1-47fe-4239-bb6a-341c168ed4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:09.527979 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c07e1-47fe-4239-bb6a-341c168ed4f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:09.529252 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c07e1-47fe-4239-bb6a-341c168ed4f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:09.529636 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c07e1-47fe-4239-bb6a-341c168ed4f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:09.531619 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c07e1-47fe-4239-bb6a-341c168ed4f1 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:09.537604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc4e4d-ff48-494a-a129-fa8f1a356986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:09.538992 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc4e4d-ff48-494a-a129-fa8f1a356986 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:09.539280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc4e4d-ff48-494a-a129-fa8f1a356986 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:09.539554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc4e4d-ff48-494a-a129-fa8f1a356986 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:09.546569 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 308/625] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:09.546684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc4e4d-ff48-494a-a129-fa8f1a356986 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:09.547865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c07e1-47fe-4239-bb6a-341c168ed4f1 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:09.548741 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc4e4d-ff48-494a-a129-fa8f1a356986 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:09.563161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-51fc4e4d-ff48-494a-a129-fa8f1a356986 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:09.563161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:09.563161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:09.563161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:09.563161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:09.563161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:09.563161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:09.563161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:09.563161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:09.563161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:09.563161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:09.563161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:09.563161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:09.563161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:09.563161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:09.564199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:09.564199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:09.564199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:09.564199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:09.564199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:09.564199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:09.564199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:09.564199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:09.564199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:09.564199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:09.564199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:09.564199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:09.564199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:09.564199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:09.564199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:09.564199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:09.564199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:09.565136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:09.565136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:09.565136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:09.565136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:09.565136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:09.565136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:09.565136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:09.565136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:09.565136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 318/626] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:09.565648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1daae4b-b9af-439a-b11f-b8168d5ee76e None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:09.566565 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1daae4b-b9af-439a-b11f-b8168d5ee76e None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:09.566565 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1daae4b-b9af-439a-b11f-b8168d5ee76e None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:09.567659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 319/627] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:09.568301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1daae4b-b9af-439a-b11f-b8168d5ee76e None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:09.600031 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:09.660582 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c07e1-47fe-4239-bb6a-341c168ed4f1 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:09.682978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1daae4b-b9af-439a-b11f-b8168d5ee76e None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:09.695196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0b544-f76c-4cc9-a0e4-d6051a7c7f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:09.695976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0b544-f76c-4cc9-a0e4-d6051a7c7f35 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:09.696353 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0b544-f76c-4cc9-a0e4-d6051a7c7f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:09.696637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0b544-f76c-4cc9-a0e4-d6051a7c7f35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:09.707206 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0b544-f76c-4cc9-a0e4-d6051a7c7f35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:09.715302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-9ab0b544-f76c-4cc9-a0e4-d6051a7c7f35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:09.715302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:09.715302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:09.715302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:09.715302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:09.715302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:09.715302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:09.715302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:09.715302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:09.715302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:09.715302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:09.715302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:09.715302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:09.715302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:09.715302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:09.715302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:09.716246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:09.716246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:09.716246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:09.716246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:09.716246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:09.716246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:09.716246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:09.716246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:09.716246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:09.716246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:09.716246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:09.716246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:09.716246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:09.716246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:09.716246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:09.716246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:09.717108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:09.717108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:09.717108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:09.717108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:09.717108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:09.717108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:09.717108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:09.717108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:09.717108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:09.717108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:09.717108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:09.717108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:09.717108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 309/628] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:41:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:09.717804 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0b544-f76c-4cc9-a0e4-d6051a7c7f35 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:09.722523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209e291-1da3-4327-9f95-eda9c08ae5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:09.723300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209e291-1da3-4327-9f95-eda9c08ae5dc None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:09.723582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209e291-1da3-4327-9f95-eda9c08ae5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:09.723854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209e291-1da3-4327-9f95-eda9c08ae5dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:09.734606 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209e291-1da3-4327-9f95-eda9c08ae5dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:09.736084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209e291-1da3-4327-9f95-eda9c08ae5dc None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:09.753725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-d209e291-1da3-4327-9f95-eda9c08ae5dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 16:41:09.753725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:09.753725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:09.753725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:09.753725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:09.753725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:09.753725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:09.753725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:09.753725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:09.753725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:09.753725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:09.753725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:09.753725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:09.753725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:09.753725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:09.753725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:09.754664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:09.754664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:09.754664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:09.754664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:09.754664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:09.754664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:09.754664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:09.754664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:09.754664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:09.754664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:09.754664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:09.754664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:09.754664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:09.754664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:09.754664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:09.754664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:09.754664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:09.754664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:09.755625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:09.755625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:09.755625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:09.755625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:09.755625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:09.755625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:09.755625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:09.755625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:09.755625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 16:41:09.755625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:09.755625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 320/629] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jun 22 16:41:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:09.756788 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bc1d5-d0d2-4b8c-b9e5-4919db55ce25 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:09.756887 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bc1d5-d0d2-4b8c-b9e5-4919db55ce25 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:09.757122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bc1d5-d0d2-4b8c-b9e5-4919db55ce25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:09.774612 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:09.777324 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-f01bc1d5-d0d2-4b8c-b9e5-4919db55ce25 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:09.778962 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f01bc1d5-d0d2-4b8c-b9e5-4919db55ce25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:09.826837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0b544-f76c-4cc9-a0e4-d6051a7c7f35 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:09.850823 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 321/630] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:41:09.851594 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bc1d5-d0d2-4b8c-b9e5-4919db55ce25 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:09.865588 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:09.872618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea401bd-0f4f-42c2-ae23-0cddc5740843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:09.873644 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea401bd-0f4f-42c2-ae23-0cddc5740843 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:09.874147 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea401bd-0f4f-42c2-ae23-0cddc5740843 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:09.874430 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea401bd-0f4f-42c2-ae23-0cddc5740843 None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:09.875239 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea401bd-0f4f-42c2-ae23-0cddc5740843 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:09.875558 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea401bd-0f4f-42c2-ae23-0cddc5740843 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:09.877040 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea401bd-0f4f-42c2-ae23-0cddc5740843 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:09.890232 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 310/631] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:09.895001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea401bd-0f4f-42c2-ae23-0cddc5740843 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:09.960463 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bc1d5-d0d2-4b8c-b9e5-4919db55ce25 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:09.994309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7183d-2246-44e9-aa14-fbc7842c0ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:09.995088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7183d-2246-44e9-aa14-fbc7842c0ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:09.995498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7183d-2246-44e9-aa14-fbc7842c0ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:09.995778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7183d-2246-44e9-aa14-fbc7842c0ef1 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:09.996580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7183d-2246-44e9-aa14-fbc7842c0ef1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:09.996889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7183d-2246-44e9-aa14-fbc7842c0ef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:09.998501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7183d-2246-44e9-aa14-fbc7842c0ef1 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:10.001051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea401bd-0f4f-42c2-ae23-0cddc5740843 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:10.010981 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:10.016873 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 322/632] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 16:41:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:10.016873 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7183d-2246-44e9-aa14-fbc7842c0ef1 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:10.041803 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce6438-2de8-4636-ac0e-3e47d45e5ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:10.042411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce6438-2de8-4636-ac0e-3e47d45e5ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:10.042700 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce6438-2de8-4636-ac0e-3e47d45e5ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:10.042974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce6438-2de8-4636-ac0e-3e47d45e5ce1 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:10.043955 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce6438-2de8-4636-ac0e-3e47d45e5ce1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:10.044299 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce6438-2de8-4636-ac0e-3e47d45e5ce1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:10.045726 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce6438-2de8-4636-ac0e-3e47d45e5ce1 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:10.068540 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 311/633] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jun 22 16:41:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:10.068540 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce6438-2de8-4636-ac0e-3e47d45e5ce1 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:10.100655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:10.126865 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7183d-2246-44e9-aa14-fbc7842c0ef1 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:10.162315 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e8079-04e1-4e45-ba6f-fcc0b9842db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:10.163132 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e8079-04e1-4e45-ba6f-fcc0b9842db2 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:10.163421 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e8079-04e1-4e45-ba6f-fcc0b9842db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:10.163698 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e8079-04e1-4e45-ba6f-fcc0b9842db2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:10.171019 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce6438-2de8-4636-ac0e-3e47d45e5ce1 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:10.174303 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e8079-04e1-4e45-ba6f-fcc0b9842db2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:10.182021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-f39e8079-04e1-4e45-ba6f-fcc0b9842db2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:10.182021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:10.182021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:10.182021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:10.182021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:10.182021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:10.182021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:10.182021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:10.182021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:10.182021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:10.182021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:10.182021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:10.182021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:10.182021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:10.182021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:10.182021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:10.182986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:10.182986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:10.182986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:10.182986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:10.182986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:10.182986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:10.182986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:10.182986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:10.182986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:10.182986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:10.182986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:10.182986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:10.182986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:10.182986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:10.182986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:10.182986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:10.183854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:10.183854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:10.183854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:10.183854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:10.183854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:10.183854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:10.183854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:10.183854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:10.183854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:10.183854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:10.183854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:10.183854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:10.183854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 323/634] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:41:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:10.185236 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e8079-04e1-4e45-ba6f-fcc0b9842db2 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:10.212651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8be9f1-e281-4690-9ccb-b4c8b2f3fd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:10.213520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8be9f1-e281-4690-9ccb-b4c8b2f3fd42 None admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:10.213801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8be9f1-e281-4690-9ccb-b4c8b2f3fd42 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:10.214076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8be9f1-e281-4690-9ccb-b4c8b2f3fd42 None admin] PATH_INFO: `/v3/projects/59d78923fdef459abaf240bd0975494a/users/861452a1dc634bf69ce630d7dcd8a2d7/roles/acb8e1bf2db94178bdd6fc69b191d6b0` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:10.229458 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8be9f1-e281-4690-9ccb-b4c8b2f3fd42 None admin] RBAC: Authorizing `identity:create_grant(project_id=59d78923fdef459abaf240bd0975494a, user_id=861452a1dc634bf69ce630d7dcd8a2d7, role_id=acb8e1bf2db94178bdd6fc69b191d6b0)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:10.231081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8be9f1-e281-4690-9ccb-b4c8b2f3fd42 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:10.285608 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e8079-04e1-4e45-ba6f-fcc0b9842db2 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:10.300435 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 312/635] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:41:10 2022] PUT /identity/v3/projects/59d78923fdef459abaf240bd0975494a/users/861452a1dc634bf69ce630d7dcd8a2d7/roles/acb8e1bf2db94178bdd6fc69b191d6b0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:41:10.300435 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8be9f1-e281-4690-9ccb-b4c8b2f3fd42 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:10.322699 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:10.348450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb163385-ef6f-4061-bd18-a3b85cbcfcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:10.349463 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb163385-ef6f-4061-bd18-a3b85cbcfcfc None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:10.349826 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb163385-ef6f-4061-bd18-a3b85cbcfcfc None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:10.350232 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb163385-ef6f-4061-bd18-a3b85cbcfcfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:10.353628 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:10.363043 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb163385-ef6f-4061-bd18-a3b85cbcfcfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:10.364783 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb163385-ef6f-4061-bd18-a3b85cbcfcfc None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:10.390077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-eb163385-ef6f-4061-bd18-a3b85cbcfcfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:10.390077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:10.390077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:10.390077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:10.390077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:10.390077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:10.390077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:10.390077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:10.390077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:10.390077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:10.390077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:10.390077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:10.390077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:10.390077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:10.390077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:10.393279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:10.393279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:10.393279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:10.393279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:10.393279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:10.393279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:10.393279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:10.393279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:10.393279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:10.393279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:10.393279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:10.393279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:10.393279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:10.393279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:10.393279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:10.393279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:10.393279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:10.394162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:10.394162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:10.394162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:10.394162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:10.394162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 324/636] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:10.394162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb163385-ef6f-4061-bd18-a3b85cbcfcfc None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:10.438809 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8be9f1-e281-4690-9ccb-b4c8b2f3fd42 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:10.483589 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a7261-3d9e-4869-8d8d-cd973dc8d42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:10.484276 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a7261-3d9e-4869-8d8d-cd973dc8d42b None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:10.484568 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a7261-3d9e-4869-8d8d-cd973dc8d42b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:10.485274 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a7261-3d9e-4869-8d8d-cd973dc8d42b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:10.509468 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb163385-ef6f-4061-bd18-a3b85cbcfcfc None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:10.544669 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d343740-8940-4ba7-b682-58ffaaa555df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:10.545337 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d343740-8940-4ba7-b682-58ffaaa555df None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:10.545621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d343740-8940-4ba7-b682-58ffaaa555df None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:10.545895 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d343740-8940-4ba7-b682-58ffaaa555df None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:10.546645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d343740-8940-4ba7-b682-58ffaaa555df None admin] RBAC: Adding query filter params (name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:10.546956 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d343740-8940-4ba7-b682-58ffaaa555df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:10.548360 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d343740-8940-4ba7-b682-58ffaaa555df None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:10.555917 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a7261-3d9e-4869-8d8d-cd973dc8d42b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:10.556796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 325/637] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 16:41:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:10.557584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d343740-8940-4ba7-b682-58ffaaa555df None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:10.557870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a7261-3d9e-4869-8d8d-cd973dc8d42b None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:10.577873 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:10.619845 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:10.666466 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 313/638] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:41:10.667780 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709223b-69fb-43d8-b32a-64b9f711b387 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:10.668066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709223b-69fb-43d8-b32a-64b9f711b387 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:10.668365 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709223b-69fb-43d8-b32a-64b9f711b387 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:10.672239 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 314/639] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:10.672239 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709223b-69fb-43d8-b32a-64b9f711b387 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:10.679213 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d343740-8940-4ba7-b682-58ffaaa555df None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:10.717555 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac5afe-fd32-406e-8af5-1d4e1094694e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:10.718212 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac5afe-fd32-406e-8af5-1d4e1094694e None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:10.718493 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac5afe-fd32-406e-8af5-1d4e1094694e None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:10.718768 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac5afe-fd32-406e-8af5-1d4e1094694e None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:10.719492 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac5afe-fd32-406e-8af5-1d4e1094694e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:10.719799 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac5afe-fd32-406e-8af5-1d4e1094694e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:10.721291 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac5afe-fd32-406e-8af5-1d4e1094694e None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:10.734194 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 326/640] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:10.734999 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac5afe-fd32-406e-8af5-1d4e1094694e None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:10.802562 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709223b-69fb-43d8-b32a-64b9f711b387 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:10.820234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:10.838130 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400e323-d743-4add-bf07-c24de6568c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:10.838915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400e323-d743-4add-bf07-c24de6568c11 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:10.839197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400e323-d743-4add-bf07-c24de6568c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:10.839479 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400e323-d743-4add-bf07-c24de6568c11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:10.842320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac5afe-fd32-406e-8af5-1d4e1094694e None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:10.849367 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400e323-d743-4add-bf07-c24de6568c11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:10.851306 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400e323-d743-4add-bf07-c24de6568c11 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:10.853314 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:10.869874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-2400e323-d743-4add-bf07-c24de6568c11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:10.869874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:10.869874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:10.869874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:10.869874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:10.869874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:10.869874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:10.869874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:10.869874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:10.869874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:10.869874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:10.869874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:10.869874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:10.869874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:10.869874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:10.871008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:10.871008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:10.871008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:10.871008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:10.871008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:10.871008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:10.871008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:10.871008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:10.871008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:10.871008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:10.871008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:10.871008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:10.871008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:10.871008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:10.871008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:10.871008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:10.871008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:10.872131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:10.872131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:10.872131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:10.872131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:10.875757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 315/641] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:10.876946 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4cd77-4299-42d9-9a2a-d346112e27a6 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:10.877236 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4cd77-4299-42d9-9a2a-d346112e27a6 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:10.877516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4cd77-4299-42d9-9a2a-d346112e27a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:10.881967 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860489ff-f773-4d77-a31a-7a711202c2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:10.882919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860489ff-f773-4d77-a31a-7a711202c2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:10.884019 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860489ff-f773-4d77-a31a-7a711202c2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:10.884348 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860489ff-f773-4d77-a31a-7a711202c2e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:10.893579 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-3ba4cd77-4299-42d9-9a2a-d346112e27a6 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:10.894755 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-3ba4cd77-4299-42d9-9a2a-d346112e27a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:10.895602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860489ff-f773-4d77-a31a-7a711202c2e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:10.897112 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860489ff-f773-4d77-a31a-7a711202c2e6 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:10.915178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-860489ff-f773-4d77-a31a-7a711202c2e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:10.915178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:10.915178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:10.915178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:10.915178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:10.915178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:10.915178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:10.915178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:10.915178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:10.915178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:10.915178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:10.915178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:10.915178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:10.915178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:10.915178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:10.916142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:10.916142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:10.916142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:10.916142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:10.916142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:10.916142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:10.916142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:10.916142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:10.916142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:10.916142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:10.916142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:10.916142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:10.916142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:10.916142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:10.916142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:10.916142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:10.916142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:10.917064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:10.917064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:10.917064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:10.917064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:10.917064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 327/642] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:10.917351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860489ff-f773-4d77-a31a-7a711202c2e6 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:10.975639 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 316/643] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:41:10.976513 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4cd77-4299-42d9-9a2a-d346112e27a6 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:11.044275 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860489ff-f773-4d77-a31a-7a711202c2e6 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:11.087220 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:11.091307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4cd77-4299-42d9-9a2a-d346112e27a6 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:11.093013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1df25-5375-43ab-a01e-b3f906332fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:11.094087 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1df25-5375-43ab-a01e-b3f906332fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:11.094087 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1df25-5375-43ab-a01e-b3f906332fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:11.094393 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1df25-5375-43ab-a01e-b3f906332fc2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:11.102038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1df25-5375-43ab-a01e-b3f906332fc2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:11.103513 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1df25-5375-43ab-a01e-b3f906332fc2 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:11.118044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-e1f1df25-5375-43ab-a01e-b3f906332fc2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 22 16:41:11.118044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:11.118044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:11.118044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:11.118044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:11.118044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:11.118044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:11.118044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:11.118044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:11.118044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:11.118044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:11.118044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:11.118044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:11.118044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:11.118044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:11.118044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:11.119010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:11.119010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:11.119010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:11.119010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:11.119010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:11.119010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:11.119010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:11.119010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:11.119010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:11.119010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:11.119010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:11.119010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:11.119010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:11.119010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:11.119010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:11.119010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:11.119010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:11.119010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:11.120038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:11.120038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:11.120038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:11.120038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:11.120038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:11.120038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:11.120038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:11.120038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:11.120038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 22 16:41:11.120038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:11.120038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 328/644] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:41:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:11.120038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1df25-5375-43ab-a01e-b3f906332fc2 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:11.129738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cc73c-1191-42a0-95c1-49abc83401be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:11.130395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cc73c-1191-42a0-95c1-49abc83401be None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:11.130678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cc73c-1191-42a0-95c1-49abc83401be None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:11.130954 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cc73c-1191-42a0-95c1-49abc83401be None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:11.131713 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cc73c-1191-42a0-95c1-49abc83401be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:11.132279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cc73c-1191-42a0-95c1-49abc83401be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:11.133970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cc73c-1191-42a0-95c1-49abc83401be None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:11.145680 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 317/645] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:11.146642 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cc73c-1191-42a0-95c1-49abc83401be None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:11.150841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:11.229342 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1df25-5375-43ab-a01e-b3f906332fc2 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:11.256900 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cc73c-1191-42a0-95c1-49abc83401be None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:11.263869 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fb904-2089-4d63-94d6-bb4465cc0e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:11.264562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fb904-2089-4d63-94d6-bb4465cc0e4c None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:11.265080 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fb904-2089-4d63-94d6-bb4465cc0e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:11.265188 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fb904-2089-4d63-94d6-bb4465cc0e4c None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:11.265841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fb904-2089-4d63-94d6-bb4465cc0e4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:11.266151 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fb904-2089-4d63-94d6-bb4465cc0e4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:11.267545 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fb904-2089-4d63-94d6-bb4465cc0e4c None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:11.283246 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 329/646] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:11.283246 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fb904-2089-4d63-94d6-bb4465cc0e4c None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:11.299041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58165b-1c4f-415b-b51a-575a9489f82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:11.299830 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58165b-1c4f-415b-b51a-575a9489f82c None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:11.300137 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58165b-1c4f-415b-b51a-575a9489f82c None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:11.300413 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58165b-1c4f-415b-b51a-575a9489f82c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:11.311436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58165b-1c4f-415b-b51a-575a9489f82c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:11.319126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-dd58165b-1c4f-415b-b51a-575a9489f82c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:11.319126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:11.319126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:11.319126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:11.319126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:11.319126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:11.319126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:11.319126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:11.319126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:11.319126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:11.319126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:11.319126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:11.319126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:11.319126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:11.319126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:11.319126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:11.320047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:11.320047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:11.320047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:11.320047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:11.320047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:11.320047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:11.320047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:11.320047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:11.320047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:11.320047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:11.320047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:11.320047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:11.320047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:11.320047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:11.320047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:11.320047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:11.325927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:11.325927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:11.325927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:11.325927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:11.325927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:11.325927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:11.325927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:11.325927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:11.325927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:11.325927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:11.325927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:11.325927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:11.325927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 318/647] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:41:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:11.325927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58165b-1c4f-415b-b51a-575a9489f82c None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:11.343224 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:11.375338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:11.395408 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fb904-2089-4d63-94d6-bb4465cc0e4c None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:11.430746 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b2e29-2256-4cf3-bcc2-a12e03523f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:11.431447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b2e29-2256-4cf3-bcc2-a12e03523f79 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:11.431762 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b2e29-2256-4cf3-bcc2-a12e03523f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:11.432022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b2e29-2256-4cf3-bcc2-a12e03523f79 None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:11.432897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b2e29-2256-4cf3-bcc2-a12e03523f79 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:11.433209 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b2e29-2256-4cf3-bcc2-a12e03523f79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:11.434409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58165b-1c4f-415b-b51a-575a9489f82c None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:11.434637 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b2e29-2256-4cf3-bcc2-a12e03523f79 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:11.453414 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 330/648] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jun 22 16:41:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:11.454283 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b2e29-2256-4cf3-bcc2-a12e03523f79 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:11.474632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacedc80-71a0-41a2-86e7-e919ff05ee01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:11.475832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacedc80-71a0-41a2-86e7-e919ff05ee01 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:11.476455 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacedc80-71a0-41a2-86e7-e919ff05ee01 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:11.476734 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacedc80-71a0-41a2-86e7-e919ff05ee01 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:11.485109 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacedc80-71a0-41a2-86e7-e919ff05ee01 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:11.486595 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacedc80-71a0-41a2-86e7-e919ff05ee01 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:11.501363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-cacedc80-71a0-41a2-86e7-e919ff05ee01 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 16:41:11.501363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:11.501363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:11.501363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:11.501363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:11.501363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:11.501363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:11.501363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:11.501363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:11.501363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:11.501363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:11.501363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:11.501363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:11.501363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:11.501363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:11.501363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:11.502328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:11.502328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:11.502328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:11.502328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:11.502328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:11.502328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:11.502328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:11.502328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:11.502328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:11.502328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:11.502328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:11.502328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:11.502328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:11.502328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:11.502328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:11.502328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:11.502328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:11.502328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:11.503269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:11.503269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:11.503269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:11.503269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:11.503269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:11.503269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:11.503269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:11.503269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:11.503269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 16:41:11.503269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:11.503269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 319/649] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:41:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:11.504452 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacedc80-71a0-41a2-86e7-e919ff05ee01 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:11.560841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b2e29-2256-4cf3-bcc2-a12e03523f79 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:11.586564 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:11.596316 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd00330-eea9-4908-a91c-eb06be556eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:11.597173 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd00330-eea9-4908-a91c-eb06be556eeb None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:11.597455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd00330-eea9-4908-a91c-eb06be556eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:11.597730 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd00330-eea9-4908-a91c-eb06be556eeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:11.604663 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd00330-eea9-4908-a91c-eb06be556eeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:11.606122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd00330-eea9-4908-a91c-eb06be556eeb None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:11.607767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:11.611065 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacedc80-71a0-41a2-86e7-e919ff05ee01 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:11.620252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-4fd00330-eea9-4908-a91c-eb06be556eeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:11.620252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:11.620252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:11.620252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:11.620252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:11.620252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:11.620252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:11.620252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:11.620252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:11.620252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:11.620252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:11.620252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:11.620252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:11.620252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:11.620252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:11.621288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:11.621288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:11.621288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:11.621288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:11.621288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:11.621288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:11.621288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:11.621288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:11.621288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:11.621288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:11.621288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:11.621288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:11.621288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:11.621288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:11.621288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:11.621288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:11.621288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:11.622220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:11.622220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:11.622220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:11.622220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:11.622220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:11.622220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:11.622220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:11.622220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:11.622220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 331/650] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:11.622703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd00330-eea9-4908-a91c-eb06be556eeb None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:11.649140 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e75d24-9b90-47eb-8382-9943af9ed55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:11.650001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e75d24-9b90-47eb-8382-9943af9ed55b None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:11.650425 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e75d24-9b90-47eb-8382-9943af9ed55b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:11.650865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e75d24-9b90-47eb-8382-9943af9ed55b None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:11.651973 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e75d24-9b90-47eb-8382-9943af9ed55b None admin] RBAC: Adding query filter params (name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:11.652442 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e75d24-9b90-47eb-8382-9943af9ed55b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:11.653932 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e75d24-9b90-47eb-8382-9943af9ed55b None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:11.662566 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 320/651] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 16:41:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:11.663599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e75d24-9b90-47eb-8382-9943af9ed55b None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:11.727679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd00330-eea9-4908-a91c-eb06be556eeb None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:11.762042 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57358f5-7b6b-46bc-aad3-8c16cb546503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:11.762917 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57358f5-7b6b-46bc-aad3-8c16cb546503 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:11.763202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57358f5-7b6b-46bc-aad3-8c16cb546503 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:11.763482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57358f5-7b6b-46bc-aad3-8c16cb546503 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:11.769272 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e75d24-9b90-47eb-8382-9943af9ed55b None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:11.806274 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebfa56-6785-409d-8e4a-95b856117bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:11.806942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebfa56-6785-409d-8e4a-95b856117bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:11.807226 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebfa56-6785-409d-8e4a-95b856117bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:11.807503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebfa56-6785-409d-8e4a-95b856117bb2 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:11.808374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebfa56-6785-409d-8e4a-95b856117bb2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:11.808686 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebfa56-6785-409d-8e4a-95b856117bb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:11.810100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebfa56-6785-409d-8e4a-95b856117bb2 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:11.821176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:11.829637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 321/652] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jun 22 16:41:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:11.830494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebfa56-6785-409d-8e4a-95b856117bb2 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:11.837980 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:11.841840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57358f5-7b6b-46bc-aad3-8c16cb546503 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:11.843284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57358f5-7b6b-46bc-aad3-8c16cb546503 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:11.936236 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebfa56-6785-409d-8e4a-95b856117bb2 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:11.950945 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 332/653] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:41:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:41:11.951970 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57358f5-7b6b-46bc-aad3-8c16cb546503 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:11.976304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc9266-24c5-42c5-8167-9733098c77bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:11.976959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc9266-24c5-42c5-8167-9733098c77bf None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:11.977240 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc9266-24c5-42c5-8167-9733098c77bf None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:11.977509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc9266-24c5-42c5-8167-9733098c77bf None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:11.978294 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc9266-24c5-42c5-8167-9733098c77bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:11.978599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc9266-24c5-42c5-8167-9733098c77bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:11.980022 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc9266-24c5-42c5-8167-9733098c77bf None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:11.992510 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 322/654] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:11.993325 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc9266-24c5-42c5-8167-9733098c77bf None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:12.060468 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:12.064459 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:12.065063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57358f5-7b6b-46bc-aad3-8c16cb546503 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:12.103285 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8e614-6f83-4e42-9eb9-2edfa4e69ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:12.104188 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8e614-6f83-4e42-9eb9-2edfa4e69ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:12.104472 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8e614-6f83-4e42-9eb9-2edfa4e69ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:12.104749 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8e614-6f83-4e42-9eb9-2edfa4e69ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:12.107146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc9266-24c5-42c5-8167-9733098c77bf None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:12.115459 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8e614-6f83-4e42-9eb9-2edfa4e69ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:12.117483 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8e614-6f83-4e42-9eb9-2edfa4e69ab2 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:12.136011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-96f8e614-6f83-4e42-9eb9-2edfa4e69ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:12.136011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:12.136011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:12.136011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:12.136011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:12.136011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:12.136011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:12.136011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:12.136011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:12.136011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:12.136011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:12.136011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:12.136011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:12.136011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:12.136011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:12.136949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:12.136949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:12.136949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:12.136949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:12.136949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:12.136949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:12.136949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:12.136949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:12.136949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:12.136949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:12.136949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:12.136949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:12.136949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:12.136949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:12.136949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:12.136949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:12.136949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:12.138129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:12.138129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:12.138129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:12.138129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:12.138129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 333/655] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:12.138768 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8e614-6f83-4e42-9eb9-2edfa4e69ab2 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:12.150456 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5533ad2-727b-4222-bbce-46c32ab58c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:12.151103 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5533ad2-727b-4222-bbce-46c32ab58c7a None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:12.151388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5533ad2-727b-4222-bbce-46c32ab58c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:12.151661 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5533ad2-727b-4222-bbce-46c32ab58c7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:12.222099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5533ad2-727b-4222-bbce-46c32ab58c7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:12.223581 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5533ad2-727b-4222-bbce-46c32ab58c7a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:12.244632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8e614-6f83-4e42-9eb9-2edfa4e69ab2 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:12.278389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b57ef-25f9-478c-a534-e28a01579bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:12.279170 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b57ef-25f9-478c-a534-e28a01579bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:12.279453 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b57ef-25f9-478c-a534-e28a01579bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:12.279727 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b57ef-25f9-478c-a534-e28a01579bc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:12.283455 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:12.291515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b57ef-25f9-478c-a534-e28a01579bc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:12.293014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b57ef-25f9-478c-a534-e28a01579bc7 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:12.311152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-0e8b57ef-25f9-478c-a534-e28a01579bc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:12.311152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:12.311152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:12.311152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:12.311152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:12.311152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:12.311152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:12.311152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:12.311152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:12.311152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:12.311152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:12.311152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:12.311152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:12.311152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:12.311152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:12.312057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:12.312057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:12.312057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:12.312057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:12.312057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:12.312057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:12.312057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:12.312057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:12.312057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:12.312057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:12.312057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:12.312057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:12.312057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:12.312057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:12.312057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:12.312057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:12.312057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:12.313000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:12.313000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:12.313000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:12.313000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:12.313000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 334/656] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:12.313274 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b57ef-25f9-478c-a534-e28a01579bc7 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:12.316271 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:12.336417 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 323/657] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:41:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:41:12.336417 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5533ad2-727b-4222-bbce-46c32ab58c7a None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:12.424369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b57ef-25f9-478c-a534-e28a01579bc7 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:12.437003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5533ad2-727b-4222-bbce-46c32ab58c7a None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:12.458224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56eb95-a5c9-4566-9fc4-2af9b301c370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:12.458867 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56eb95-a5c9-4566-9fc4-2af9b301c370 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:12.459146 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56eb95-a5c9-4566-9fc4-2af9b301c370 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:12.459480 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56eb95-a5c9-4566-9fc4-2af9b301c370 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:12.460842 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56eb95-a5c9-4566-9fc4-2af9b301c370 None admin] RBAC: Adding query filter params (role.id=acb8e1bf2db94178bdd6fc69b191d6b0, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=78e7bdfffdc84465a570d135d1d86380) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:12.461157 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56eb95-a5c9-4566-9fc4-2af9b301c370 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:12.462575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56eb95-a5c9-4566-9fc4-2af9b301c370 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:12.468185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 335/658] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:41:12 2022] GET /identity/v3/role_assignments?user.id=78e7bdfffdc84465a570d135d1d86380&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=acb8e1bf2db94178bdd6fc69b191d6b0 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:12.468949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56eb95-a5c9-4566-9fc4-2af9b301c370 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:12.471275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9a92d-f084-468e-bc9d-3be2231e304a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:12.471943 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9a92d-f084-468e-bc9d-3be2231e304a None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:12.472315 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9a92d-f084-468e-bc9d-3be2231e304a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:12.472546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9a92d-f084-468e-bc9d-3be2231e304a None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:12.473289 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9a92d-f084-468e-bc9d-3be2231e304a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:12.473603 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9a92d-f084-468e-bc9d-3be2231e304a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:12.475030 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9a92d-f084-468e-bc9d-3be2231e304a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:12.487798 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 324/659] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:12.488733 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9a92d-f084-468e-bc9d-3be2231e304a None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:12.513425 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:12.558462 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:12.599132 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56eb95-a5c9-4566-9fc4-2af9b301c370 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:12.602067 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9a92d-f084-468e-bc9d-3be2231e304a None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:12.640986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66fd86-e95f-48d1-a8f9-7ae2b61926b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:12.641654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66fd86-e95f-48d1-a8f9-7ae2b61926b8 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:12.641971 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66fd86-e95f-48d1-a8f9-7ae2b61926b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:12.642253 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66fd86-e95f-48d1-a8f9-7ae2b61926b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:12.642985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66fd86-e95f-48d1-a8f9-7ae2b61926b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:12.643461 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66fd86-e95f-48d1-a8f9-7ae2b61926b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:12.644869 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66fd86-e95f-48d1-a8f9-7ae2b61926b8 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:12.645751 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5122a-3ed1-4e97-adce-df4a75c31d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:12.645984 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5122a-3ed1-4e97-adce-df4a75c31d40 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:12.646271 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5122a-3ed1-4e97-adce-df4a75c31d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:12.646551 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5122a-3ed1-4e97-adce-df4a75c31d40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:12.660218 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 336/660] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:12.661174 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5122a-3ed1-4e97-adce-df4a75c31d40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:12.661295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d395c50-5775-4204-812a-0774a377b632 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:12.661595 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d395c50-5775-4204-812a-0774a377b632 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:12.661880 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d395c50-5775-4204-812a-0774a377b632 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:12.663007 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5122a-3ed1-4e97-adce-df4a75c31d40 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:12.667468 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 337/661] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:12.668298 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d395c50-5775-4204-812a-0774a377b632 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:12.686437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-ddf5122a-3ed1-4e97-adce-df4a75c31d40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:12.686437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:12.686437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:12.686437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:12.686437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:12.686437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:12.686437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:12.686437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:12.686437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:12.686437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:12.686437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:12.686437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:12.686437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:12.686437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:12.686437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:12.687362 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:12.687362 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:12.687362 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:12.687362 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:12.687362 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:12.687362 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:12.687362 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:12.687362 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:12.687362 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:12.687362 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:12.687362 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:12.687362 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:12.687362 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:12.687362 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:12.687362 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:12.687362 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:12.687362 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:12.688330 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:12.688330 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:12.688330 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:12.688330 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:12.688330 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 325/662] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:12.692136 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96c82c-a7d8-4d30-b105-b5ada942b1b5 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:12.692136 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96c82c-a7d8-4d30-b105-b5ada942b1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:12.692136 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96c82c-a7d8-4d30-b105-b5ada942b1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:12.709526 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-cf96c82c-a7d8-4d30-b105-b5ada942b1b5 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:12.711086 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-cf96c82c-a7d8-4d30-b105-b5ada942b1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:12.793052 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d395c50-5775-4204-812a-0774a377b632 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:12.795615 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:12.800141 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 326/663] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:41:12.801059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96c82c-a7d8-4d30-b105-b5ada942b1b5 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:12.831307 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:12.841580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaead7b-e7a9-4a8c-b14e-7ecd23b5f968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:12.842370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaead7b-e7a9-4a8c-b14e-7ecd23b5f968 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:12.842653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaead7b-e7a9-4a8c-b14e-7ecd23b5f968 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:12.842927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaead7b-e7a9-4a8c-b14e-7ecd23b5f968 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:12.850410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaead7b-e7a9-4a8c-b14e-7ecd23b5f968 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:12.851907 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaead7b-e7a9-4a8c-b14e-7ecd23b5f968 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:12.867258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-eeaead7b-e7a9-4a8c-b14e-7ecd23b5f968 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 16:41:12.867258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:12.867258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:12.867258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:12.867258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:12.867258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:12.867258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:12.867258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:12.867258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:12.867258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:12.867258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:12.867258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:12.867258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:12.867258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:12.867258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:12.867258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:12.868340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:12.868340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:12.868340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:12.868340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:12.868340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:12.868340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:12.868340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:12.868340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:12.868340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:12.868340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:12.868340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:12.868340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:12.868340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:12.868340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:12.868340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:12.868340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:12.868340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:12.868340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:12.874205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:12.874205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:12.874205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:12.874205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:12.874205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:12.874205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:12.874205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:12.874205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:12.874205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 22 16:41:12.874205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:12.874205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 338/664] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:41:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:12.874205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaead7b-e7a9-4a8c-b14e-7ecd23b5f968 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:12.919072 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96c82c-a7d8-4d30-b105-b5ada942b1b5 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:12.954829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b9066-c246-4cdf-b7df-503ed5789d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:12.955613 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b9066-c246-4cdf-b7df-503ed5789d6f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:12.955891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b9066-c246-4cdf-b7df-503ed5789d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:12.956186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b9066-c246-4cdf-b7df-503ed5789d6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:12.963036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b9066-c246-4cdf-b7df-503ed5789d6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:12.964523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b9066-c246-4cdf-b7df-503ed5789d6f None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:12.972234 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaead7b-e7a9-4a8c-b14e-7ecd23b5f968 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:12.978557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-8c0b9066-c246-4cdf-b7df-503ed5789d6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:12.978557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:12.978557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:12.978557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:12.978557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:12.978557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:12.978557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:12.978557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:12.978557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:12.978557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:12.978557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:12.978557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:12.978557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:12.978557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:12.978557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:12.979470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:12.979470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:12.979470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:12.979470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:12.979470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:12.979470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:12.979470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:12.979470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:12.979470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:12.979470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:12.979470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:12.979470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:12.979470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:12.979470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:12.979470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:12.979470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:12.979470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:12.980757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:12.980757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:12.980757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:12.980757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:12.980757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:12.980757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:12.980757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:12.980757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:12.984430 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 327/665] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:12.985026 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b9066-c246-4cdf-b7df-503ed5789d6f None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:13.012033 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b795e7b-c5b1-4920-b153-22647b40adb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:13.012997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b795e7b-c5b1-4920-b153-22647b40adb9 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:13.013290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b795e7b-c5b1-4920-b153-22647b40adb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:13.013554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b795e7b-c5b1-4920-b153-22647b40adb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:13.014277 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b795e7b-c5b1-4920-b153-22647b40adb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:13.014580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b795e7b-c5b1-4920-b153-22647b40adb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:13.015945 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b795e7b-c5b1-4920-b153-22647b40adb9 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:13.028367 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 339/666] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:13.029288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b795e7b-c5b1-4920-b153-22647b40adb9 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:13.061639 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:13.085110 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:13.110528 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b9066-c246-4cdf-b7df-503ed5789d6f None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:13.142747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b795e7b-c5b1-4920-b153-22647b40adb9 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:13.146943 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb8e7d-f58a-495a-b778-c483a6249928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:13.147738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb8e7d-f58a-495a-b778-c483a6249928 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:13.148025 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb8e7d-f58a-495a-b778-c483a6249928 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:13.148328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb8e7d-f58a-495a-b778-c483a6249928 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:13.159339 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb8e7d-f58a-495a-b778-c483a6249928 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:13.167622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-9dcb8e7d-f58a-495a-b778-c483a6249928 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:13.167622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:13.167622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:13.167622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:13.167622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:13.167622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:13.167622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:13.167622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:13.167622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:13.167622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:13.167622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:13.167622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:13.167622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:13.167622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:13.167622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:13.167622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:13.168801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:13.168801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:13.168801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:13.168801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:13.168801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:13.168801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:13.168801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:13.168801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:13.168801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:13.168801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:13.168801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:13.168801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:13.168801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:13.168801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:13.168801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:13.168801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:13.169673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:13.169673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:13.169673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:13.169673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:13.169673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:13.169673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:13.169673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:13.169673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:13.169673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:13.169673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:13.169673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:13.169673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:13.169673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 328/667] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:41:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:13.169673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb8e7d-f58a-495a-b778-c483a6249928 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:13.181568 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd611a-a340-44ca-9c49-18e6b91e0069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:13.182247 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd611a-a340-44ca-9c49-18e6b91e0069 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:13.182544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd611a-a340-44ca-9c49-18e6b91e0069 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:13.182823 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd611a-a340-44ca-9c49-18e6b91e0069 None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:13.183675 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd611a-a340-44ca-9c49-18e6b91e0069 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:13.183992 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd611a-a340-44ca-9c49-18e6b91e0069 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:13.185464 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd611a-a340-44ca-9c49-18e6b91e0069 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:13.208038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 340/668] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Jun 22 16:41:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:13.208038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd611a-a340-44ca-9c49-18e6b91e0069 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:13.283613 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb8e7d-f58a-495a-b778-c483a6249928 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:13.303370 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:13.317124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd611a-a340-44ca-9c49-18e6b91e0069 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:13.319012 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab3df7-d6b5-441c-af81-07f0054c925f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:13.319530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:13.320470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab3df7-d6b5-441c-af81-07f0054c925f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:13.321140 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab3df7-d6b5-441c-af81-07f0054c925f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:13.321683 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab3df7-d6b5-441c-af81-07f0054c925f None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:13.322795 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab3df7-d6b5-441c-af81-07f0054c925f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:13.323355 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab3df7-d6b5-441c-af81-07f0054c925f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:13.325293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab3df7-d6b5-441c-af81-07f0054c925f None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:13.342694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 329/669] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:13.342694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab3df7-d6b5-441c-af81-07f0054c925f None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:13.357720 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5e218-cf2c-40fc-adff-4616b2a0d5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:13.358512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5e218-cf2c-40fc-adff-4616b2a0d5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:13.358803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5e218-cf2c-40fc-adff-4616b2a0d5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:13.359084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5e218-cf2c-40fc-adff-4616b2a0d5d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:13.365891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5e218-cf2c-40fc-adff-4616b2a0d5d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:13.367344 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5e218-cf2c-40fc-adff-4616b2a0d5d0 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:13.380839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-fbc5e218-cf2c-40fc-adff-4616b2a0d5d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:13.380839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:13.380839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:13.380839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:13.380839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:13.380839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:13.380839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:13.380839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:13.380839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:13.380839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:13.380839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:13.380839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:13.380839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:13.380839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:13.380839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:13.381761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:13.381761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:13.381761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:13.381761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:13.381761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:13.381761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:13.381761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:13.381761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:13.381761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:13.381761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:13.381761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:13.381761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:13.381761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:13.381761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:13.381761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:13.381761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:13.381761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:13.382655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:13.382655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:13.382655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:13.382655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:13.382655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:13.382655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:13.382655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:13.382655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:13.382655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 341/670] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:13.383139 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5e218-cf2c-40fc-adff-4616b2a0d5d0 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:13.448729 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab3df7-d6b5-441c-af81-07f0054c925f None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:13.483339 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91605df0-697c-4a02-8fa7-d630237cc60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:13.483996 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91605df0-697c-4a02-8fa7-d630237cc60a None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:13.484317 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91605df0-697c-4a02-8fa7-d630237cc60a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:13.484599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91605df0-697c-4a02-8fa7-d630237cc60a None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:13.485343 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91605df0-697c-4a02-8fa7-d630237cc60a None admin] RBAC: Adding query filter params (name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:13.485649 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91605df0-697c-4a02-8fa7-d630237cc60a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:13.487022 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91605df0-697c-4a02-8fa7-d630237cc60a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:13.489708 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5e218-cf2c-40fc-adff-4616b2a0d5d0 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:13.499344 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 330/671] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 16:41:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:13.499344 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91605df0-697c-4a02-8fa7-d630237cc60a None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:13.527271 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc11d15-ca35-4b5e-ab3b-22ccb96a0f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:13.527911 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc11d15-ca35-4b5e-ab3b-22ccb96a0f1a None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:13.528228 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc11d15-ca35-4b5e-ab3b-22ccb96a0f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:13.528508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc11d15-ca35-4b5e-ab3b-22ccb96a0f1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:13.545967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:13.559392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:13.597773 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc11d15-ca35-4b5e-ab3b-22ccb96a0f1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:13.599386 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc11d15-ca35-4b5e-ab3b-22ccb96a0f1a None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:13.607324 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91605df0-697c-4a02-8fa7-d630237cc60a None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:13.642331 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05001522-353b-4d84-af70-b064bcee2858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:13.642994 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05001522-353b-4d84-af70-b064bcee2858 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:13.643275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05001522-353b-4d84-af70-b064bcee2858 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:13.643553 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05001522-353b-4d84-af70-b064bcee2858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:13.644530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05001522-353b-4d84-af70-b064bcee2858 None admin] RBAC: Adding query filter params (role.id=acb8e1bf2db94178bdd6fc69b191d6b0, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=144e0074ab4d4e5c8743e4f7d68a89b0) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:13.644840 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05001522-353b-4d84-af70-b064bcee2858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:13.646274 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05001522-353b-4d84-af70-b064bcee2858 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:13.653379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 331/672] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:41:13 2022] GET /identity/v3/role_assignments?user.id=144e0074ab4d4e5c8743e4f7d68a89b0&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=acb8e1bf2db94178bdd6fc69b191d6b0 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:13.654178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05001522-353b-4d84-af70-b064bcee2858 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:13.728292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 342/673] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:41:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:41:13.728292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc11d15-ca35-4b5e-ab3b-22ccb96a0f1a None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:13.794459 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05001522-353b-4d84-af70-b064bcee2858 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:13.800220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:13.803807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:13.848847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc11d15-ca35-4b5e-ab3b-22ccb96a0f1a None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:13.850954 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a9c80-4179-437d-ad41-f9a52b74ce2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:13.852826 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a9c80-4179-437d-ad41-f9a52b74ce2a None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:13.853283 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a9c80-4179-437d-ad41-f9a52b74ce2a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:13.853711 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a9c80-4179-437d-ad41-f9a52b74ce2a None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:13.854676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a9c80-4179-437d-ad41-f9a52b74ce2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:13.855142 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a9c80-4179-437d-ad41-f9a52b74ce2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:13.857120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a9c80-4179-437d-ad41-f9a52b74ce2a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:13.874832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 332/674] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:13.875921 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a9c80-4179-437d-ad41-f9a52b74ce2a None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:13.894375 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67684259-b65e-4ae2-b62a-25d7e11f9fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:13.895205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67684259-b65e-4ae2-b62a-25d7e11f9fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:13.895561 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67684259-b65e-4ae2-b62a-25d7e11f9fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:13.895842 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67684259-b65e-4ae2-b62a-25d7e11f9fc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:13.908582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67684259-b65e-4ae2-b62a-25d7e11f9fc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:13.910066 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67684259-b65e-4ae2-b62a-25d7e11f9fc8 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:13.929060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-67684259-b65e-4ae2-b62a-25d7e11f9fc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:13.929060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:13.929060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:13.929060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:13.929060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:13.929060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:13.929060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:13.929060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:13.929060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:13.929060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:13.929060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:13.929060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:13.929060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:13.929060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:13.929060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:13.930125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:13.930125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:13.930125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:13.930125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:13.930125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:13.930125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:13.930125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:13.930125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:13.930125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:13.930125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:13.930125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:13.930125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:13.930125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:13.930125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:13.930125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:13.930125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:13.930125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:13.931073 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:13.931073 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:13.931073 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:13.931073 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:13.931907 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 343/675] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:13.936246 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67684259-b65e-4ae2-b62a-25d7e11f9fc8 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:14.020474 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a9c80-4179-437d-ad41-f9a52b74ce2a None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:14.068702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622d81f-247f-422c-93e7-752327394e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:14.070146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622d81f-247f-422c-93e7-752327394e4a None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:14.070354 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67684259-b65e-4ae2-b62a-25d7e11f9fc8 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:14.070578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622d81f-247f-422c-93e7-752327394e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:14.070968 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622d81f-247f-422c-93e7-752327394e4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:14.084002 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622d81f-247f-422c-93e7-752327394e4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:14.085765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622d81f-247f-422c-93e7-752327394e4a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:14.091554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:14.106610 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-2622d81f-247f-422c-93e7-752327394e4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:14.106610 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:14.106610 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:14.106610 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:14.106610 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:14.106610 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:14.106610 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:14.106610 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:14.106610 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:14.106610 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:14.106610 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:14.106610 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:14.106610 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:14.106610 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:14.106610 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:14.107594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:14.107594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:14.107594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:14.107594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:14.107594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:14.107594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:14.107594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:14.107594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:14.107594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:14.107594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:14.107594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:14.107594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:14.107594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:14.107594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:14.107594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:14.107594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:14.107594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:14.108621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:14.108621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:14.108621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:14.108621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:14.110626 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 333/676] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:14.117153 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622d81f-247f-422c-93e7-752327394e4a None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:14.119525 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0422a5a-a3c7-4114-b5f5-f5db4f0b797a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:14.120237 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0422a5a-a3c7-4114-b5f5-f5db4f0b797a None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:14.120527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0422a5a-a3c7-4114-b5f5-f5db4f0b797a None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:14.120806 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0422a5a-a3c7-4114-b5f5-f5db4f0b797a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:14.121665 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0422a5a-a3c7-4114-b5f5-f5db4f0b797a None admin] RBAC: Adding query filter params (role.id=acb8e1bf2db94178bdd6fc69b191d6b0, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=5d28208f3127499a98a9d50f8d63ea6b) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:14.121979 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0422a5a-a3c7-4114-b5f5-f5db4f0b797a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:14.123778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0422a5a-a3c7-4114-b5f5-f5db4f0b797a None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:14.132424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 344/677] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:41:13 2022] GET /identity/v3/role_assignments?user.id=5d28208f3127499a98a9d50f8d63ea6b&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=acb8e1bf2db94178bdd6fc69b191d6b0 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:14.133862 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0422a5a-a3c7-4114-b5f5-f5db4f0b797a None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:14.150787 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:14.265389 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622d81f-247f-422c-93e7-752327394e4a None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:14.291040 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0422a5a-a3c7-4114-b5f5-f5db4f0b797a None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:14.332727 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd39584-62a5-4e79-91da-45927f1560dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:14.333835 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd39584-62a5-4e79-91da-45927f1560dc None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:14.334910 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd39584-62a5-4e79-91da-45927f1560dc None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:14.335423 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd39584-62a5-4e79-91da-45927f1560dc None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:14.340469 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88300357-bdc1-4893-a92f-95c94bb108cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:14.341426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88300357-bdc1-4893-a92f-95c94bb108cb None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:14.341928 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88300357-bdc1-4893-a92f-95c94bb108cb None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:14.342422 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88300357-bdc1-4893-a92f-95c94bb108cb None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:14.343364 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88300357-bdc1-4893-a92f-95c94bb108cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:14.343665 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd39584-62a5-4e79-91da-45927f1560dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:14.344262 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd39584-62a5-4e79-91da-45927f1560dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:14.344785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88300357-bdc1-4893-a92f-95c94bb108cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:14.346467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88300357-bdc1-4893-a92f-95c94bb108cb None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:14.349439 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd39584-62a5-4e79-91da-45927f1560dc None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:14.363472 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 345/678] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:14.366992 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 334/679] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:14.371296 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd39584-62a5-4e79-91da-45927f1560dc None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:14.372702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88300357-bdc1-4893-a92f-95c94bb108cb None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:14.424905 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:14.464096 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:14.479536 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd39584-62a5-4e79-91da-45927f1560dc None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:14.485966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88300357-bdc1-4893-a92f-95c94bb108cb None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:14.523785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b1574-d3ae-4202-a264-c81daf6fad5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:14.524612 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b1574-d3ae-4202-a264-c81daf6fad5d None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:14.524905 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b1574-d3ae-4202-a264-c81daf6fad5d None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:14.525190 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b1574-d3ae-4202-a264-c81daf6fad5d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:14.525544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815844c4-71a5-453b-a766-011fc5368041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:14.526517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815844c4-71a5-453b-a766-011fc5368041 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:14.526811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815844c4-71a5-453b-a766-011fc5368041 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:14.527098 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815844c4-71a5-453b-a766-011fc5368041 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:14.533439 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b1574-d3ae-4202-a264-c81daf6fad5d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:14.534118 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815844c4-71a5-453b-a766-011fc5368041 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:14.534908 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b1574-d3ae-4202-a264-c81daf6fad5d None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:14.535752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815844c4-71a5-453b-a766-011fc5368041 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:14.549697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-815844c4-71a5-453b-a766-011fc5368041 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:14.549697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:14.549697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:14.549697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:14.549697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:14.549697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:14.549697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:14.549697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:14.549697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:14.549697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:14.549697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:14.549697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:14.549697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:14.549697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:14.549697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:14.550619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:14.550619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:14.550619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:14.550619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:14.550619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:14.550619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:14.550619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:14.550619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:14.550619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:14.550619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:14.550619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:14.550619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:14.550619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:14.550619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:14.550619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:14.550619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:14.550619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:14.551518 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:14.551518 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:14.551518 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:14.551518 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:14.551518 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:14.551518 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:14.551518 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:14.551518 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:14.551518 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 346/680] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:14.554099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-104b1574-d3ae-4202-a264-c81daf6fad5d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 16:41:14.554099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:14.554099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:14.554099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:14.554099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:14.554099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:14.554099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:14.554099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:14.554099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:14.554099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:14.554099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:14.554099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:14.554099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:14.554099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:14.554099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:14.554099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:14.555031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:14.555031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:14.555031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:14.555031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:14.555031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:14.555031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:14.555031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:14.555031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:14.555031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:14.555031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:14.555031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:14.555031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:14.555031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:14.555031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:14.555031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:14.555031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:14.555031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:14.555031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:14.556060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:14.556060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:14.556060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:14.556060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:14.556060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:14.556060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:14.556060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:14.556060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:14.556060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 16:41:14.556060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:14.556672 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815844c4-71a5-453b-a766-011fc5368041 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:14.558908 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 335/681] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:41:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:14.564034 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b1574-d3ae-4202-a264-c81daf6fad5d None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:14.660724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:14.663583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815844c4-71a5-453b-a766-011fc5368041 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:14.675697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b1574-d3ae-4202-a264-c81daf6fad5d None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:14.699491 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf038dc-cbcb-4674-945b-ebc72a899d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:14.701156 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf038dc-cbcb-4674-945b-ebc72a899d6e None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:14.701156 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf038dc-cbcb-4674-945b-ebc72a899d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:14.701156 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf038dc-cbcb-4674-945b-ebc72a899d6e None admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:14.701653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf038dc-cbcb-4674-945b-ebc72a899d6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:14.701979 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf038dc-cbcb-4674-945b-ebc72a899d6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:14.703441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf038dc-cbcb-4674-945b-ebc72a899d6e None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:14.716637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebc067-30b5-4534-8a64-4d20115d5a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:14.717207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 347/682] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:14.717955 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebc067-30b5-4534-8a64-4d20115d5a55 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:14.718493 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebc067-30b5-4534-8a64-4d20115d5a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:14.718614 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d19869-08c6-4095-be0b-55229be5eedd None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:14.718810 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d19869-08c6-4095-be0b-55229be5eedd None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:14.719094 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d19869-08c6-4095-be0b-55229be5eedd None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:14.719504 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebc067-30b5-4534-8a64-4d20115d5a55 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:14.720588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebc067-30b5-4534-8a64-4d20115d5a55 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:14.721165 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebc067-30b5-4534-8a64-4d20115d5a55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:14.722831 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebc067-30b5-4534-8a64-4d20115d5a55 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:14.729074 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 348/683] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:14.729074 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d19869-08c6-4095-be0b-55229be5eedd None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:14.747217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 336/684] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jun 22 16:41:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:14.749049 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9871136-9e21-46af-a043-465bc671de2b None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:14.749585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9871136-9e21-46af-a043-465bc671de2b None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:14.750089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9871136-9e21-46af-a043-465bc671de2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:14.757125 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:14.769424 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-a9871136-9e21-46af-a043-465bc671de2b None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:14.770766 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-a9871136-9e21-46af-a043-465bc671de2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:14.843446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d19869-08c6-4095-be0b-55229be5eedd None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:14.860342 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 337/685] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:41:14.861281 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9871136-9e21-46af-a043-465bc671de2b None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:14.887693 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211cab3-f744-47af-bc24-48ca8a907c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:14.888741 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211cab3-f744-47af-bc24-48ca8a907c18 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:14.889389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211cab3-f744-47af-bc24-48ca8a907c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:14.890906 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211cab3-f744-47af-bc24-48ca8a907c18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:14.891966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211cab3-f744-47af-bc24-48ca8a907c18 None admin] RBAC: Adding query filter params (role.id=acb8e1bf2db94178bdd6fc69b191d6b0, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=9090c22ba9f041e2a8d00750d853435a) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:14.892311 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211cab3-f744-47af-bc24-48ca8a907c18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:14.893971 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211cab3-f744-47af-bc24-48ca8a907c18 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:14.905815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 349/686] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:41:14 2022] GET /identity/v3/role_assignments?user.id=9090c22ba9f041e2a8d00750d853435a&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=acb8e1bf2db94178bdd6fc69b191d6b0 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:14.906644 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211cab3-f744-47af-bc24-48ca8a907c18 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:14.933692 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:14.995501 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9871136-9e21-46af-a043-465bc671de2b None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:15.027173 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:15.037322 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a28197-9643-474e-ba27-913d635a700a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:15.038554 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a28197-9643-474e-ba27-913d635a700a None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:15.039060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a28197-9643-474e-ba27-913d635a700a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:15.039557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a28197-9643-474e-ba27-913d635a700a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:15.048291 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211cab3-f744-47af-bc24-48ca8a907c18 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:15.128439 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013aecc4-74b0-4492-8322-c2b4a1c2c571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:15.129234 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013aecc4-74b0-4492-8322-c2b4a1c2c571 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:15.129518 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013aecc4-74b0-4492-8322-c2b4a1c2c571 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:15.129792 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013aecc4-74b0-4492-8322-c2b4a1c2c571 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:15.138838 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a28197-9643-474e-ba27-913d635a700a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:15.140582 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a28197-9643-474e-ba27-913d635a700a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:15.146452 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013aecc4-74b0-4492-8322-c2b4a1c2c571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:15.155427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-013aecc4-74b0-4492-8322-c2b4a1c2c571 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:41:15.155427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:15.155427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:15.155427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:15.155427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:15.155427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:15.155427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:15.155427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:15.155427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:15.155427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:15.155427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:15.155427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:15.155427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:15.155427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:15.155427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:15.155427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:15.156424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:15.156424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:15.156424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:15.156424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:15.156424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:15.156424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:15.156424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:15.156424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:15.156424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:15.156424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:15.156424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:15.156424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:15.156424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:15.156424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:15.156424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:15.156424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:15.157344 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:15.157344 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:15.157344 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:15.157344 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:15.157344 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:15.157344 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:15.157344 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:15.157344 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:15.157344 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:15.157344 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:15.157344 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:41:15.157344 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:15.164239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 350/687] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:41:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:15.166805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013aecc4-74b0-4492-8322-c2b4a1c2c571 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:15.265772 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 338/688] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:41:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:41:15.267381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a28197-9643-474e-ba27-913d635a700a None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:15.271967 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:15.292133 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013aecc4-74b0-4492-8322-c2b4a1c2c571 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:15.298035 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:15.334148 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58488603-def6-4f60-8565-410fbdbf932a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:15.335754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58488603-def6-4f60-8565-410fbdbf932a None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:15.336375 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58488603-def6-4f60-8565-410fbdbf932a None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:15.336862 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58488603-def6-4f60-8565-410fbdbf932a None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:15.337824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58488603-def6-4f60-8565-410fbdbf932a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:15.338421 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58488603-def6-4f60-8565-410fbdbf932a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:15.340078 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58488603-def6-4f60-8565-410fbdbf932a None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:15.354802 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 351/689] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:41:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:15.357064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58488603-def6-4f60-8565-410fbdbf932a None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:15.388982 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a28197-9643-474e-ba27-913d635a700a None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:15.429720 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343e674-e4c2-4e1b-b9aa-3048f9ad1362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:15.430639 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343e674-e4c2-4e1b-b9aa-3048f9ad1362 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:15.430925 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343e674-e4c2-4e1b-b9aa-3048f9ad1362 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:15.431198 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343e674-e4c2-4e1b-b9aa-3048f9ad1362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:15.443087 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343e674-e4c2-4e1b-b9aa-3048f9ad1362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:15.445372 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343e674-e4c2-4e1b-b9aa-3048f9ad1362 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:15.467051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-3343e674-e4c2-4e1b-b9aa-3048f9ad1362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:15.467051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:15.467051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:15.467051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:15.467051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:15.467051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:15.467051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:15.467051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:15.467051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:15.467051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:15.467051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:15.467051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:15.467051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:15.467051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:15.467051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:15.468003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:15.468003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:15.468003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:15.468003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:15.468003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:15.468003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:15.468003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:15.468003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:15.468003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:15.468003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:15.468003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:15.468003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:15.468003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:15.468003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:15.468003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:15.468003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:15.468003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:15.469373 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:15.469373 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:15.469373 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:15.469373 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:15.469373 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 339/690] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:15.476132 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343e674-e4c2-4e1b-b9aa-3048f9ad1362 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:15.526803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58488603-def6-4f60-8565-410fbdbf932a None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:15.563322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e17e1-0f67-4108-9ce5-31039feb1e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:15.564112 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e17e1-0f67-4108-9ce5-31039feb1e1b None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:15.564544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e17e1-0f67-4108-9ce5-31039feb1e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:15.564823 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e17e1-0f67-4108-9ce5-31039feb1e1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:15.577759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e17e1-0f67-4108-9ce5-31039feb1e1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:15.580340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e17e1-0f67-4108-9ce5-31039feb1e1b None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:15.586976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:15.600458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-8d6e17e1-0f67-4108-9ce5-31039feb1e1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:15.600458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:15.600458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:15.600458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:15.600458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:15.600458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:15.600458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:15.600458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:15.600458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:15.600458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:15.600458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:15.600458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:15.600458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:15.600458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:15.600458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:15.601391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:15.601391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:15.601391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:15.601391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:15.601391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:15.601391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:15.601391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:15.601391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:15.601391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:15.601391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:15.601391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:15.601391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:15.601391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:15.601391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:15.601391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:15.601391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:15.601391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:15.602283 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:15.602283 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:15.602283 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:15.602283 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:15.602798 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 352/691] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:15.608792 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e17e1-0f67-4108-9ce5-31039feb1e1b None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:15.652478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:15.675516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343e674-e4c2-4e1b-b9aa-3048f9ad1362 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:15.715197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9237d-1492-47ad-8f62-b5a0643b28aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:15.715934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9237d-1492-47ad-8f62-b5a0643b28aa None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:15.716252 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9237d-1492-47ad-8f62-b5a0643b28aa None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:15.716532 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9237d-1492-47ad-8f62-b5a0643b28aa None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:15.717288 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9237d-1492-47ad-8f62-b5a0643b28aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:15.717601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9237d-1492-47ad-8f62-b5a0643b28aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:15.719745 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9237d-1492-47ad-8f62-b5a0643b28aa None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:15.738953 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 340/692] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:15.744973 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9237d-1492-47ad-8f62-b5a0643b28aa None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:15.852378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e17e1-0f67-4108-9ce5-31039feb1e1b None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:15.892890 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9237d-1492-47ad-8f62-b5a0643b28aa None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:15.909840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a340c1-76c3-4ca1-8d2f-d615368d4534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:15.910509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a340c1-76c3-4ca1-8d2f-d615368d4534 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:15.910798 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a340c1-76c3-4ca1-8d2f-d615368d4534 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:15.911079 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a340c1-76c3-4ca1-8d2f-d615368d4534 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:15.911819 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a340c1-76c3-4ca1-8d2f-d615368d4534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:15.912148 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a340c1-76c3-4ca1-8d2f-d615368d4534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:15.914116 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a340c1-76c3-4ca1-8d2f-d615368d4534 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:15.937054 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 353/693] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:15.941449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a340c1-76c3-4ca1-8d2f-d615368d4534 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:15.961540 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac0e35-a390-44c8-9733-eb7b944c2b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:15.962343 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac0e35-a390-44c8-9733-eb7b944c2b00 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:15.962627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac0e35-a390-44c8-9733-eb7b944c2b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:15.962908 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac0e35-a390-44c8-9733-eb7b944c2b00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:15.975420 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac0e35-a390-44c8-9733-eb7b944c2b00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:15.976894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac0e35-a390-44c8-9733-eb7b944c2b00 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:15.978627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:15.992837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-07ac0e35-a390-44c8-9733-eb7b944c2b00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:15.992837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:15.992837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:15.992837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:15.992837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:15.992837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:15.992837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:15.992837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:15.992837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:15.992837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:15.992837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:15.992837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:15.992837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:15.992837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:15.992837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:15.998308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:15.998308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:15.998308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:15.998308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:15.998308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:15.998308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:15.998308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:15.998308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:15.998308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:15.998308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:15.998308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:15.998308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:15.998308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:15.998308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:15.998308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:15.998308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:15.998308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:15.999213 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:15.999213 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:15.999213 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:15.999213 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:15.999213 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:15.999213 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:15.999213 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:15.999213 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:15.999213 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 341/694] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:16.002193 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac0e35-a390-44c8-9733-eb7b944c2b00 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:16.064471 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:16.131974 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a340c1-76c3-4ca1-8d2f-d615368d4534 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:16.176438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac0e35-a390-44c8-9733-eb7b944c2b00 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:16.181465 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467abeb0-7ebe-4356-8f83-e6097e9d5e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:16.182511 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467abeb0-7ebe-4356-8f83-e6097e9d5e70 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:16.183001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467abeb0-7ebe-4356-8f83-e6097e9d5e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:16.183499 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467abeb0-7ebe-4356-8f83-e6097e9d5e70 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:16.193238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467abeb0-7ebe-4356-8f83-e6097e9d5e70 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:16.195241 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467abeb0-7ebe-4356-8f83-e6097e9d5e70 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:16.210501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-467abeb0-7ebe-4356-8f83-e6097e9d5e70 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 16:41:16.210501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:16.210501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:16.210501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:16.210501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:16.210501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:16.210501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:16.210501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:16.210501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:16.210501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:16.210501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:16.210501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:16.210501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:16.210501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:16.210501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:16.210501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:16.211508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:16.211508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:16.211508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:16.211508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:16.211508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:16.211508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:16.211508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:16.211508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:16.211508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:16.211508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:16.211508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:16.211508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:16.211508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:16.211508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:16.211508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:16.211508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:16.211508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:16.211508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:16.212509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:16.212509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:16.212509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:16.212509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:16.212509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:16.212509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:16.212509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:16.212509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:16.212509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 16:41:16.212509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:16.216310 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 354/695] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jun 22 16:41:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:16.217627 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e83be7-1bb3-4bf9-a3d5-c3efe65d48da None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:16.217922 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e83be7-1bb3-4bf9-a3d5-c3efe65d48da None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:16.218209 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e83be7-1bb3-4bf9-a3d5-c3efe65d48da None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:16.221197 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 355/696] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:16.222551 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e83be7-1bb3-4bf9-a3d5-c3efe65d48da None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:16.226222 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23aeec-2ed2-499a-8db8-82464d726934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:16.227283 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23aeec-2ed2-499a-8db8-82464d726934 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:16.228495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23aeec-2ed2-499a-8db8-82464d726934 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:16.228782 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23aeec-2ed2-499a-8db8-82464d726934 None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:16.229599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23aeec-2ed2-499a-8db8-82464d726934 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:16.229917 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23aeec-2ed2-499a-8db8-82464d726934 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:16.231356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23aeec-2ed2-499a-8db8-82464d726934 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:16.244503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 342/697] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:16.246062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90228d89-b1c0-48cb-b23a-cec491906cee None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:16.246687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90228d89-b1c0-48cb-b23a-cec491906cee None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:16.246687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90228d89-b1c0-48cb-b23a-cec491906cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:16.265201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-90228d89-b1c0-48cb-b23a-cec491906cee None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:16.266566 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-90228d89-b1c0-48cb-b23a-cec491906cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:16.326029 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:16.345653 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 343/698] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:41:16.346500 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90228d89-b1c0-48cb-b23a-cec491906cee None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:16.356678 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e83be7-1bb3-4bf9-a3d5-c3efe65d48da None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:16.380381 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:16.400431 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e8e98-770c-4be3-82f8-f1d79e297d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:16.401171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e8e98-770c-4be3-82f8-f1d79e297d7a None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:16.401578 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e8e98-770c-4be3-82f8-f1d79e297d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:16.402199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e8e98-770c-4be3-82f8-f1d79e297d7a None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:16.404049 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e8e98-770c-4be3-82f8-f1d79e297d7a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:16.404498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e8e98-770c-4be3-82f8-f1d79e297d7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:16.406176 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e8e98-770c-4be3-82f8-f1d79e297d7a None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:16.430503 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 356/699] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jun 22 16:41:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:16.431506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e8e98-770c-4be3-82f8-f1d79e297d7a None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:16.491416 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90228d89-b1c0-48cb-b23a-cec491906cee None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:16.530214 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280db43d-ec35-4789-b1a0-ef8b52b86187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:16.530930 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280db43d-ec35-4789-b1a0-ef8b52b86187 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:16.531158 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280db43d-ec35-4789-b1a0-ef8b52b86187 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:16.531440 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280db43d-ec35-4789-b1a0-ef8b52b86187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:16.532374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280db43d-ec35-4789-b1a0-ef8b52b86187 None admin] RBAC: Adding query filter params (role.id=acb8e1bf2db94178bdd6fc69b191d6b0, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=861452a1dc634bf69ce630d7dcd8a2d7) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:16.532692 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280db43d-ec35-4789-b1a0-ef8b52b86187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:16.534174 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280db43d-ec35-4789-b1a0-ef8b52b86187 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:16.541470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 344/700] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:41:16 2022] GET /identity/v3/role_assignments?user.id=861452a1dc634bf69ce630d7dcd8a2d7&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=acb8e1bf2db94178bdd6fc69b191d6b0 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:16.542498 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280db43d-ec35-4789-b1a0-ef8b52b86187 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:16.562922 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e8e98-770c-4be3-82f8-f1d79e297d7a None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:16.603738 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaaf87-cbe2-40b0-97f9-355cc9bfeb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:16.604606 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaaf87-cbe2-40b0-97f9-355cc9bfeb28 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:16.604898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaaf87-cbe2-40b0-97f9-355cc9bfeb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:16.605181 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaaf87-cbe2-40b0-97f9-355cc9bfeb28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:16.614889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:16.619590 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaaaf87-cbe2-40b0-97f9-355cc9bfeb28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:16.621683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaaaf87-cbe2-40b0-97f9-355cc9bfeb28 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:16.646785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-ecaaaf87-cbe2-40b0-97f9-355cc9bfeb28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:16.646785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:16.646785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:16.646785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:16.646785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:16.646785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:16.646785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:16.646785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:16.646785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:16.646785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:16.646785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:16.646785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:16.646785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:16.646785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:16.646785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:16.647764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:16.647764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:16.647764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:16.647764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:16.647764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:16.647764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:16.647764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:16.647764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:16.647764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:16.647764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:16.647764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:16.647764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:16.647764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:16.647764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:16.647764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:16.647764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:16.647764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:16.648705 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:16.648705 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:16.648705 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:16.648705 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:16.652282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 357/701] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:16.654840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaaf87-cbe2-40b0-97f9-355cc9bfeb28 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:16.686099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280db43d-ec35-4789-b1a0-ef8b52b86187 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:16.693007 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:16.723764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940bc92-490b-4f61-a26d-2a05d969e89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:16.725351 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940bc92-490b-4f61-a26d-2a05d969e89d None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:16.726655 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940bc92-490b-4f61-a26d-2a05d969e89d None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:16.727132 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940bc92-490b-4f61-a26d-2a05d969e89d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:16.777377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaaf87-cbe2-40b0-97f9-355cc9bfeb28 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:16.814765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940bc92-490b-4f61-a26d-2a05d969e89d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:16.816291 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2940bc92-490b-4f61-a26d-2a05d969e89d None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:16.822602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc60d07-4805-4959-b339-57d19033e6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:16.822602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc60d07-4805-4959-b339-57d19033e6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:16.822876 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc60d07-4805-4959-b339-57d19033e6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:16.823085 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc60d07-4805-4959-b339-57d19033e6e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:16.823712 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc60d07-4805-4959-b339-57d19033e6e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:16.824822 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc60d07-4805-4959-b339-57d19033e6e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:16.825896 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc60d07-4805-4959-b339-57d19033e6e7 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:16.839188 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 358/702] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:16.840579 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669fc09-e2f5-4879-8a60-087ddfb45eb0 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:16.840880 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669fc09-e2f5-4879-8a60-087ddfb45eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:16.841161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669fc09-e2f5-4879-8a60-087ddfb45eb0 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:16.842385 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 359/703] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:16.847552 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2669fa-a002-4271-bd1a-de7e92562f0c None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:16.847838 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2669fa-a002-4271-bd1a-de7e92562f0c None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:16.848155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2669fa-a002-4271-bd1a-de7e92562f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:16.867978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-5b2669fa-a002-4271-bd1a-de7e92562f0c None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:16.869429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-5b2669fa-a002-4271-bd1a-de7e92562f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:16.883350 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:16.943489 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 360/704] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:41:16.944381 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2669fa-a002-4271-bd1a-de7e92562f0c None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:16.953786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 345/705] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:41:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:41:16.956355 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940bc92-490b-4f61-a26d-2a05d969e89d None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:16.966921 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:17.073044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2669fa-a002-4271-bd1a-de7e92562f0c None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:17.085391 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2940bc92-490b-4f61-a26d-2a05d969e89d None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:17.112430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78aca2-1743-41d8-80b2-a38a7283cd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:17.113377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78aca2-1743-41d8-80b2-a38a7283cd3f None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:17.113894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78aca2-1743-41d8-80b2-a38a7283cd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:17.114538 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78aca2-1743-41d8-80b2-a38a7283cd3f None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:17.115485 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78aca2-1743-41d8-80b2-a38a7283cd3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:17.117210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78aca2-1743-41d8-80b2-a38a7283cd3f None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:17.130395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61525611-a09a-4459-b540-21f70cda1bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:17.131270 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61525611-a09a-4459-b540-21f70cda1bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:17.131557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61525611-a09a-4459-b540-21f70cda1bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:17.131832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61525611-a09a-4459-b540-21f70cda1bc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:17.143332 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61525611-a09a-4459-b540-21f70cda1bc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:17.144830 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61525611-a09a-4459-b540-21f70cda1bc9 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:17.163654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-61525611-a09a-4459-b540-21f70cda1bc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:17.163654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:17.163654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:17.163654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:17.163654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:17.163654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:17.163654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:17.163654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:17.163654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:17.163654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:17.163654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:17.163654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:17.163654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:17.163654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:17.163654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:17.164687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:17.164687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:17.164687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:17.164687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:17.164687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:17.164687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:17.164687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:17.164687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:17.164687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:17.164687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:17.164687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:17.164687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:17.164687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:17.164687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:17.164687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:17.164687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:17.164687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:17.166182 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:17.166182 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:17.166182 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:17.166182 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:17.166591 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 346/706] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:17.167666 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61525611-a09a-4459-b540-21f70cda1bc9 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:17.172634 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:17.228965 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 361/707] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 16:41:16 2022] POST /identity/v3/users => generated 254 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:41:17.229969 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78aca2-1743-41d8-80b2-a38a7283cd3f None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:17.321439 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61525611-a09a-4459-b540-21f70cda1bc9 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:17.366383 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47202711-58b0-4973-8c34-bc293235198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:17.367753 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47202711-58b0-4973-8c34-bc293235198b None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:17.368346 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47202711-58b0-4973-8c34-bc293235198b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:17.368871 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47202711-58b0-4973-8c34-bc293235198b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:17.369792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47202711-58b0-4973-8c34-bc293235198b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:17.371450 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47202711-58b0-4973-8c34-bc293235198b None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:17.389180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-47202711-58b0-4973-8c34-bc293235198b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 16:41:17.389180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:17.389180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:17.389180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:17.389180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:17.389180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:17.389180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:17.389180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:17.389180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 16:41:17.389180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:17.389180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:17.389180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:17.389180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:17.389180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:17.389180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:17.389180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:17.390251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:17.390251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:17.390251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:17.390251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:17.390251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:17.390251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:17.390251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:17.390251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:17.390251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:17.390251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:17.390251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:17.390251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:17.390251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:17.390251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:17.390251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:17.390251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:17.391108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:17.391108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:17.391108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:17.391108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:17.391108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:17.391108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:17.391108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:17.391108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:17.391108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:17.391108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:17.391108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:17.391108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:17.391108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:17.391108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 16:41:17.391108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:17.393810 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 347/708] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Jun 22 16:41:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:17.400676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47202711-58b0-4973-8c34-bc293235198b None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:17.419842 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:17.451304 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78aca2-1743-41d8-80b2-a38a7283cd3f None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:17.489151 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2f239-0251-4122-ade5-01f8f1dc0eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:17.490071 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2f239-0251-4122-ade5-01f8f1dc0eeb None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:17.490531 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:17.490662 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2f239-0251-4122-ade5-01f8f1dc0eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:17.490884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2f239-0251-4122-ade5-01f8f1dc0eeb None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:17.491696 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2f239-0251-4122-ade5-01f8f1dc0eeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:17.492530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2f239-0251-4122-ade5-01f8f1dc0eeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:17.493409 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2f239-0251-4122-ade5-01f8f1dc0eeb None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:17.513919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 362/709] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:17.515235 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2f239-0251-4122-ade5-01f8f1dc0eeb None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:17.528987 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47202711-58b0-4973-8c34-bc293235198b None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:17.564943 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9071b5c-d542-4535-8d22-92608a20ad88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:17.565952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9071b5c-d542-4535-8d22-92608a20ad88 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:17.566431 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9071b5c-d542-4535-8d22-92608a20ad88 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:17.566908 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9071b5c-d542-4535-8d22-92608a20ad88 None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:17.567831 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9071b5c-d542-4535-8d22-92608a20ad88 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:17.568386 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9071b5c-d542-4535-8d22-92608a20ad88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:17.570489 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9071b5c-d542-4535-8d22-92608a20ad88 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:17.577860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 348/710] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jun 22 16:41:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:17.581101 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9071b5c-d542-4535-8d22-92608a20ad88 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:17.633489 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2f239-0251-4122-ade5-01f8f1dc0eeb None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:17.669149 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba4d89-df23-4f60-9662-c7277ac37f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:17.669938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba4d89-df23-4f60-9662-c7277ac37f90 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:17.670218 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba4d89-df23-4f60-9662-c7277ac37f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:17.670490 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba4d89-df23-4f60-9662-c7277ac37f90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:17.672458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:17.677936 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba4d89-df23-4f60-9662-c7277ac37f90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:17.680156 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba4d89-df23-4f60-9662-c7277ac37f90 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:17.695927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-0dba4d89-df23-4f60-9662-c7277ac37f90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:17.695927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:17.695927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:17.695927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:17.695927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:17.695927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:17.695927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:17.695927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:17.695927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:17.695927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:17.695927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:17.695927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:17.695927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:17.695927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:17.695927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:17.696889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:17.696889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:17.696889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:17.696889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:17.696889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:17.696889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:17.696889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:17.696889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:17.696889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:17.696889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:17.696889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:17.696889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:17.696889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:17.696889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:17.696889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:17.696889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:17.696889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:17.698049 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:17.698049 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:17.698049 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:17.698049 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:17.698049 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:17.698049 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:17.698049 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:17.698049 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:17.699981 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9071b5c-d542-4535-8d22-92608a20ad88 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:17.701933 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 363/711] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:17.703566 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbad00f-4208-405a-babc-85b73934d349 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:17.704093 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbad00f-4208-405a-babc-85b73934d349 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:17.704594 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbad00f-4208-405a-babc-85b73934d349 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:17.706387 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 364/712] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:17.707150 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbad00f-4208-405a-babc-85b73934d349 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:17.741789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:17.746729 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0ee23-1242-4332-8a91-f5cee57b5565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:17.747479 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0ee23-1242-4332-8a91-f5cee57b5565 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:17.747816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0ee23-1242-4332-8a91-f5cee57b5565 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:17.748191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0ee23-1242-4332-8a91-f5cee57b5565 None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:17.748969 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0ee23-1242-4332-8a91-f5cee57b5565 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:17.749477 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0ee23-1242-4332-8a91-f5cee57b5565 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:17.750913 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0ee23-1242-4332-8a91-f5cee57b5565 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:17.757771 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 349/713] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jun 22 16:41:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:17.760517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74319ee9-e507-4094-a677-f3999c3068c5 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:17.760517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74319ee9-e507-4094-a677-f3999c3068c5 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:17.768908 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74319ee9-e507-4094-a677-f3999c3068c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:17.797371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-74319ee9-e507-4094-a677-f3999c3068c5 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:17.798702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-74319ee9-e507-4094-a677-f3999c3068c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:17.834375 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbad00f-4208-405a-babc-85b73934d349 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:17.886597 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fe1ab-9aff-40f4-9236-f2ff022682ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:17.887832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fe1ab-9aff-40f4-9236-f2ff022682ce None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:17.888346 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fe1ab-9aff-40f4-9236-f2ff022682ce None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:17.888810 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fe1ab-9aff-40f4-9236-f2ff022682ce None admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:17.889850 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fe1ab-9aff-40f4-9236-f2ff022682ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:17.890380 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fe1ab-9aff-40f4-9236-f2ff022682ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:17.891989 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fe1ab-9aff-40f4-9236-f2ff022682ce None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:17.907927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 350/714] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:41:17.920804 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 365/715] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:17.927081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74319ee9-e507-4094-a677-f3999c3068c5 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:17.946670 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fe1ab-9aff-40f4-9236-f2ff022682ce None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:18.061964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74319ee9-e507-4094-a677-f3999c3068c5 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:18.091900 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:18.096064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:18.110922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e1d4e-89ee-4ab1-8308-57024b3a1270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:18.111581 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e1d4e-89ee-4ab1-8308-57024b3a1270 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:18.111866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e1d4e-89ee-4ab1-8308-57024b3a1270 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:18.112251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e1d4e-89ee-4ab1-8308-57024b3a1270 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:18.113239 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e1d4e-89ee-4ab1-8308-57024b3a1270 None admin] RBAC: Adding query filter params (role.id=459b0e5c21c94fb1b81f76c65780fdb5, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=78e7bdfffdc84465a570d135d1d86380) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:18.113553 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e1d4e-89ee-4ab1-8308-57024b3a1270 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:18.116046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e1d4e-89ee-4ab1-8308-57024b3a1270 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:18.123348 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fe1ab-9aff-40f4-9236-f2ff022682ce None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:18.128286 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 351/716] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:41:17 2022] GET /identity/v3/role_assignments?user.id=78e7bdfffdc84465a570d135d1d86380&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=459b0e5c21c94fb1b81f76c65780fdb5 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:18.177663 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f604ee-010a-4026-b6d8-b9e8f5f676d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:18.179464 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f604ee-010a-4026-b6d8-b9e8f5f676d6 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:18.179944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f604ee-010a-4026-b6d8-b9e8f5f676d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:18.180455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f604ee-010a-4026-b6d8-b9e8f5f676d6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:18.181338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f604ee-010a-4026-b6d8-b9e8f5f676d6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:18.183008 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f604ee-010a-4026-b6d8-b9e8f5f676d6 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:18.205124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-a6f604ee-010a-4026-b6d8-b9e8f5f676d6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 16:41:18.205124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:18.205124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:18.205124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:18.205124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:18.205124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:18.205124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:18.205124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:18.205124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 16:41:18.205124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:18.205124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:18.205124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:18.205124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:18.205124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:18.205124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:18.205124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:18.205124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:18.206185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:18.206185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:18.206185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:18.206185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:18.206185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:18.206185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:18.206185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:18.206185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:18.206185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:18.206185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:18.206185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:18.206185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:18.206185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:18.206185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:18.206185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:18.206185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:18.207029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:18.207029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:18.207029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:18.207029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:18.207029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:18.207029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:18.207029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:18.207029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:18.207029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:18.207029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:18.207029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:18.207029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:18.207029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 16:41:18.207029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:18.216740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 366/717] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:17 2022] GET /identity/v3/services/network => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:18.222247 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e1d4e-89ee-4ab1-8308-57024b3a1270 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:18.347097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e1d4e-89ee-4ab1-8308-57024b3a1270 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:18.383105 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02753a46-da78-4a1f-874d-f5d65f811bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:18.384154 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02753a46-da78-4a1f-874d-f5d65f811bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:18.384634 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02753a46-da78-4a1f-874d-f5d65f811bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:18.385103 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02753a46-da78-4a1f-874d-f5d65f811bb0 None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:18.385999 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02753a46-da78-4a1f-874d-f5d65f811bb0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:18.386533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02753a46-da78-4a1f-874d-f5d65f811bb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:18.388375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02753a46-da78-4a1f-874d-f5d65f811bb0 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:18.393424 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 352/718] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 16:41:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:18.401271 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f604ee-010a-4026-b6d8-b9e8f5f676d6 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:18.524907 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f604ee-010a-4026-b6d8-b9e8f5f676d6 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:18.551068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:18.581909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b19f0-fc02-4371-b5c7-98c52cd157c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:18.581909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b19f0-fc02-4371-b5c7-98c52cd157c0 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:18.581909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b19f0-fc02-4371-b5c7-98c52cd157c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:18.581909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b19f0-fc02-4371-b5c7-98c52cd157c0 None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:18.586338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b19f0-fc02-4371-b5c7-98c52cd157c0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:18.586338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b19f0-fc02-4371-b5c7-98c52cd157c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:18.586338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b19f0-fc02-4371-b5c7-98c52cd157c0 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:18.600962 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 367/719] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 16:41:18 2022] GET /identity/v3/services?type=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:19.037298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793b48f-4ced-484e-a8f0-c1444187341e None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:19.037611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793b48f-4ced-484e-a8f0-c1444187341e None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:19.037864 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793b48f-4ced-484e-a8f0-c1444187341e None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:19.039245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 353/720] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:19.045283 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a969b2e-b612-4024-8389-910be05a2660 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:19.045580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a969b2e-b612-4024-8389-910be05a2660 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:19.045860 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a969b2e-b612-4024-8389-910be05a2660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:19.067995 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-3a969b2e-b612-4024-8389-910be05a2660 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:19.069789 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3a969b2e-b612-4024-8389-910be05a2660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:19.172430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 368/721] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:41:19.203029 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793b48f-4ced-484e-a8f0-c1444187341e None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:19.301584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:19.360692 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793b48f-4ced-484e-a8f0-c1444187341e None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:19.411639 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7c8e5-e540-4e52-91ab-2ddc1a390f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:19.412485 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7c8e5-e540-4e52-91ab-2ddc1a390f02 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:19.412775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7c8e5-e540-4e52-91ab-2ddc1a390f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:19.413053 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7c8e5-e540-4e52-91ab-2ddc1a390f02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:19.432976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7c8e5-e540-4e52-91ab-2ddc1a390f02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:19.440651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-3cb7c8e5-e540-4e52-91ab-2ddc1a390f02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:41:19.440651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:19.440651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:19.440651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:19.440651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:19.440651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:19.440651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:19.440651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:19.440651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:19.440651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:19.440651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:19.440651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:19.440651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:19.440651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:19.440651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:19.440651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:19.441594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:19.441594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:19.441594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:19.441594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:19.441594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:19.441594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:19.441594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:19.441594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:19.441594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:19.441594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:19.441594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:19.441594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:19.441594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:19.441594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:19.441594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:19.441594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:19.442855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:19.442855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:19.442855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:19.442855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:19.442855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:19.442855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:19.442855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:19.442855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:19.442855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:19.442855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:19.442855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:41:19.442855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:19.442855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 354/722] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:41:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:19.448402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a969b2e-b612-4024-8389-910be05a2660 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:19.566706 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a969b2e-b612-4024-8389-910be05a2660 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:19.581420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:19.607786 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54181024-6a38-4c3c-a002-9373a78f542f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:19.608829 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54181024-6a38-4c3c-a002-9373a78f542f None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:19.609319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54181024-6a38-4c3c-a002-9373a78f542f None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:19.609817 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54181024-6a38-4c3c-a002-9373a78f542f None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:19.610778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54181024-6a38-4c3c-a002-9373a78f542f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:19.611315 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54181024-6a38-4c3c-a002-9373a78f542f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:19.612916 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54181024-6a38-4c3c-a002-9373a78f542f None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:19.622409 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 369/723] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:41:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:19.629625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7c8e5-e540-4e52-91ab-2ddc1a390f02 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:19.792409 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f36f00-c433-4bbf-98bb-fba08a0cb2d8 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:19.792703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f36f00-c433-4bbf-98bb-fba08a0cb2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:19.792992 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f36f00-c433-4bbf-98bb-fba08a0cb2d8 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:19.794637 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 370/724] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:19.796977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7c8e5-e540-4e52-91ab-2ddc1a390f02 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:19.805739 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f784c-e565-4598-8c8c-9d4bf5f725bf None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:19.806040 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f784c-e565-4598-8c8c-9d4bf5f725bf None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:19.806317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f784c-e565-4598-8c8c-9d4bf5f725bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:19.820551 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:19.841250 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d08897-19d4-43a0-a303-a821c361e753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:19.842044 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d08897-19d4-43a0-a303-a821c361e753 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:19.842329 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d08897-19d4-43a0-a303-a821c361e753 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:19.842609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d08897-19d4-43a0-a303-a821c361e753 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:19.843981 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-477f784c-e565-4598-8c8c-9d4bf5f725bf None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:19.845520 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-477f784c-e565-4598-8c8c-9d4bf5f725bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:19.856640 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d08897-19d4-43a0-a303-a821c361e753 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:19.858518 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d08897-19d4-43a0-a303-a821c361e753 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:19.889184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-a3d08897-19d4-43a0-a303-a821c361e753 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:19.889184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:19.889184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:19.889184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:19.889184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:19.889184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:19.889184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:19.889184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:19.889184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:19.889184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:19.889184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:19.889184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:19.889184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:19.889184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:19.889184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:19.890234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:19.890234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:19.890234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:19.890234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:19.890234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:19.890234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:19.890234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:19.890234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:19.890234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:19.890234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:19.890234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:19.890234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:19.890234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:19.890234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:19.890234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:19.890234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:19.890234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:19.891151 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:19.891151 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:19.891151 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:19.891151 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:19.898711 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 355/725] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:19.904686 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d08897-19d4-43a0-a303-a821c361e753 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:19.937327 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 371/726] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 22 16:41:19.965854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f784c-e565-4598-8c8c-9d4bf5f725bf None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:20.069960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d08897-19d4-43a0-a303-a821c361e753 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:20.107227 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf1de8-f1b5-4548-ba2a-ca5ccacccff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:20.107902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf1de8-f1b5-4548-ba2a-ca5ccacccff7 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:20.108215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf1de8-f1b5-4548-ba2a-ca5ccacccff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:20.108507 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf1de8-f1b5-4548-ba2a-ca5ccacccff7 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:20.109243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf1de8-f1b5-4548-ba2a-ca5ccacccff7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:20.109719 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf1de8-f1b5-4548-ba2a-ca5ccacccff7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:20.111416 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf1de8-f1b5-4548-ba2a-ca5ccacccff7 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:20.124957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 356/727] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:20.130418 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf1de8-f1b5-4548-ba2a-ca5ccacccff7 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:20.161329 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:20.234264 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f784c-e565-4598-8c8c-9d4bf5f725bf None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:20.240943 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:20.243567 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf1de8-f1b5-4548-ba2a-ca5ccacccff7 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:20.282863 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024cadd-00ab-4574-b4a7-fae0691398ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:20.283657 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024cadd-00ab-4574-b4a7-fae0691398ac None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:20.284410 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024cadd-00ab-4574-b4a7-fae0691398ac None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:20.284698 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024cadd-00ab-4574-b4a7-fae0691398ac None admin] PATH_INFO: `/v3/users/swift` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:20.292788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024cadd-00ab-4574-b4a7-fae0691398ac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:20.294243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024cadd-00ab-4574-b4a7-fae0691398ac None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:20.311244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-6024cadd-00ab-4574-b4a7-fae0691398ac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 16:41:20.311244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:20.311244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:20.311244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:20.311244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:20.311244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:20.311244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:20.311244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:20.311244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:20.311244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:20.311244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:20.311244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:20.311244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:20.311244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:20.311244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:20.311244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:20.312311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:20.312311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:20.312311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:20.312311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:20.312311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:20.312311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:20.312311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:20.312311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:20.312311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:20.312311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:20.312311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:20.312311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:20.312311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:20.312311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:20.312311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:20.312311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:20.312311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:20.312311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:20.313279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:20.313279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:20.313279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:20.313279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:20.313279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:20.313279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:20.313279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:20.313279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:20.313279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 16:41:20.313279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:20.313279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 357/728] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:41:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:20.319652 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024cadd-00ab-4574-b4a7-fae0691398ac None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:20.340722 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8908cb3-a1aa-4aa3-a647-7f72be56c45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:20.341534 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8908cb3-a1aa-4aa3-a647-7f72be56c45a None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:20.341819 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8908cb3-a1aa-4aa3-a647-7f72be56c45a None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:20.342090 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8908cb3-a1aa-4aa3-a647-7f72be56c45a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:20.360251 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8908cb3-a1aa-4aa3-a647-7f72be56c45a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:20.368891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-b8908cb3-a1aa-4aa3-a647-7f72be56c45a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:20.368891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:20.368891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:20.368891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:20.368891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:20.368891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:20.368891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:20.368891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:20.368891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:20.368891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:20.368891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:20.368891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:20.368891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:20.368891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:20.368891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:20.368891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:20.369839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:20.369839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:20.369839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:20.369839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:20.369839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:20.369839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:20.369839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:20.369839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:20.369839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:20.369839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:20.369839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:20.369839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:20.369839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:20.369839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:20.369839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:20.369839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:20.371476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:20.371476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:20.371476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:20.371476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:20.371476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:20.371476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:20.371476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:20.371476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:20.371476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:20.371476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:20.371476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:20.371476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:20.371476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 372/729] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:41:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:20.378931 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8908cb3-a1aa-4aa3-a647-7f72be56c45a None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:20.415924 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:20.445753 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024cadd-00ab-4574-b4a7-fae0691398ac None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:20.510548 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13014787-eaaf-46ab-ae9d-7f361f147c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:20.511210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13014787-eaaf-46ab-ae9d-7f361f147c8a None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:20.511487 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13014787-eaaf-46ab-ae9d-7f361f147c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:20.511757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13014787-eaaf-46ab-ae9d-7f361f147c8a None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:20.512880 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13014787-eaaf-46ab-ae9d-7f361f147c8a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:20.513186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13014787-eaaf-46ab-ae9d-7f361f147c8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:20.514610 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13014787-eaaf-46ab-ae9d-7f361f147c8a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:20.547763 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 358/730] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jun 22 16:41:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:20.555033 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13014787-eaaf-46ab-ae9d-7f361f147c8a None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:20.579556 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8908cb3-a1aa-4aa3-a647-7f72be56c45a None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:20.629561 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdf620-db0c-436d-82bb-a5d8e84ed75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:20.630159 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdf620-db0c-436d-82bb-a5d8e84ed75f None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:20.630449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdf620-db0c-436d-82bb-a5d8e84ed75f None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:20.630731 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdf620-db0c-436d-82bb-a5d8e84ed75f None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:20.631521 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdf620-db0c-436d-82bb-a5d8e84ed75f None admin] RBAC: Adding query filter params (name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:20.631832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdf620-db0c-436d-82bb-a5d8e84ed75f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:20.633328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdf620-db0c-436d-82bb-a5d8e84ed75f None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:20.642309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 373/731] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 16:41:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:20.649150 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdf620-db0c-436d-82bb-a5d8e84ed75f None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:20.689363 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:20.777699 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13014787-eaaf-46ab-ae9d-7f361f147c8a None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:20.806254 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdf620-db0c-436d-82bb-a5d8e84ed75f None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:20.813863 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95e36e-8c32-42fe-9459-68f69222f642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:20.814513 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95e36e-8c32-42fe-9459-68f69222f642 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:20.814836 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95e36e-8c32-42fe-9459-68f69222f642 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:20.815083 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95e36e-8c32-42fe-9459-68f69222f642 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:20.830876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:20.846904 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccff92a-642b-453e-9efa-4c24f9a41e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:20.848708 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccff92a-642b-453e-9efa-4c24f9a41e23 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:20.849212 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccff92a-642b-453e-9efa-4c24f9a41e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:20.849731 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccff92a-642b-453e-9efa-4c24f9a41e23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:20.867907 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccff92a-642b-453e-9efa-4c24f9a41e23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:20.870678 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccff92a-642b-453e-9efa-4c24f9a41e23 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:20.889224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-1ccff92a-642b-453e-9efa-4c24f9a41e23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:20.889224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:20.889224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:20.889224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:20.889224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:20.889224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:20.889224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:20.889224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:20.889224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:20.889224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:20.889224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:20.889224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:20.889224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:20.889224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:20.889224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:20.890126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:20.890126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:20.890126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:20.890126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:20.890126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:20.890126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:20.890126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:20.890126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:20.890126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:20.890126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:20.890126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:20.890126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:20.890126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:20.890126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:20.890126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:20.890126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:20.890126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:20.891029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:20.891029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:20.891029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:20.891029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:20.891029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 374/732] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:20.891635 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abaad41-585a-4cb6-873b-f696feff1da7 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:20.891929 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abaad41-585a-4cb6-873b-f696feff1da7 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:20.892229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abaad41-585a-4cb6-873b-f696feff1da7 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:20.895854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 375/733] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:20.895854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c32122-72f7-4233-ba3e-3f31d5b58cd5 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:20.895854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c32122-72f7-4233-ba3e-3f31d5b58cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:20.895854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c32122-72f7-4233-ba3e-3f31d5b58cd5 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:20.899099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95e36e-8c32-42fe-9459-68f69222f642 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:20.900655 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95e36e-8c32-42fe-9459-68f69222f642 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:20.901845 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 376/734] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:20.902546 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c32122-72f7-4233-ba3e-3f31d5b58cd5 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:20.991103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:21.015963 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 359/735] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:41:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:41:21.015963 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb467f-2922-4a35-a237-e0eaa19bc57f None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:21.015963 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb467f-2922-4a35-a237-e0eaa19bc57f None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:21.015963 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb467f-2922-4a35-a237-e0eaa19bc57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:21.027559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c32122-72f7-4233-ba3e-3f31d5b58cd5 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:21.030859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-08eb467f-2922-4a35-a237-e0eaa19bc57f None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:21.032044 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-08eb467f-2922-4a35-a237-e0eaa19bc57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:21.066932 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2682f1-130e-4081-8dd2-596ccb2fccfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:21.067598 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2682f1-130e-4081-8dd2-596ccb2fccfe None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:21.067944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2682f1-130e-4081-8dd2-596ccb2fccfe None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:21.068273 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2682f1-130e-4081-8dd2-596ccb2fccfe None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:21.069095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2682f1-130e-4081-8dd2-596ccb2fccfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:21.069568 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2682f1-130e-4081-8dd2-596ccb2fccfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:21.071074 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2682f1-130e-4081-8dd2-596ccb2fccfe None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:21.075113 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:21.089643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 377/736] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:21.089643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00541f3-4a84-40b0-bbae-a583d4d3343b None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:21.089643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00541f3-4a84-40b0-bbae-a583d4d3343b None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:21.089643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00541f3-4a84-40b0-bbae-a583d4d3343b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:21.107335 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-f00541f3-4a84-40b0-bbae-a583d4d3343b None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:21.108636 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f00541f3-4a84-40b0-bbae-a583d4d3343b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:21.120363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 360/737] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:41:21.120363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb467f-2922-4a35-a237-e0eaa19bc57f None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:21.181380 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 378/738] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:41:21.182148 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00541f3-4a84-40b0-bbae-a583d4d3343b None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:21.242593 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb467f-2922-4a35-a237-e0eaa19bc57f None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:21.262104 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:21.283197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87de401-9165-4573-bb18-f4e282faa80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:21.284429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87de401-9165-4573-bb18-f4e282faa80d None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:21.284874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87de401-9165-4573-bb18-f4e282faa80d None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:21.285315 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87de401-9165-4573-bb18-f4e282faa80d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:21.297631 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87de401-9165-4573-bb18-f4e282faa80d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:21.299076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87de401-9165-4573-bb18-f4e282faa80d None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:21.300934 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00541f3-4a84-40b0-bbae-a583d4d3343b None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:21.316277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-e87de401-9165-4573-bb18-f4e282faa80d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:21.316277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:21.316277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:21.316277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:21.316277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:21.316277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:21.316277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:21.316277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:21.316277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:21.316277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:21.316277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:21.316277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:21.316277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:21.316277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:21.316277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:21.317209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:21.317209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:21.317209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:21.317209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:21.317209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:21.317209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:21.317209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:21.317209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:21.317209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:21.317209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:21.317209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:21.317209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:21.317209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:21.317209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:21.317209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:21.317209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:21.317209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:21.318150 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:21.318150 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:21.318150 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:21.318150 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:21.318150 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 361/739] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:21.318941 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87de401-9165-4573-bb18-f4e282faa80d None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:21.338242 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4f350-341d-48b5-b7a7-82146c1b246d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:21.339056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4f350-341d-48b5-b7a7-82146c1b246d None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:21.339346 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4f350-341d-48b5-b7a7-82146c1b246d None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:21.339624 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4f350-341d-48b5-b7a7-82146c1b246d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:21.345826 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:21.346632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4f350-341d-48b5-b7a7-82146c1b246d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:21.348082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4f350-341d-48b5-b7a7-82146c1b246d None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:21.362894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-1af4f350-341d-48b5-b7a7-82146c1b246d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 16:41:21.362894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:21.362894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:21.362894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:21.362894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:21.362894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:21.362894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:21.362894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:21.362894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:21.362894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:21.362894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:21.362894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:21.362894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:21.362894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:21.362894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:21.362894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:21.363852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:21.363852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:21.363852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:21.363852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:21.363852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:21.363852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:21.363852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:21.363852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:21.363852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:21.363852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:21.363852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:21.363852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:21.363852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:21.363852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:21.363852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:21.363852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:21.363852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:21.363852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:21.365051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:21.365051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:21.365051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:21.365051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:21.365051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:21.365051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:21.365051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:21.365051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:21.365051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 16:41:21.365051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:21.365051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 379/740] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jun 22 16:41:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:21.365641 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4f350-341d-48b5-b7a7-82146c1b246d None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:21.420815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87de401-9165-4573-bb18-f4e282faa80d None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:21.454435 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a156a5d-fc8c-452d-affe-36ef0ffc6221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:21.455405 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a156a5d-fc8c-452d-affe-36ef0ffc6221 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:21.455687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a156a5d-fc8c-452d-affe-36ef0ffc6221 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:21.455961 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a156a5d-fc8c-452d-affe-36ef0ffc6221 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:21.463276 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4f350-341d-48b5-b7a7-82146c1b246d None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:21.466384 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a156a5d-fc8c-452d-affe-36ef0ffc6221 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:21.473815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-6a156a5d-fc8c-452d-affe-36ef0ffc6221 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:41:21.473815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:21.473815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:21.473815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:21.473815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:21.473815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:21.473815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:21.473815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:21.473815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:21.473815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:21.473815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:21.473815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:21.473815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:21.473815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:21.473815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:21.473815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:21.474927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:21.474927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:21.474927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:21.474927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:21.474927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:21.474927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:21.474927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:21.474927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:21.474927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:21.474927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:21.474927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:21.474927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:21.474927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:21.474927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:21.474927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:21.474927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:21.475788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:21.475788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:21.475788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:21.475788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:21.475788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:21.475788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:21.475788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:21.475788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:21.475788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:21.475788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:21.475788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:41:21.475788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:21.475788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 362/741] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:41:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:21.476556 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da209d5-3b77-4a07-889b-e73960b4c5d4 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:21.476796 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da209d5-3b77-4a07-889b-e73960b4c5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:21.477069 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da209d5-3b77-4a07-889b-e73960b4c5d4 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:21.478301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 363/742] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:21.478978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da209d5-3b77-4a07-889b-e73960b4c5d4 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:21.493391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:21.501077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2ea43-bbea-4039-a860-eb8e40d9ad1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:21.501733 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2ea43-bbea-4039-a860-eb8e40d9ad1b None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:21.502015 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2ea43-bbea-4039-a860-eb8e40d9ad1b None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:21.502293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2ea43-bbea-4039-a860-eb8e40d9ad1b None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:21.507884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2ea43-bbea-4039-a860-eb8e40d9ad1b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:21.507884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2ea43-bbea-4039-a860-eb8e40d9ad1b None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:21.565773 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:21.581828 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da209d5-3b77-4a07-889b-e73960b4c5d4 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:21.607135 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 380/743] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 16:41:21 2022] POST /identity/v3/services => generated 251 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:41:21.608144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2ea43-bbea-4039-a860-eb8e40d9ad1b None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:21.633335 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898479b-640c-4704-a086-10d4cf4fde1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:21.634129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898479b-640c-4704-a086-10d4cf4fde1f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:21.634619 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898479b-640c-4704-a086-10d4cf4fde1f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:21.634960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898479b-640c-4704-a086-10d4cf4fde1f None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:21.635793 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898479b-640c-4704-a086-10d4cf4fde1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:21.636195 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898479b-640c-4704-a086-10d4cf4fde1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:21.638000 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898479b-640c-4704-a086-10d4cf4fde1f None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:21.651443 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 364/744] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:21.652708 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898479b-640c-4704-a086-10d4cf4fde1f None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:21.724166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2ea43-bbea-4039-a860-eb8e40d9ad1b None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:21.763244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898479b-640c-4704-a086-10d4cf4fde1f None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:21.766234 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b7c5d-c3f5-459b-8cc3-cd54f6ca2489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:21.766915 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b7c5d-c3f5-459b-8cc3-cd54f6ca2489 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:21.767203 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b7c5d-c3f5-459b-8cc3-cd54f6ca2489 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:21.767482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b7c5d-c3f5-459b-8cc3-cd54f6ca2489 None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:21.768421 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b7c5d-c3f5-459b-8cc3-cd54f6ca2489 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:21.768736 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b7c5d-c3f5-459b-8cc3-cd54f6ca2489 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:21.770178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b7c5d-c3f5-459b-8cc3-cd54f6ca2489 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:21.790375 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 381/745] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jun 22 16:41:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:21.791194 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925185d-3cb8-4512-bbbc-393a913a08e7 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:21.791486 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925185d-3cb8-4512-bbbc-393a913a08e7 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:21.791764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925185d-3cb8-4512-bbbc-393a913a08e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:21.808738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906587d-ecf2-4349-bc9c-3cd232de7ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:21.809487 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906587d-ecf2-4349-bc9c-3cd232de7ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:21.809833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906587d-ecf2-4349-bc9c-3cd232de7ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:21.810070 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-7925185d-3cb8-4512-bbbc-393a913a08e7 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:21.810247 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906587d-ecf2-4349-bc9c-3cd232de7ac3 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:21.811068 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906587d-ecf2-4349-bc9c-3cd232de7ac3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:21.811440 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906587d-ecf2-4349-bc9c-3cd232de7ac3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:21.811546 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-7925185d-3cb8-4512-bbbc-393a913a08e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:21.813006 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906587d-ecf2-4349-bc9c-3cd232de7ac3 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:21.828988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 365/746] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:41:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:21.828988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906587d-ecf2-4349-bc9c-3cd232de7ac3 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:21.832842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:21.858986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:21.900128 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 382/747] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 22 16:41:21.900128 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925185d-3cb8-4512-bbbc-393a913a08e7 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:21.942861 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906587d-ecf2-4349-bc9c-3cd232de7ac3 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:21.979699 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb5a4c-818c-46c8-b33e-29e1cff86688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:21.980584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb5a4c-818c-46c8-b33e-29e1cff86688 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:21.980970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb5a4c-818c-46c8-b33e-29e1cff86688 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:21.981385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb5a4c-818c-46c8-b33e-29e1cff86688 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:21.988482 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb5a4c-818c-46c8-b33e-29e1cff86688 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:21.990026 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb5a4c-818c-46c8-b33e-29e1cff86688 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:22.004557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-e4bb5a4c-818c-46c8-b33e-29e1cff86688 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:22.004557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:22.004557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:22.004557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:22.004557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:22.004557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:22.004557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:22.004557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:22.004557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:22.004557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:22.004557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:22.004557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:22.004557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:22.004557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:22.004557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:22.005465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:22.005465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:22.005465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:22.005465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:22.005465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:22.005465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:22.005465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:22.005465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:22.005465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:22.005465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:22.005465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:22.005465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:22.005465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:22.005465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:22.005465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:22.005465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:22.005465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:22.006484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:22.006484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:22.006484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:22.006484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:22.006484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:22.006484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:22.006484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:22.006484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:22.006484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 366/748] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:22.007041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb5a4c-818c-46c8-b33e-29e1cff86688 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:22.019688 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925185d-3cb8-4512-bbbc-393a913a08e7 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:22.058118 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff7a39-b733-4559-b757-dbfabe55e704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:22.058761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff7a39-b733-4559-b757-dbfabe55e704 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:22.059045 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff7a39-b733-4559-b757-dbfabe55e704 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:22.059324 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff7a39-b733-4559-b757-dbfabe55e704 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:22.079323 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:22.108181 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:22.119424 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb5a4c-818c-46c8-b33e-29e1cff86688 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:22.131724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff7a39-b733-4559-b757-dbfabe55e704 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:22.133596 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff7a39-b733-4559-b757-dbfabe55e704 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:22.164650 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89359622-d597-4b5e-a943-f4f1fbebfa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:22.165480 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89359622-d597-4b5e-a943-f4f1fbebfa21 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:22.165763 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89359622-d597-4b5e-a943-f4f1fbebfa21 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:22.166037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89359622-d597-4b5e-a943-f4f1fbebfa21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:22.180470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89359622-d597-4b5e-a943-f4f1fbebfa21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:22.181936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89359622-d597-4b5e-a943-f4f1fbebfa21 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:22.199967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-89359622-d597-4b5e-a943-f4f1fbebfa21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:22.199967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:22.199967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:22.199967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:22.199967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:22.199967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:22.199967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:22.199967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:22.199967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:22.199967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:22.199967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:22.199967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:22.199967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:22.199967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:22.199967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:22.200934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:22.200934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:22.200934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:22.200934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:22.200934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:22.200934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:22.200934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:22.200934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:22.200934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:22.200934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:22.200934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:22.200934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:22.200934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:22.200934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:22.200934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:22.200934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:22.200934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:22.206683 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:22.206683 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:22.206683 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:22.206683 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:22.206683 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 367/749] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:22.206683 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89359622-d597-4b5e-a943-f4f1fbebfa21 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:22.243604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 383/750] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:41:21 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 22 16:41:22.244464 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff7a39-b733-4559-b757-dbfabe55e704 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:22.311829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89359622-d597-4b5e-a943-f4f1fbebfa21 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:22.325789 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:22.330152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:22.347812 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25b709-7560-4578-85a1-d9ac24eb09ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:22.348516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25b709-7560-4578-85a1-d9ac24eb09ca None admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:22.348803 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25b709-7560-4578-85a1-d9ac24eb09ca None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:22.349077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25b709-7560-4578-85a1-d9ac24eb09ca None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:22.350391 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25b709-7560-4578-85a1-d9ac24eb09ca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:22.350832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff7a39-b733-4559-b757-dbfabe55e704 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:22.351766 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25b709-7560-4578-85a1-d9ac24eb09ca None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:22.384054 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567fb98-78ce-4fc4-9bf0-1013896a09a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:22.384735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567fb98-78ce-4fc4-9bf0-1013896a09a8 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:22.385020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567fb98-78ce-4fc4-9bf0-1013896a09a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:22.385292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567fb98-78ce-4fc4-9bf0-1013896a09a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:22.386069 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567fb98-78ce-4fc4-9bf0-1013896a09a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:22.386376 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567fb98-78ce-4fc4-9bf0-1013896a09a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:22.388057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567fb98-78ce-4fc4-9bf0-1013896a09a8 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:22.399547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 384/751] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:22.400341 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567fb98-78ce-4fc4-9bf0-1013896a09a8 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:22.430038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 368/752] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 16:41:22 2022] POST /identity/v3/services => generated 240 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:41:22.441327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25b709-7560-4578-85a1-d9ac24eb09ca None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:22.531661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567fb98-78ce-4fc4-9bf0-1013896a09a8 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:22.571975 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:22.580983 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861c4d2-f34a-44e2-b6ea-c40136e14aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:22.580983 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861c4d2-f34a-44e2-b6ea-c40136e14aaa None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:22.580983 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861c4d2-f34a-44e2-b6ea-c40136e14aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:22.580983 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861c4d2-f34a-44e2-b6ea-c40136e14aaa None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:22.581312 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861c4d2-f34a-44e2-b6ea-c40136e14aaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:22.581312 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861c4d2-f34a-44e2-b6ea-c40136e14aaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:22.581312 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861c4d2-f34a-44e2-b6ea-c40136e14aaa None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:22.593292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 385/753] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:22.594226 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861c4d2-f34a-44e2-b6ea-c40136e14aaa None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:22.607076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25b709-7560-4578-85a1-d9ac24eb09ca None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:22.651067 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93bd22f-bb76-481a-8817-2de64a6bdacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:22.652009 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bd22f-bb76-481a-8817-2de64a6bdacb None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:22.652325 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bd22f-bb76-481a-8817-2de64a6bdacb None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:22.652603 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bd22f-bb76-481a-8817-2de64a6bdacb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:22.666300 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93bd22f-bb76-481a-8817-2de64a6bdacb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:22.667750 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93bd22f-bb76-481a-8817-2de64a6bdacb None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:22.690357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-c93bd22f-bb76-481a-8817-2de64a6bdacb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:22.690357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:22.690357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:22.690357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:22.690357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:22.690357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:22.690357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:22.690357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:22.690357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:22.690357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:22.690357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:22.690357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:22.690357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:22.690357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:22.690357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:22.691334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:22.691334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:22.691334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:22.691334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:22.691334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:22.691334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:22.691334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:22.691334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:22.691334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:22.691334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:22.691334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:22.691334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:22.691334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:22.691334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:22.691334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:22.691334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:22.691334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:22.692254 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:22.692254 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:22.692254 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:22.692254 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:22.694185 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 369/754] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:22.694766 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93bd22f-bb76-481a-8817-2de64a6bdacb None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:22.722128 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861c4d2-f34a-44e2-b6ea-c40136e14aaa None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:22.734627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:22.765643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0f7a8-c3de-45e3-aa27-c1bd9c23123a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:22.767617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0f7a8-c3de-45e3-aa27-c1bd9c23123a None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:22.768213 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0f7a8-c3de-45e3-aa27-c1bd9c23123a None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:22.769246 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0f7a8-c3de-45e3-aa27-c1bd9c23123a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:22.770425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0f7a8-c3de-45e3-aa27-c1bd9c23123a None admin] RBAC: Adding query filter params (role.id=459b0e5c21c94fb1b81f76c65780fdb5, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=861452a1dc634bf69ce630d7dcd8a2d7) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:22.771078 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0f7a8-c3de-45e3-aa27-c1bd9c23123a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:22.773746 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0f7a8-c3de-45e3-aa27-c1bd9c23123a None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:22.780208 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 386/755] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:41:22 2022] GET /identity/v3/role_assignments?user.id=861452a1dc634bf69ce630d7dcd8a2d7&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=459b0e5c21c94fb1b81f76c65780fdb5 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:22.781179 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0f7a8-c3de-45e3-aa27-c1bd9c23123a None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:22.847037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93bd22f-bb76-481a-8817-2de64a6bdacb None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:22.856302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:22.924409 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0f7a8-c3de-45e3-aa27-c1bd9c23123a None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:22.950671 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831eb52b-5093-4ee9-b74b-323a2eab4046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:22.951525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831eb52b-5093-4ee9-b74b-323a2eab4046 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:22.951815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831eb52b-5093-4ee9-b74b-323a2eab4046 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:22.952088 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831eb52b-5093-4ee9-b74b-323a2eab4046 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:22.971147 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831eb52b-5093-4ee9-b74b-323a2eab4046 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:22.972060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccc005-55d8-4a43-9615-1eff39f81117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:22.972871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccc005-55d8-4a43-9615-1eff39f81117 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:22.973259 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccc005-55d8-4a43-9615-1eff39f81117 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:22.973639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccc005-55d8-4a43-9615-1eff39f81117 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:22.974500 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ccc005-55d8-4a43-9615-1eff39f81117 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:22.974959 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ccc005-55d8-4a43-9615-1eff39f81117 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:22.976658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831eb52b-5093-4ee9-b74b-323a2eab4046 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:22.978169 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ccc005-55d8-4a43-9615-1eff39f81117 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:22.996145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 387/756] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:23.001111 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccc005-55d8-4a43-9615-1eff39f81117 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:23.005369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-831eb52b-5093-4ee9-b74b-323a2eab4046 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 16:41:23.005369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:23.005369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:23.005369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:23.005369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:23.005369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:23.005369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:23.005369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:23.005369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:23.005369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:23.005369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:23.005369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:23.005369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:23.005369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:23.005369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:23.005369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:23.006915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:23.006915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:23.006915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:23.006915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:23.006915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:23.006915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:23.006915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:23.006915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:23.006915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:23.006915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:23.006915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:23.006915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:23.006915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:23.006915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:23.006915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:23.006915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:23.006915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:23.006915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:23.007892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:23.007892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:23.007892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:23.007892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:23.007892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:23.007892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:23.007892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:23.007892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:23.007892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 16:41:23.007892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:23.007892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 370/757] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jun 22 16:41:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:23.015503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831eb52b-5093-4ee9-b74b-323a2eab4046 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:23.125445 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccc005-55d8-4a43-9615-1eff39f81117 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:23.144213 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:23.172161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a369d1-8877-4d58-9778-def5e53b4126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:23.173293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a369d1-8877-4d58-9778-def5e53b4126 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:23.173744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a369d1-8877-4d58-9778-def5e53b4126 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:23.174279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a369d1-8877-4d58-9778-def5e53b4126 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:23.182606 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a369d1-8877-4d58-9778-def5e53b4126 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:23.184388 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a369d1-8877-4d58-9778-def5e53b4126 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:23.188317 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:23.200604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-51a369d1-8877-4d58-9778-def5e53b4126 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:23.200604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:23.200604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:23.200604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:23.200604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:23.200604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:23.200604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:23.200604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:23.200604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:23.200604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:23.200604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:23.200604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:23.200604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:23.200604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:23.200604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:23.201580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:23.201580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:23.201580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:23.201580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:23.201580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:23.201580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:23.201580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:23.201580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:23.201580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:23.201580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:23.201580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:23.201580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:23.201580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:23.201580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:23.201580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:23.201580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:23.201580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:23.202496 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:23.202496 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:23.202496 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:23.202496 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:23.202496 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:23.202496 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:23.202496 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:23.202496 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:23.205103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 388/758] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:23.209077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831eb52b-5093-4ee9-b74b-323a2eab4046 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:23.221060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a369d1-8877-4d58-9778-def5e53b4126 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:23.257931 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c43361-cf3b-4f2b-80cc-2f248a8aab17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:23.259319 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c43361-cf3b-4f2b-80cc-2f248a8aab17 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:23.259604 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c43361-cf3b-4f2b-80cc-2f248a8aab17 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:23.259879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c43361-cf3b-4f2b-80cc-2f248a8aab17 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:23.260753 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c43361-cf3b-4f2b-80cc-2f248a8aab17 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:23.261059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c43361-cf3b-4f2b-80cc-2f248a8aab17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:23.262747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c43361-cf3b-4f2b-80cc-2f248a8aab17 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:23.295893 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 371/759] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jun 22 16:41:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:23.301347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c43361-cf3b-4f2b-80cc-2f248a8aab17 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:23.352556 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a369d1-8877-4d58-9778-def5e53b4126 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:23.437300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50a7d6-ab14-44b5-8572-3ab1f97d1422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:23.437891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50a7d6-ab14-44b5-8572-3ab1f97d1422 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:23.438171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50a7d6-ab14-44b5-8572-3ab1f97d1422 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:23.438446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50a7d6-ab14-44b5-8572-3ab1f97d1422 None admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:23.439241 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50a7d6-ab14-44b5-8572-3ab1f97d1422 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:23.439549 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50a7d6-ab14-44b5-8572-3ab1f97d1422 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:23.441193 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50a7d6-ab14-44b5-8572-3ab1f97d1422 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:23.470645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c43361-cf3b-4f2b-80cc-2f248a8aab17 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:23.476003 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 389/760] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:23.481651 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50a7d6-ab14-44b5-8572-3ab1f97d1422 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:23.519092 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:23.535129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372dfdf-6dbd-4e62-b176-f1b13fe2b79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:23.535954 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372dfdf-6dbd-4e62-b176-f1b13fe2b79d None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:23.536261 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372dfdf-6dbd-4e62-b176-f1b13fe2b79d None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:23.536536 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372dfdf-6dbd-4e62-b176-f1b13fe2b79d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:23.556287 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372dfdf-6dbd-4e62-b176-f1b13fe2b79d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:23.557996 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372dfdf-6dbd-4e62-b176-f1b13fe2b79d None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:23.576495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:23.587625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50a7d6-ab14-44b5-8572-3ab1f97d1422 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:23.594588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-a372dfdf-6dbd-4e62-b176-f1b13fe2b79d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:23.594588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:23.594588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:23.594588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:23.594588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:23.594588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:23.594588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:23.594588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:23.594588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:23.594588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:23.594588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:23.594588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:23.594588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:23.594588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:23.594588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:23.595495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:23.595495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:23.595495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:23.595495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:23.595495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:23.595495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:23.595495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:23.595495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:23.595495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:23.595495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:23.595495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:23.595495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:23.595495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:23.595495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:23.595495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:23.595495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:23.595495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:23.596871 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:23.596871 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:23.596871 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:23.596871 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:23.596871 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 372/761] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:23.610335 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372dfdf-6dbd-4e62-b176-f1b13fe2b79d None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:23.636119 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c64637-ad8e-4cc3-82ac-da2d0129a9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:23.636786 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c64637-ad8e-4cc3-82ac-da2d0129a9bc None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:23.637072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c64637-ad8e-4cc3-82ac-da2d0129a9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:23.637613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c64637-ad8e-4cc3-82ac-da2d0129a9bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:23.638466 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c64637-ad8e-4cc3-82ac-da2d0129a9bc None admin] RBAC: Adding query filter params (role.id=acb8e1bf2db94178bdd6fc69b191d6b0, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=2a0a8cfb2482466a98340adab9980d53) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:23.638779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c64637-ad8e-4cc3-82ac-da2d0129a9bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:23.640248 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c64637-ad8e-4cc3-82ac-da2d0129a9bc None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:23.657748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 390/762] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:41:23 2022] GET /identity/v3/role_assignments?user.id=2a0a8cfb2482466a98340adab9980d53&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=acb8e1bf2db94178bdd6fc69b191d6b0 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:23.767218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372dfdf-6dbd-4e62-b176-f1b13fe2b79d None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:23.804632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb309cd-cd8a-4608-b9fa-ce18b25d0836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:23.805306 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb309cd-cd8a-4608-b9fa-ce18b25d0836 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:23.805592 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb309cd-cd8a-4608-b9fa-ce18b25d0836 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:23.805870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb309cd-cd8a-4608-b9fa-ce18b25d0836 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:23.806608 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb309cd-cd8a-4608-b9fa-ce18b25d0836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:23.806915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb309cd-cd8a-4608-b9fa-ce18b25d0836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:23.808325 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb309cd-cd8a-4608-b9fa-ce18b25d0836 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:23.820649 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 373/763] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:23.826224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c64637-ad8e-4cc3-82ac-da2d0129a9bc None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:23.847600 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb7bf1-3acc-4a11-8ca1-28046a157f28 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:23.847929 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb7bf1-3acc-4a11-8ca1-28046a157f28 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:23.848222 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb7bf1-3acc-4a11-8ca1-28046a157f28 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:23.851031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 374/764] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:41:23.863810 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8919c1e-8946-44b4-b6ed-8da9a20e0bca None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:23.864141 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8919c1e-8946-44b4-b6ed-8da9a20e0bca None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:23.864442 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8919c1e-8946-44b4-b6ed-8da9a20e0bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:23.891606 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-b8919c1e-8946-44b4-b6ed-8da9a20e0bca None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:23.892851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b8919c1e-8946-44b4-b6ed-8da9a20e0bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:23.981480 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:23.986798 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:23.991175 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c64637-ad8e-4cc3-82ac-da2d0129a9bc None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:24.004171 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 375/765] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 16:41:24.024523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8919c1e-8946-44b4-b6ed-8da9a20e0bca None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:24.035289 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbfcf6-8525-4775-a0b7-14706a01b1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:24.036412 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbfcf6-8525-4775-a0b7-14706a01b1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:24.038100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbfcf6-8525-4775-a0b7-14706a01b1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:24.038606 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbfcf6-8525-4775-a0b7-14706a01b1c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:24.053142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbfcf6-8525-4775-a0b7-14706a01b1c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:24.055184 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbfcf6-8525-4775-a0b7-14706a01b1c8 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:24.076874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-bdfbfcf6-8525-4775-a0b7-14706a01b1c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:24.076874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:24.076874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:24.076874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:24.076874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:24.076874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:24.076874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:24.076874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:24.076874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:24.076874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:24.076874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:24.076874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:24.076874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:24.076874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:24.076874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:24.077803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:24.077803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:24.077803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:24.077803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:24.077803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:24.077803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:24.077803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:24.077803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:24.077803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:24.077803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:24.077803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:24.077803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:24.077803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:24.077803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:24.077803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:24.077803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:24.077803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:24.080161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:24.080161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:24.080161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:24.080161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:24.080161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:24.080161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:24.080161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:24.080161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:24.080161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 391/766] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:24.089205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbfcf6-8525-4775-a0b7-14706a01b1c8 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:24.194620 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8919c1e-8946-44b4-b6ed-8da9a20e0bca None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:24.263907 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af384ee0-95ea-4e27-abbf-2a6233a5de12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:24.264772 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af384ee0-95ea-4e27-abbf-2a6233a5de12 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:24.265103 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af384ee0-95ea-4e27-abbf-2a6233a5de12 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:24.265431 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af384ee0-95ea-4e27-abbf-2a6233a5de12 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:24.272147 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af384ee0-95ea-4e27-abbf-2a6233a5de12 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:24.272147 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af384ee0-95ea-4e27-abbf-2a6233a5de12 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:24.278967 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbfcf6-8525-4775-a0b7-14706a01b1c8 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:24.280865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-af384ee0-95ea-4e27-abbf-2a6233a5de12 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 16:41:24.280865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:24.280865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:24.280865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:24.280865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:24.280865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:24.280865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:24.280865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:24.280865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 16:41:24.280865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:24.280865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:24.280865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:24.280865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:24.280865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:24.280865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:24.280865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:24.281784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:24.281784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:24.281784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:24.281784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:24.281784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:24.281784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:24.281784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:24.281784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:24.281784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:24.281784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:24.281784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:24.281784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:24.281784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:24.281784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:24.281784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:24.281784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:24.282621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:24.282621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:24.282621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:24.282621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:24.282621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:24.282621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:24.282621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:24.282621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:24.282621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:24.282621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:24.282621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:24.282621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:24.282621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:24.282621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 16:41:24.282621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:24.290289 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 376/767] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Jun 22 16:41:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:24.291710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af384ee0-95ea-4e27-abbf-2a6233a5de12 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:24.351290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c1436-409d-491b-8925-b82745d7f54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:24.352284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c1436-409d-491b-8925-b82745d7f54e None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:24.352782 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c1436-409d-491b-8925-b82745d7f54e None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:24.353249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c1436-409d-491b-8925-b82745d7f54e None admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:24.354279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c1436-409d-491b-8925-b82745d7f54e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:24.354796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c1436-409d-491b-8925-b82745d7f54e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:24.356429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c1436-409d-491b-8925-b82745d7f54e None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:24.378993 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 392/768] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:24.379671 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:24.386373 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c1436-409d-491b-8925-b82745d7f54e None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:24.426547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:24.463989 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af384ee0-95ea-4e27-abbf-2a6233a5de12 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:24.545866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c1436-409d-491b-8925-b82745d7f54e None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:24.572839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38db98-0e61-42ce-b7ff-a6ea574ef79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:24.573594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38db98-0e61-42ce-b7ff-a6ea574ef79e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:24.573814 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38db98-0e61-42ce-b7ff-a6ea574ef79e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:24.574061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38db98-0e61-42ce-b7ff-a6ea574ef79e None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:24.574784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38db98-0e61-42ce-b7ff-a6ea574ef79e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:24.575097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38db98-0e61-42ce-b7ff-a6ea574ef79e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:24.576510 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38db98-0e61-42ce-b7ff-a6ea574ef79e None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:24.582317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eaeb54-ac5f-420f-a81f-6ab8a9b55400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:24.583511 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaeb54-ac5f-420f-a81f-6ab8a9b55400 None admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:24.583972 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaeb54-ac5f-420f-a81f-6ab8a9b55400 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:24.584436 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eaeb54-ac5f-420f-a81f-6ab8a9b55400 None admin] PATH_INFO: `/v3/projects/59d78923fdef459abaf240bd0975494a/users/78e7bdfffdc84465a570d135d1d86380/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:24.587116 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eaeb54-ac5f-420f-a81f-6ab8a9b55400 None admin] RBAC: Authorizing `identity:create_grant(project_id=59d78923fdef459abaf240bd0975494a, user_id=78e7bdfffdc84465a570d135d1d86380, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:24.588920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eaeb54-ac5f-420f-a81f-6ab8a9b55400 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:24.598315 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 377/769] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jun 22 16:41:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:24.609080 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38db98-0e61-42ce-b7ff-a6ea574ef79e None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:24.671346 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 393/770] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:41:24 2022] PUT /identity/v3/projects/59d78923fdef459abaf240bd0975494a/users/78e7bdfffdc84465a570d135d1d86380/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:41:24.729036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38db98-0e61-42ce-b7ff-a6ea574ef79e None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:24.748838 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:24.769259 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37220b84-ed46-4270-ad92-9f6f5998edaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:24.770294 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37220b84-ed46-4270-ad92-9f6f5998edaa None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:24.770815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37220b84-ed46-4270-ad92-9f6f5998edaa None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:24.771289 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37220b84-ed46-4270-ad92-9f6f5998edaa None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:24.772325 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37220b84-ed46-4270-ad92-9f6f5998edaa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:24.772837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37220b84-ed46-4270-ad92-9f6f5998edaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:24.774455 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37220b84-ed46-4270-ad92-9f6f5998edaa None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:24.783888 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 378/771] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jun 22 16:41:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:24.787154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eaeb54-ac5f-420f-a81f-6ab8a9b55400 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:24.899279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a227835-effa-4ffc-8efe-d57cba660f88 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:24.899936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a227835-effa-4ffc-8efe-d57cba660f88 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:24.900534 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a227835-effa-4ffc-8efe-d57cba660f88 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:24.902083 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:24.904709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 379/772] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:24.913935 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b3208-3270-4fec-a44c-b322d86e4e1e None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:24.914862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b3208-3270-4fec-a44c-b322d86e4e1e None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:24.915643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b3208-3270-4fec-a44c-b322d86e4e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:24.930166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eaeb54-ac5f-420f-a81f-6ab8a9b55400 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:24.939423 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-a61b3208-3270-4fec-a44c-b322d86e4e1e None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:24.940965 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-a61b3208-3270-4fec-a44c-b322d86e4e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:24.968380 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2429c3-c87d-40d9-aee8-95a2ad509c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:24.969056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2429c3-c87d-40d9-aee8-95a2ad509c50 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:24.969377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2429c3-c87d-40d9-aee8-95a2ad509c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:24.969613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2429c3-c87d-40d9-aee8-95a2ad509c50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:24.970417 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2429c3-c87d-40d9-aee8-95a2ad509c50 None admin] RBAC: Adding query filter params (interface=public, service_id=80d6e41543834309ab3c40a186c15f4c, region_id=RegionOne) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:24.970738 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2429c3-c87d-40d9-aee8-95a2ad509c50 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:24.972555 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2429c3-c87d-40d9-aee8-95a2ad509c50 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:24.985523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 394/773] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jun 22 16:41:24 2022] GET /identity/v3/endpoints?service_id=80d6e41543834309ab3c40a186c15f4c&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:24.987669 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2429c3-c87d-40d9-aee8-95a2ad509c50 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:25.028189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 380/774] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:25.047555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b3208-3270-4fec-a44c-b322d86e4e1e None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:25.155639 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b3208-3270-4fec-a44c-b322d86e4e1e None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:25.167804 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:25.187925 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2429c3-c87d-40d9-aee8-95a2ad509c50 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:25.193793 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c80309-875f-4022-a258-2751f0fc893a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:25.194860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c80309-875f-4022-a258-2751f0fc893a None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:25.195379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c80309-875f-4022-a258-2751f0fc893a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:25.195855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c80309-875f-4022-a258-2751f0fc893a None admin] PATH_INFO: `/v3/services/network` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:25.196764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c80309-875f-4022-a258-2751f0fc893a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:25.198342 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c80309-875f-4022-a258-2751f0fc893a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:25.210309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-d4c80309-875f-4022-a258-2751f0fc893a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 16:41:25.210309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:25.210309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:25.210309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:25.210309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:25.210309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:25.210309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:25.210309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:25.210309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 16:41:25.210309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:25.210309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:25.210309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:25.210309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:25.210309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:25.210309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:25.210309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:25.210309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:25.211371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:25.211371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:25.211371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:25.211371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:25.211371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:25.211371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:25.211371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:25.211371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:25.211371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:25.211371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:25.211371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:25.211371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:25.211371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:25.211371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:25.211371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:25.211371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:25.212273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:25.212273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:25.212273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:25.212273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:25.212273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:25.212273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:25.212273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:25.212273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:25.212273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:25.212273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:25.212273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:25.212273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:25.212273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 16:41:25.212273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:25.219630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 381/775] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:25 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:25.219630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776bbbc-e7b6-4517-a467-04c47783f90b None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:25.219845 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776bbbc-e7b6-4517-a467-04c47783f90b None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:25.220414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776bbbc-e7b6-4517-a467-04c47783f90b None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:25.221579 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 382/776] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:25.222095 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776bbbc-e7b6-4517-a467-04c47783f90b None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:25.227929 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a4424-27a8-452b-8bcc-6e34c55973ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:25.228655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a4424-27a8-452b-8bcc-6e34c55973ff None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:25.228942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a4424-27a8-452b-8bcc-6e34c55973ff None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:25.229220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a4424-27a8-452b-8bcc-6e34c55973ff None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:25.229935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a4424-27a8-452b-8bcc-6e34c55973ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:25.231307 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a4424-27a8-452b-8bcc-6e34c55973ff None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:25.237642 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 395/777] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jun 22 16:41:24 2022] GET /identity/v3/services => generated 772 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:25.244733 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a3a8b-b59f-4bf0-9861-6ecd19703182 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:25.245363 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a3a8b-b59f-4bf0-9861-6ecd19703182 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:25.245860 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a3a8b-b59f-4bf0-9861-6ecd19703182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:25.276022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-3b1a3a8b-b59f-4bf0-9861-6ecd19703182 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:25.277644 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3b1a3a8b-b59f-4bf0-9861-6ecd19703182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:25.280080 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:25.360375 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 396/778] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:25.379207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a3a8b-b59f-4bf0-9861-6ecd19703182 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:25.460758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776bbbc-e7b6-4517-a467-04c47783f90b None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:25.499634 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e431a-6b80-421d-809a-27ed0284cd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:25.500240 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e431a-6b80-421d-809a-27ed0284cd92 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:25.500530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e431a-6b80-421d-809a-27ed0284cd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:25.500806 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e431a-6b80-421d-809a-27ed0284cd92 None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:25.501524 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e431a-6b80-421d-809a-27ed0284cd92 None admin] RBAC: Adding query filter params (name=network) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:25.501833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e431a-6b80-421d-809a-27ed0284cd92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:25.503207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e431a-6b80-421d-809a-27ed0284cd92 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:25.507660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a3a8b-b59f-4bf0-9861-6ecd19703182 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:25.513839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 383/779] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 16:41:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:25.515102 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e431a-6b80-421d-809a-27ed0284cd92 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:25.550443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953d17f-2d13-4750-98cc-abc1ae4f9441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:25.551623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953d17f-2d13-4750-98cc-abc1ae4f9441 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:25.552140 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953d17f-2d13-4750-98cc-abc1ae4f9441 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:25.552745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953d17f-2d13-4750-98cc-abc1ae4f9441 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:25.560624 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:25.565942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953d17f-2d13-4750-98cc-abc1ae4f9441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:25.574551 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:25.575824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-3953d17f-2d13-4750-98cc-abc1ae4f9441 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:41:25.575824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:25.575824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:25.575824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:25.575824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:25.575824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:25.575824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:25.575824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:25.575824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:25.575824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:25.575824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:25.575824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:25.575824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:25.575824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:25.575824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:25.575824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:25.581331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:25.581331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:25.581331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:25.581331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:25.581331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:25.581331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:25.581331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:25.581331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:25.581331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:25.581331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:25.581331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:25.581331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:25.581331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:25.581331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:25.581331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:25.581331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:25.582166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:25.582166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:25.582166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:25.582166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:25.582166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:25.582166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:25.582166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:25.582166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:25.582166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:25.582166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:25.582166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:41:25.582166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:25.582166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 397/780] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:41:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:25.588050 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953d17f-2d13-4750-98cc-abc1ae4f9441 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:25.689829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e431a-6b80-421d-809a-27ed0284cd92 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:25.707137 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953d17f-2d13-4750-98cc-abc1ae4f9441 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:25.746430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b66f4c-002d-4112-8fc8-0666a1578edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:25.747449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b66f4c-002d-4112-8fc8-0666a1578edc None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:25.747942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b66f4c-002d-4112-8fc8-0666a1578edc None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:25.748431 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b66f4c-002d-4112-8fc8-0666a1578edc None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:25.749819 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b66f4c-002d-4112-8fc8-0666a1578edc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:25.750431 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b66f4c-002d-4112-8fc8-0666a1578edc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:25.752083 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b66f4c-002d-4112-8fc8-0666a1578edc None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:25.762197 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 398/781] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:41:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:25.767132 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73348296-b442-4e00-9663-59289d35dbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:25.767132 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73348296-b442-4e00-9663-59289d35dbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:25.767132 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73348296-b442-4e00-9663-59289d35dbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:25.767132 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73348296-b442-4e00-9663-59289d35dbe5 None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:25.767472 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73348296-b442-4e00-9663-59289d35dbe5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:25.767472 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73348296-b442-4e00-9663-59289d35dbe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:25.768175 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73348296-b442-4e00-9663-59289d35dbe5 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:25.772334 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b66f4c-002d-4112-8fc8-0666a1578edc None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:25.778058 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 384/782] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 16:41:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:25.785694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73348296-b442-4e00-9663-59289d35dbe5 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:25.894472 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73348296-b442-4e00-9663-59289d35dbe5 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:25.908455 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:25.933401 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05808dbe-0424-45b4-8a7b-0374b5886655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:25.934443 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05808dbe-0424-45b4-8a7b-0374b5886655 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:25.934935 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05808dbe-0424-45b4-8a7b-0374b5886655 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:25.935404 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05808dbe-0424-45b4-8a7b-0374b5886655 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:25.936433 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05808dbe-0424-45b4-8a7b-0374b5886655 None admin] RBAC: Adding query filter params (interface=public, service_id=fca4ad8588bf4c4ebfc0aa9812999d01, region_id=RegionOne) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:25.937008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05808dbe-0424-45b4-8a7b-0374b5886655 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:25.938882 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05808dbe-0424-45b4-8a7b-0374b5886655 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:25.947963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:25.951756 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 385/783] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jun 22 16:41:25 2022] GET /identity/v3/endpoints?service_id=fca4ad8588bf4c4ebfc0aa9812999d01&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:25.957320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05808dbe-0424-45b4-8a7b-0374b5886655 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:26.020300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b66f4c-002d-4112-8fc8-0666a1578edc None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:26.079347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05808dbe-0424-45b4-8a7b-0374b5886655 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:26.106978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54b003-0bc7-4785-8e49-9d3bf1d2fe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:26.107896 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54b003-0bc7-4785-8e49-9d3bf1d2fe02 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:26.108212 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54b003-0bc7-4785-8e49-9d3bf1d2fe02 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:26.108496 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54b003-0bc7-4785-8e49-9d3bf1d2fe02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:26.120719 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe051b1-4012-4655-bfb9-7761b39853a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:26.122055 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe051b1-4012-4655-bfb9-7761b39853a3 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:26.122270 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54b003-0bc7-4785-8e49-9d3bf1d2fe02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:26.122748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe051b1-4012-4655-bfb9-7761b39853a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:26.123230 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe051b1-4012-4655-bfb9-7761b39853a3 None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:26.123728 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54b003-0bc7-4785-8e49-9d3bf1d2fe02 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:26.124460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe051b1-4012-4655-bfb9-7761b39853a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:26.126305 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe051b1-4012-4655-bfb9-7761b39853a3 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:26.133532 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 386/784] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jun 22 16:41:25 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:26.135270 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc25e7-63e8-4961-ae76-318fa5d89ca3 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:26.135728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc25e7-63e8-4961-ae76-318fa5d89ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:26.136167 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc25e7-63e8-4961-ae76-318fa5d89ca3 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:26.138189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 387/785] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:26.144141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-0f54b003-0bc7-4785-8e49-9d3bf1d2fe02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:26.144141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:26.144141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:26.144141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:26.144141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:26.144141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:26.144141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:26.144141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:26.144141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:26.144141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:26.144141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:26.144141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:26.144141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:26.144141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:26.144141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:26.145280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:26.145280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:26.145280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:26.145280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:26.145280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:26.145280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:26.145280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:26.145280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:26.145280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:26.145280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:26.145280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:26.145280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:26.145280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:26.145280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:26.145280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:26.145280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:26.145280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:26.146319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:26.146319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:26.146319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:26.146319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:26.148760 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665b270-b50e-49a6-8fe6-9221080c0992 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:26.149194 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665b270-b50e-49a6-8fe6-9221080c0992 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:26.149595 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665b270-b50e-49a6-8fe6-9221080c0992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:26.151510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 399/786] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:26.158048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54b003-0bc7-4785-8e49-9d3bf1d2fe02 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:26.185211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-3665b270-b50e-49a6-8fe6-9221080c0992 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:26.187374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-3665b270-b50e-49a6-8fe6-9221080c0992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:26.241940 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:26.316017 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 388/787] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:26.335196 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54b003-0bc7-4785-8e49-9d3bf1d2fe02 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:26.340491 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665b270-b50e-49a6-8fe6-9221080c0992 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:26.351004 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:26.372402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ffa64-c045-4b26-9659-9ec621eaec85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:26.373068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ffa64-c045-4b26-9659-9ec621eaec85 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:26.373355 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ffa64-c045-4b26-9659-9ec621eaec85 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:26.373634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ffa64-c045-4b26-9659-9ec621eaec85 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:26.374367 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ffa64-c045-4b26-9659-9ec621eaec85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:26.374702 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ffa64-c045-4b26-9659-9ec621eaec85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:26.376068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ffa64-c045-4b26-9659-9ec621eaec85 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:26.391895 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 400/788] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:26.396220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ffa64-c045-4b26-9659-9ec621eaec85 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:26.495843 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665b270-b50e-49a6-8fe6-9221080c0992 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:26.510564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ffa64-c045-4b26-9659-9ec621eaec85 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:26.547492 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5a737-a4b1-407e-a738-44df8cf0d7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:26.548698 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5a737-a4b1-407e-a738-44df8cf0d7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:26.549223 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5a737-a4b1-407e-a738-44df8cf0d7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:26.549788 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5a737-a4b1-407e-a738-44df8cf0d7c2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:26.557884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5a737-a4b1-407e-a738-44df8cf0d7c2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:26.559699 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5a737-a4b1-407e-a738-44df8cf0d7c2 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:26.573618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba44de-f4e3-44e0-98c2-cbbaa929ac63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:26.574347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba44de-f4e3-44e0-98c2-cbbaa929ac63 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:26.574635 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba44de-f4e3-44e0-98c2-cbbaa929ac63 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:26.575163 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba44de-f4e3-44e0-98c2-cbbaa929ac63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:26.583645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-79f5a737-a4b1-407e-a738-44df8cf0d7c2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 16:41:26.583645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:26.583645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:26.583645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:26.583645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:26.583645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:26.583645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:26.583645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:26.583645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:26.583645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:26.583645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:26.583645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:26.583645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:26.583645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:26.583645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:26.583645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:26.585207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:26.585207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:26.585207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:26.585207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:26.585207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:26.585207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:26.585207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:26.585207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:26.585207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:26.585207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:26.585207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:26.585207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:26.585207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:26.585207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:26.585207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:26.585207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:26.585207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:26.585207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:26.586162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:26.586162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:26.586162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:26.586162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:26.586162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:26.586162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:26.586162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:26.586162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:26.586162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 16:41:26.586162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:26.591893 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 401/789] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:41:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:26.595461 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba44de-f4e3-44e0-98c2-cbbaa929ac63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:26.601606 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5a737-a4b1-407e-a738-44df8cf0d7c2 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:26.604654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-4fba44de-f4e3-44e0-98c2-cbbaa929ac63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:26.604654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:26.604654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:26.604654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:26.604654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:26.604654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:26.604654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:26.604654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:26.604654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:26.604654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:26.604654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:26.604654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:26.604654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:26.604654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:26.604654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:26.604654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:26.605839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:26.605839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:26.605839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:26.605839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:26.605839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:26.605839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:26.605839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:26.605839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:26.605839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:26.605839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:26.605839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:26.605839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:26.605839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:26.605839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:26.605839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:26.605839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:26.606776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:26.606776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:26.606776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:26.606776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:26.606776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:26.606776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:26.606776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:26.606776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:26.606776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:26.606776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:26.606776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:26.606776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:26.614703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 389/790] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:41:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:26.622666 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba44de-f4e3-44e0-98c2-cbbaa929ac63 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:26.661601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:26.675143 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:26.751203 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5a737-a4b1-407e-a738-44df8cf0d7c2 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:26.796865 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe4eb4-5dc2-4adc-832b-750050838f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:26.797547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe4eb4-5dc2-4adc-832b-750050838f99 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:26.797835 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe4eb4-5dc2-4adc-832b-750050838f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:26.798114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe4eb4-5dc2-4adc-832b-750050838f99 None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:26.798978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe4eb4-5dc2-4adc-832b-750050838f99 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:26.799292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe4eb4-5dc2-4adc-832b-750050838f99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:26.800757 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe4eb4-5dc2-4adc-832b-750050838f99 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:26.828366 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba44de-f4e3-44e0-98c2-cbbaa929ac63 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:26.842780 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 402/791] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jun 22 16:41:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:26.848307 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe4eb4-5dc2-4adc-832b-750050838f99 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:26.867541 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec703cc-78d7-4927-8cfe-7900593de657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:26.868242 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec703cc-78d7-4927-8cfe-7900593de657 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:26.868530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec703cc-78d7-4927-8cfe-7900593de657 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:26.868806 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec703cc-78d7-4927-8cfe-7900593de657 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:26.869572 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec703cc-78d7-4927-8cfe-7900593de657 None admin] RBAC: Adding query filter params (name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:26.869888 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec703cc-78d7-4927-8cfe-7900593de657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:26.871275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec703cc-78d7-4927-8cfe-7900593de657 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:26.895649 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 390/792] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 16:41:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:26.896637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec703cc-78d7-4927-8cfe-7900593de657 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:27.012619 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:27.031659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec703cc-78d7-4927-8cfe-7900593de657 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:27.066755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:27.069156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c8af0-42ef-4db5-8a1a-d0fba3734875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:27.069955 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c8af0-42ef-4db5-8a1a-d0fba3734875 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:27.070240 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c8af0-42ef-4db5-8a1a-d0fba3734875 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:27.070514 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c8af0-42ef-4db5-8a1a-d0fba3734875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:27.082484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c8af0-42ef-4db5-8a1a-d0fba3734875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:27.082637 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe4eb4-5dc2-4adc-832b-750050838f99 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:27.083199 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c8af0-42ef-4db5-8a1a-d0fba3734875 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:27.124395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-b51c8af0-42ef-4db5-8a1a-d0fba3734875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:27.124395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:27.124395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:27.124395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:27.124395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:27.124395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:27.124395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:27.124395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:27.124395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:27.124395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:27.124395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:27.124395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:27.124395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:27.124395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:27.124395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:27.125549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:27.125549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:27.125549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:27.125549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:27.125549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:27.125549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:27.125549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:27.125549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:27.125549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:27.125549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:27.125549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:27.125549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:27.125549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:27.125549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:27.125549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:27.125549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:27.125549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:27.126648 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:27.126648 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:27.126648 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:27.126648 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:27.129501 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 391/793] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:27.130945 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d67888-1af6-4eb7-b118-f8910d649fd4 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:27.133911 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d67888-1af6-4eb7-b118-f8910d649fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:27.134273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d67888-1af6-4eb7-b118-f8910d649fd4 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:27.135647 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 392/794] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:27.138426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d67888-1af6-4eb7-b118-f8910d649fd4 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:27.153011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70ce64-2b36-40f4-8f4e-719f54d0099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:27.154333 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70ce64-2b36-40f4-8f4e-719f54d0099e None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:27.154695 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70ce64-2b36-40f4-8f4e-719f54d0099e None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:27.155049 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70ce64-2b36-40f4-8f4e-719f54d0099e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:27.168853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70ce64-2b36-40f4-8f4e-719f54d0099e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:27.170909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70ce64-2b36-40f4-8f4e-719f54d0099e None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:27.194022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-7f70ce64-2b36-40f4-8f4e-719f54d0099e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:27.194022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:27.194022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:27.194022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:27.194022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:27.194022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:27.194022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:27.194022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:27.194022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:27.194022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:27.194022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:27.194022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:27.194022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:27.194022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:27.194022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:27.195076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:27.195076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:27.195076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:27.195076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:27.195076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:27.195076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:27.195076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:27.195076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:27.195076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:27.195076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:27.195076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:27.195076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:27.195076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:27.195076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:27.195076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:27.195076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:27.195076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:27.196196 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:27.196196 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:27.196196 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:27.196196 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:27.197804 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 403/795] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:27.199080 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e6a6c-d097-4e49-b76b-8e7ad19f96ee None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:27.199429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e6a6c-d097-4e49-b76b-8e7ad19f96ee None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:27.199766 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e6a6c-d097-4e49-b76b-8e7ad19f96ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:27.222254 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-df3e6a6c-d097-4e49-b76b-8e7ad19f96ee None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:27.223712 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-df3e6a6c-d097-4e49-b76b-8e7ad19f96ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:27.266293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d67888-1af6-4eb7-b118-f8910d649fd4 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:27.301306 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff43f4d-c757-4c13-bc87-72c0f5bbb1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:27.302063 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff43f4d-c757-4c13-bc87-72c0f5bbb1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:27.302420 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff43f4d-c757-4c13-bc87-72c0f5bbb1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:27.302801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff43f4d-c757-4c13-bc87-72c0f5bbb1a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:27.303611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff43f4d-c757-4c13-bc87-72c0f5bbb1a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:27.303988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff43f4d-c757-4c13-bc87-72c0f5bbb1a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:27.305455 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff43f4d-c757-4c13-bc87-72c0f5bbb1a7 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:27.308451 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:27.308654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 404/796] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:27.310304 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e6a6c-d097-4e49-b76b-8e7ad19f96ee None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:27.320311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 393/797] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:27.328128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff43f4d-c757-4c13-bc87-72c0f5bbb1a7 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:27.413433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:27.449233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e6a6c-d097-4e49-b76b-8e7ad19f96ee None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:27.454573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff43f4d-c757-4c13-bc87-72c0f5bbb1a7 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:27.492458 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526513c9-7519-4954-b7a3-7b713bee1999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:27.493389 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526513c9-7519-4954-b7a3-7b713bee1999 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:27.493680 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526513c9-7519-4954-b7a3-7b713bee1999 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:27.493960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526513c9-7519-4954-b7a3-7b713bee1999 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:27.494903 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8df91-271c-4a60-b93d-7713f2aee264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:27.496045 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8df91-271c-4a60-b93d-7713f2aee264 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:27.496562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8df91-271c-4a60-b93d-7713f2aee264 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:27.497681 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8df91-271c-4a60-b93d-7713f2aee264 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:27.498619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8df91-271c-4a60-b93d-7713f2aee264 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:27.499143 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8df91-271c-4a60-b93d-7713f2aee264 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:27.501023 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8df91-271c-4a60-b93d-7713f2aee264 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:27.501615 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526513c9-7519-4954-b7a3-7b713bee1999 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:27.503248 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526513c9-7519-4954-b7a3-7b713bee1999 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:27.519665 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 405/798] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:27.520844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8df91-271c-4a60-b93d-7713f2aee264 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:27.520952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-526513c9-7519-4954-b7a3-7b713bee1999 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 16:41:27.520952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:27.520952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:27.520952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:27.520952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:27.520952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:27.520952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:27.520952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:27.520952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:27.520952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:27.520952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:27.520952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:27.520952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:27.520952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:27.520952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:27.520952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:27.522460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:27.522460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:27.522460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:27.522460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:27.522460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:27.522460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:27.522460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:27.522460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:27.522460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:27.522460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:27.522460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:27.522460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:27.522460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:27.522460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:27.522460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:27.522460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:27.522460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:27.522460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:27.523438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:27.523438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:27.523438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:27.523438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:27.523438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:27.523438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:27.523438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:27.523438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:27.523438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 16:41:27.523438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:27.527347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 394/799] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jun 22 16:41:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:27.528219 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526513c9-7519-4954-b7a3-7b713bee1999 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:27.622197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:27.666118 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8df91-271c-4a60-b93d-7713f2aee264 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:27.669913 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526513c9-7519-4954-b7a3-7b713bee1999 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:27.700190 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:27.706555 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541882b2-1980-4258-a9ca-ad3c15a70b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:27.708042 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541882b2-1980-4258-a9ca-ad3c15a70b91 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:27.708784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541882b2-1980-4258-a9ca-ad3c15a70b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:27.709348 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541882b2-1980-4258-a9ca-ad3c15a70b91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:27.712438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae73d9-c1b2-490c-9679-6423c1af4838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:27.715517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae73d9-c1b2-490c-9679-6423c1af4838 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:27.715517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae73d9-c1b2-490c-9679-6423c1af4838 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:27.715517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae73d9-c1b2-490c-9679-6423c1af4838 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:27.722048 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae73d9-c1b2-490c-9679-6423c1af4838 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:27.723576 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae73d9-c1b2-490c-9679-6423c1af4838 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:27.724970 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541882b2-1980-4258-a9ca-ad3c15a70b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:27.734512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-541882b2-1980-4258-a9ca-ad3c15a70b91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:41:27.734512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:27.734512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:27.734512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:27.734512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:27.734512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:27.734512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:27.734512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:27.734512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:27.734512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:27.734512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:27.734512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:27.734512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:27.734512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:27.734512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:27.734512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:27.735425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:27.735425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:27.735425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:27.735425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:27.735425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:27.735425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:27.735425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:27.735425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:27.735425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:27.735425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:27.735425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:27.735425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:27.735425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:27.735425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:27.735425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:27.735425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:27.736384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:27.736384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:27.736384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:27.736384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:27.736384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:27.736384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:27.736384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:27.736384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:27.736384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:27.736384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:27.736384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:41:27.736384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:27.739388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-46ae73d9-c1b2-490c-9679-6423c1af4838 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:27.739388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:27.739388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:27.739388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:27.739388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:27.739388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:27.739388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:27.739388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:27.739388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:27.739388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:27.739388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:27.739388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:27.739388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:27.739388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:27.739388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:27.741001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:27.741001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:27.741001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:27.741001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:27.741001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:27.741001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:27.741001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:27.741001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:27.741001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:27.741001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:27.741001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:27.741001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:27.741001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:27.741001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:27.741001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:27.741001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:27.741001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:27.742135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:27.742135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:27.742135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:27.742135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:27.742135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:27.742135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:27.742135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:27.742135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:27.743401 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 395/800] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:27.746905 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae73d9-c1b2-490c-9679-6423c1af4838 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:27.747079 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 406/801] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:41:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:27.748357 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541882b2-1980-4258-a9ca-ad3c15a70b91 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:27.850944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae73d9-c1b2-490c-9679-6423c1af4838 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:27.863093 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541882b2-1980-4258-a9ca-ad3c15a70b91 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:27.864381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:27.885546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f54a9-76e0-446e-8eb4-77b0131d1d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:27.886210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f54a9-76e0-446e-8eb4-77b0131d1d1f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:27.886494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f54a9-76e0-446e-8eb4-77b0131d1d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:27.886771 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f54a9-76e0-446e-8eb4-77b0131d1d1f None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:27.887862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f54a9-76e0-446e-8eb4-77b0131d1d1f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:27.888208 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f54a9-76e0-446e-8eb4-77b0131d1d1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:27.889681 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f54a9-76e0-446e-8eb4-77b0131d1d1f None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:27.900697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a930f9-35ec-4907-86ff-09c4b39eb107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:27.901367 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a930f9-35ec-4907-86ff-09c4b39eb107 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:27.901665 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a930f9-35ec-4907-86ff-09c4b39eb107 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:27.901935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a930f9-35ec-4907-86ff-09c4b39eb107 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:27.902696 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a930f9-35ec-4907-86ff-09c4b39eb107 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:27.903006 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a930f9-35ec-4907-86ff-09c4b39eb107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:27.904583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a930f9-35ec-4907-86ff-09c4b39eb107 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:27.906852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 396/802] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jun 22 16:41:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:27.906852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f54a9-76e0-446e-8eb4-77b0131d1d1f None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:27.915821 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 407/803] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:41:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:27.920261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07581a-e94b-412d-b56d-f5b26d6602d0 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:27.920261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07581a-e94b-412d-b56d-f5b26d6602d0 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:27.920261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07581a-e94b-412d-b56d-f5b26d6602d0 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:27.920261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 408/804] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:27.920261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07581a-e94b-412d-b56d-f5b26d6602d0 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:27.983967 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:28.020951 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f54a9-76e0-446e-8eb4-77b0131d1d1f None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:28.035806 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07581a-e94b-412d-b56d-f5b26d6602d0 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:28.058597 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cc9c2-bb7d-44e1-8df3-8afd42c816f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:28.059185 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cc9c2-bb7d-44e1-8df3-8afd42c816f0 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:28.059471 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cc9c2-bb7d-44e1-8df3-8afd42c816f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:28.059746 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cc9c2-bb7d-44e1-8df3-8afd42c816f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:28.060573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cc9c2-bb7d-44e1-8df3-8afd42c816f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:28.061088 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cc9c2-bb7d-44e1-8df3-8afd42c816f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:28.062308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cc9c2-bb7d-44e1-8df3-8afd42c816f0 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:28.074040 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd3502-aadf-4879-9859-3efea007699a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:28.074815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd3502-aadf-4879-9859-3efea007699a None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:28.079731 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd3502-aadf-4879-9859-3efea007699a None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:28.079873 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 397/805] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:28.079956 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd3502-aadf-4879-9859-3efea007699a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:28.080027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cc9c2-bb7d-44e1-8df3-8afd42c816f0 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:28.090653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd3502-aadf-4879-9859-3efea007699a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:28.092139 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd3502-aadf-4879-9859-3efea007699a None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:28.111576 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:28.113853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-b9bd3502-aadf-4879-9859-3efea007699a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:28.113853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:28.113853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:28.113853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:28.113853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:28.113853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:28.113853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:28.113853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:28.113853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:28.113853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:28.113853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:28.113853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:28.113853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:28.113853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:28.113853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:28.114744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:28.114744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:28.114744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:28.114744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:28.114744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:28.114744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:28.114744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:28.114744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:28.114744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:28.114744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:28.114744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:28.114744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:28.114744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:28.114744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:28.114744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:28.114744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:28.114744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:28.121214 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:28.121214 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:28.121214 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:28.121214 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:28.121214 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 409/806] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:28.121214 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f01847-0d98-4cd3-b6d8-4090712d78e8 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:28.121214 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f01847-0d98-4cd3-b6d8-4090712d78e8 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:28.121214 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f01847-0d98-4cd3-b6d8-4090712d78e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:28.136906 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-26f01847-0d98-4cd3-b6d8-4090712d78e8 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:28.138380 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-26f01847-0d98-4cd3-b6d8-4090712d78e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:28.187668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cc9c2-bb7d-44e1-8df3-8afd42c816f0 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:28.210898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 410/807] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:28.211643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f01847-0d98-4cd3-b6d8-4090712d78e8 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:28.232051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe108b4-b42b-40f3-a1af-dcbf76a09cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:28.233146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe108b4-b42b-40f3-a1af-dcbf76a09cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:28.233715 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe108b4-b42b-40f3-a1af-dcbf76a09cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:28.234196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe108b4-b42b-40f3-a1af-dcbf76a09cf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:28.246002 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe108b4-b42b-40f3-a1af-dcbf76a09cf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:28.247454 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe108b4-b42b-40f3-a1af-dcbf76a09cf3 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:28.256776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:28.265512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-afe108b4-b42b-40f3-a1af-dcbf76a09cf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:28.265512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:28.265512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:28.265512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:28.265512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:28.265512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:28.265512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:28.265512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:28.265512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:28.265512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:28.265512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:28.265512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:28.265512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:28.265512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:28.265512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:28.275609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:28.275609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:28.275609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:28.275609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:28.275609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:28.275609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:28.275609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:28.275609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:28.275609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:28.275609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:28.275609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:28.275609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:28.275609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:28.275609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:28.275609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:28.275609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:28.275609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:28.276785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:28.276785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:28.276785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:28.276785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:28.276785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 398/808] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:28.276785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe108b4-b42b-40f3-a1af-dcbf76a09cf3 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:28.338706 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f01847-0d98-4cd3-b6d8-4090712d78e8 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:28.372175 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:28.376575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c7ba4-1ee6-403f-b83c-d0265f376cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:28.377481 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c7ba4-1ee6-403f-b83c-d0265f376cc2 None admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:28.377750 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c7ba4-1ee6-403f-b83c-d0265f376cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:28.378026 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c7ba4-1ee6-403f-b83c-d0265f376cc2 None admin] PATH_INFO: `/v3/projects/59d78923fdef459abaf240bd0975494a/users/861452a1dc634bf69ce630d7dcd8a2d7/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:28.380019 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c7ba4-1ee6-403f-b83c-d0265f376cc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=59d78923fdef459abaf240bd0975494a, user_id=861452a1dc634bf69ce630d7dcd8a2d7, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:28.382096 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c7ba4-1ee6-403f-b83c-d0265f376cc2 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:28.389199 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe108b4-b42b-40f3-a1af-dcbf76a09cf3 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:28.422035 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c33b57-dfba-4518-a51c-2f04f529ee6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:28.422746 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c33b57-dfba-4518-a51c-2f04f529ee6d None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:28.424358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c33b57-dfba-4518-a51c-2f04f529ee6d None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:28.424358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c33b57-dfba-4518-a51c-2f04f529ee6d None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:28.424358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c33b57-dfba-4518-a51c-2f04f529ee6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:28.424358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c33b57-dfba-4518-a51c-2f04f529ee6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:28.425737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c33b57-dfba-4518-a51c-2f04f529ee6d None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:28.438420 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 399/809] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:28.439158 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c33b57-dfba-4518-a51c-2f04f529ee6d None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:28.448398 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 411/810] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:41:28 2022] PUT /identity/v3/projects/59d78923fdef459abaf240bd0975494a/users/861452a1dc634bf69ce630d7dcd8a2d7/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:41:28.450305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c7ba4-1ee6-403f-b83c-d0265f376cc2 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:28.559933 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:28.564134 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c33b57-dfba-4518-a51c-2f04f529ee6d None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:28.565615 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c7ba4-1ee6-403f-b83c-d0265f376cc2 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:28.606513 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67facf-773d-4a0b-805e-24c4b2f51e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:28.606852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67facf-773d-4a0b-805e-24c4b2f51e6a None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:28.607096 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67facf-773d-4a0b-805e-24c4b2f51e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:28.607373 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67facf-773d-4a0b-805e-24c4b2f51e6a None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:28.608694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67facf-773d-4a0b-805e-24c4b2f51e6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:28.608694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67facf-773d-4a0b-805e-24c4b2f51e6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:28.609933 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67facf-773d-4a0b-805e-24c4b2f51e6a None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:28.617220 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b3226-d256-4df6-863f-8f9f86999a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:28.618595 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b3226-d256-4df6-863f-8f9f86999a37 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:28.619079 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b3226-d256-4df6-863f-8f9f86999a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:28.619554 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b3226-d256-4df6-863f-8f9f86999a37 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:28.620839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b3226-d256-4df6-863f-8f9f86999a37 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:28.622432 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b3226-d256-4df6-863f-8f9f86999a37 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:28.625933 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 412/811] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:28.627215 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67facf-773d-4a0b-805e-24c4b2f51e6a None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:28.641895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-847b3226-d256-4df6-863f-8f9f86999a37 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 16:41:28.641895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:28.641895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:28.641895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:28.641895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:28.641895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:28.641895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:28.641895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:28.641895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 16:41:28.641895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:28.641895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:28.641895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:28.641895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:28.641895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:28.641895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:28.641895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:28.642872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:28.642872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:28.642872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:28.642872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:28.642872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:28.642872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:28.642872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:28.642872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:28.642872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:28.642872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:28.642872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:28.642872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:28.642872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:28.642872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:28.642872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:28.642872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:28.643710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:28.643710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:28.643710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:28.643710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:28.643710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:28.643710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:28.643710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:28.643710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:28.643710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:28.643710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:28.643710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:28.643710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:28.643710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:28.643710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 22 16:41:28.643710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:28.643710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 400/812] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Jun 22 16:41:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:28.644593 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa2b8a-eb1a-4b2b-94f9-8ad53a3c8ffd None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:28.644661 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa2b8a-eb1a-4b2b-94f9-8ad53a3c8ffd None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:28.645254 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa2b8a-eb1a-4b2b-94f9-8ad53a3c8ffd None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:28.647560 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 401/813] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:28.647560 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa2b8a-eb1a-4b2b-94f9-8ad53a3c8ffd None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:28.658779 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:28.745454 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67facf-773d-4a0b-805e-24c4b2f51e6a None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:28.754460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa2b8a-eb1a-4b2b-94f9-8ad53a3c8ffd None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:28.788210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ad67b-7c4e-4fde-9212-6aa2dba497d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:28.788973 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ad67b-7c4e-4fde-9212-6aa2dba497d5 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:28.789245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ad67b-7c4e-4fde-9212-6aa2dba497d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:28.789524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ad67b-7c4e-4fde-9212-6aa2dba497d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:28.790212 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a37a66-8915-4b5e-bcf7-ff911c40fe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:28.791300 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a37a66-8915-4b5e-bcf7-ff911c40fe55 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:28.791776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a37a66-8915-4b5e-bcf7-ff911c40fe55 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:28.792378 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a37a66-8915-4b5e-bcf7-ff911c40fe55 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:28.796493 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ad67b-7c4e-4fde-9212-6aa2dba497d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:28.797924 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ad67b-7c4e-4fde-9212-6aa2dba497d5 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:28.800491 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a37a66-8915-4b5e-bcf7-ff911c40fe55 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:28.801922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a37a66-8915-4b5e-bcf7-ff911c40fe55 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:28.812467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-0e2ad67b-7c4e-4fde-9212-6aa2dba497d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:28.812467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:28.812467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:28.812467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:28.812467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:28.812467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:28.812467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:28.812467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:28.812467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:28.812467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:28.812467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:28.812467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:28.812467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:28.812467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:28.812467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:28.813358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:28.813358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:28.813358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:28.813358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:28.813358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:28.813358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:28.813358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:28.813358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:28.813358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:28.813358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:28.813358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:28.813358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:28.813358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:28.813358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:28.813358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:28.813358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:28.813358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:28.819487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:28.819487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:28.819487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:28.819487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:28.819487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:28.819487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:28.819487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:28.819487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:28.819487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 413/814] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:28.819487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ad67b-7c4e-4fde-9212-6aa2dba497d5 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:28.820064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-30a37a66-8915-4b5e-bcf7-ff911c40fe55 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 16:41:28.820064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:28.820064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:28.820064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:28.820064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:28.820064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:28.820064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:28.820064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:28.820064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:28.820064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:28.820064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:28.820064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:28.820064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:28.820064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:28.820064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:28.820064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:28.820980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:28.820980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:28.820980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:28.820980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:28.820980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:28.820980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:28.820980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:28.820980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:28.820980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:28.820980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:28.820980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:28.820980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:28.820980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:28.820980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:28.820980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:28.820980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:28.820980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:28.820980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:28.821938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:28.821938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:28.821938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:28.821938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:28.821938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:28.821938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:28.821938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:28.821938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:28.821938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 16:41:28.821938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:28.821938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 402/815] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jun 22 16:41:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:28.821938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c716b3-c4de-45b6-818f-b1eb7beb19b8 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:28.821938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c716b3-c4de-45b6-818f-b1eb7beb19b8 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:28.824222 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c716b3-c4de-45b6-818f-b1eb7beb19b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:28.840407 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-a8c716b3-c4de-45b6-818f-b1eb7beb19b8 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:28.841618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-a8c716b3-c4de-45b6-818f-b1eb7beb19b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:28.842657 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:28.906072 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:28.911403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 403/816] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:28.912853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c716b3-c4de-45b6-818f-b1eb7beb19b8 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:28.942038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ad67b-7c4e-4fde-9212-6aa2dba497d5 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:28.984202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c189c5-8615-4990-a0a4-d422132e7ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:28.984881 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c189c5-8615-4990-a0a4-d422132e7ada None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:28.985315 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c189c5-8615-4990-a0a4-d422132e7ada None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:28.985667 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c189c5-8615-4990-a0a4-d422132e7ada None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:28.986995 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c189c5-8615-4990-a0a4-d422132e7ada None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:28.987315 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c189c5-8615-4990-a0a4-d422132e7ada None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:28.988740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c189c5-8615-4990-a0a4-d422132e7ada None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:29.000003 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 414/817] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jun 22 16:41:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:29.000003 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c189c5-8615-4990-a0a4-d422132e7ada None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:29.031777 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c716b3-c4de-45b6-818f-b1eb7beb19b8 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:29.066718 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e80fc5-6463-45d6-815a-68a7484d929f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:29.067376 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e80fc5-6463-45d6-815a-68a7484d929f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:29.067661 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e80fc5-6463-45d6-815a-68a7484d929f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:29.067941 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e80fc5-6463-45d6-815a-68a7484d929f None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:29.069467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e80fc5-6463-45d6-815a-68a7484d929f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:29.069784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e80fc5-6463-45d6-815a-68a7484d929f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:29.071241 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e80fc5-6463-45d6-815a-68a7484d929f None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:29.083138 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 404/818] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:29.083988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e80fc5-6463-45d6-815a-68a7484d929f None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:29.092047 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:29.111844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c189c5-8615-4990-a0a4-d422132e7ada None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:29.145553 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:29.150439 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cafba8-192d-4572-a3ca-ad38f2106946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:29.151225 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cafba8-192d-4572-a3ca-ad38f2106946 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:29.151617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cafba8-192d-4572-a3ca-ad38f2106946 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:29.152053 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cafba8-192d-4572-a3ca-ad38f2106946 None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:29.153017 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cafba8-192d-4572-a3ca-ad38f2106946 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:29.157600 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cafba8-192d-4572-a3ca-ad38f2106946 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:29.157600 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cafba8-192d-4572-a3ca-ad38f2106946 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:29.178430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 415/819] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jun 22 16:41:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:29.178430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cafba8-192d-4572-a3ca-ad38f2106946 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:29.202906 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e80fc5-6463-45d6-815a-68a7484d929f None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:29.240388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a7f78-a8ba-480e-868c-124227a25e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:29.241320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a7f78-a8ba-480e-868c-124227a25e31 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:29.241706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a7f78-a8ba-480e-868c-124227a25e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:29.242115 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a7f78-a8ba-480e-868c-124227a25e31 None admin] PATH_INFO: `/v3/services/network` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:29.242853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a7f78-a8ba-480e-868c-124227a25e31 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:29.244325 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a7f78-a8ba-480e-868c-124227a25e31 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:29.256191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-012a7f78-a8ba-480e-868c-124227a25e31 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 16:41:29.256191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:29.256191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:29.256191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:29.256191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:29.256191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:29.256191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:29.256191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:29.256191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 16:41:29.256191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:29.256191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:29.256191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:29.256191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:29.256191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:29.256191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:29.256191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:29.256191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:29.257392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:29.257392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:29.257392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:29.257392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:29.257392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:29.257392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:29.257392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:29.257392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:29.257392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:29.257392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:29.257392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:29.257392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:29.257392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:29.257392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:29.257392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:29.257392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:29.258446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:29.258446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:29.258446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:29.258446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:29.258446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:29.258446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:29.258446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:29.258446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:29.258446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:29.258446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:29.258446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:29.258446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:29.258446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 22 16:41:29.258446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:29.260393 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 405/820] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:29 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:29.261579 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a7f78-a8ba-480e-868c-124227a25e31 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:29.283220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cafba8-192d-4572-a3ca-ad38f2106946 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:29.321305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb11da-54d4-43fd-9b30-42079b7dfab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:29.322053 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb11da-54d4-43fd-9b30-42079b7dfab9 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:29.322341 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb11da-54d4-43fd-9b30-42079b7dfab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:29.322676 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb11da-54d4-43fd-9b30-42079b7dfab9 None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:29.323416 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb11da-54d4-43fd-9b30-42079b7dfab9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:29.323732 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb11da-54d4-43fd-9b30-42079b7dfab9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:29.325184 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb11da-54d4-43fd-9b30-42079b7dfab9 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:29.336381 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 416/821] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jun 22 16:41:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:29.336381 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb11da-54d4-43fd-9b30-42079b7dfab9 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:29.338962 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:29.441202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb11da-54d4-43fd-9b30-42079b7dfab9 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:29.478949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc28be9-3bba-4f43-b71f-c88486b7cfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:29.479740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc28be9-3bba-4f43-b71f-c88486b7cfc3 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:29.480030 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc28be9-3bba-4f43-b71f-c88486b7cfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:29.480337 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc28be9-3bba-4f43-b71f-c88486b7cfc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:29.482553 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a7f78-a8ba-480e-868c-124227a25e31 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:29.505113 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:29.519794 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d4af9-54fe-4cf3-aa44-43d4f3fcd5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:29.519794 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d4af9-54fe-4cf3-aa44-43d4f3fcd5d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:29.519794 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d4af9-54fe-4cf3-aa44-43d4f3fcd5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:29.519794 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d4af9-54fe-4cf3-aa44-43d4f3fcd5d2 None admin] PATH_INFO: `/v3/projects/59d78923fdef459abaf240bd0975494a/users/2a0a8cfb2482466a98340adab9980d53/roles/acb8e1bf2db94178bdd6fc69b191d6b0` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:29.534827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d4af9-54fe-4cf3-aa44-43d4f3fcd5d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=59d78923fdef459abaf240bd0975494a, user_id=2a0a8cfb2482466a98340adab9980d53, role_id=acb8e1bf2db94178bdd6fc69b191d6b0)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:29.536831 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2d4af9-54fe-4cf3-aa44-43d4f3fcd5d2 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:29.552005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc28be9-3bba-4f43-b71f-c88486b7cfc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:29.553501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc28be9-3bba-4f43-b71f-c88486b7cfc3 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:29.558108 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:29.612674 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 406/822] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:41:29 2022] PUT /identity/v3/projects/59d78923fdef459abaf240bd0975494a/users/2a0a8cfb2482466a98340adab9980d53/roles/acb8e1bf2db94178bdd6fc69b191d6b0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:41:29.621341 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d4af9-54fe-4cf3-aa44-43d4f3fcd5d2 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:29.679837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 417/823] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:41:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 16:41:29.680901 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc28be9-3bba-4f43-b71f-c88486b7cfc3 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:29.784339 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d4af9-54fe-4cf3-aa44-43d4f3fcd5d2 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:29.796567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc28be9-3bba-4f43-b71f-c88486b7cfc3 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:29.798232 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:29.826407 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce21ba7-11fe-4f58-bce1-c4268c1fd425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:29.827094 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce21ba7-11fe-4f58-bce1-c4268c1fd425 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:29.827359 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce21ba7-11fe-4f58-bce1-c4268c1fd425 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:29.827636 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce21ba7-11fe-4f58-bce1-c4268c1fd425 None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:29.829168 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce21ba7-11fe-4f58-bce1-c4268c1fd425 None admin] RBAC: Adding query filter params (name=network) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:29.829168 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce21ba7-11fe-4f58-bce1-c4268c1fd425 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:29.830563 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce21ba7-11fe-4f58-bce1-c4268c1fd425 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:29.835751 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 407/824] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 16:41:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:29.836713 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce21ba7-11fe-4f58-bce1-c4268c1fd425 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:29.838373 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f30dd-e31b-4e21-a197-7c0ca4dfdb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:29.839211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f30dd-e31b-4e21-a197-7c0ca4dfdb49 None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:29.839516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f30dd-e31b-4e21-a197-7c0ca4dfdb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:29.840700 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f30dd-e31b-4e21-a197-7c0ca4dfdb49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:29.841467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f30dd-e31b-4e21-a197-7c0ca4dfdb49 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:29.842936 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f30dd-e31b-4e21-a197-7c0ca4dfdb49 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:29.872418 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:29.936986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce21ba7-11fe-4f58-bce1-c4268c1fd425 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:29.954028 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 418/825] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jun 22 16:41:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:41:29.960295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f30dd-e31b-4e21-a197-7c0ca4dfdb49 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:30.030785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae659c4f-50f2-4c14-938e-109d69d28fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:30.031598 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae659c4f-50f2-4c14-938e-109d69d28fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:30.031893 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae659c4f-50f2-4c14-938e-109d69d28fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:30.032194 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae659c4f-50f2-4c14-938e-109d69d28fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:30.060158 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae659c4f-50f2-4c14-938e-109d69d28fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:30.061621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae659c4f-50f2-4c14-938e-109d69d28fc5 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:30.096128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-ae659c4f-50f2-4c14-938e-109d69d28fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:30.096128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:30.096128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:30.096128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:30.096128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:30.096128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:30.096128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:30.096128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:30.096128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:30.096128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:30.096128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:30.096128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:30.096128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:30.096128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:30.096128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:30.097107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:30.097107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:30.097107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:30.097107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:30.097107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:30.097107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:30.097107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:30.097107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:30.097107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:30.097107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:30.097107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:30.097107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:30.097107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:30.097107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:30.097107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:30.097107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:30.097107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:30.097995 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:30.097995 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:30.097995 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:30.097995 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:30.100526 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 408/826] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:30.106344 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae659c4f-50f2-4c14-938e-109d69d28fc5 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:30.134644 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f30dd-e31b-4e21-a197-7c0ca4dfdb49 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:30.171816 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfe413-d427-4f5c-9555-7da07241468f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:30.172531 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfe413-d427-4f5c-9555-7da07241468f None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:30.172819 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfe413-d427-4f5c-9555-7da07241468f None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:30.173098 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfe413-d427-4f5c-9555-7da07241468f None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:30.173829 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfe413-d427-4f5c-9555-7da07241468f None admin] RBAC: Adding query filter params (type=network) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:30.174198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfe413-d427-4f5c-9555-7da07241468f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:30.175608 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfe413-d427-4f5c-9555-7da07241468f None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:30.186296 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 419/827] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 16:41:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:30.187536 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfe413-d427-4f5c-9555-7da07241468f None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:30.272819 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:30.292528 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae659c4f-50f2-4c14-938e-109d69d28fc5 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:30.335767 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ca1c2-2da7-4061-a355-c1c7cc4cd181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:30.336861 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ca1c2-2da7-4061-a355-c1c7cc4cd181 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:30.337350 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ca1c2-2da7-4061-a355-c1c7cc4cd181 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:30.337828 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ca1c2-2da7-4061-a355-c1c7cc4cd181 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:30.338778 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ca1c2-2da7-4061-a355-c1c7cc4cd181 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:30.339284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ca1c2-2da7-4061-a355-c1c7cc4cd181 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:30.340461 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:30.341484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ca1c2-2da7-4061-a355-c1c7cc4cd181 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:30.362210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 409/828] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:30.368417 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ca1c2-2da7-4061-a355-c1c7cc4cd181 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:30.407480 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfe413-d427-4f5c-9555-7da07241468f None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:30.443187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cd41d-988f-4647-a72e-508b0127cf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:30.444217 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cd41d-988f-4647-a72e-508b0127cf59 None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:30.444510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cd41d-988f-4647-a72e-508b0127cf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:30.444795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cd41d-988f-4647-a72e-508b0127cf59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:30.445555 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cd41d-988f-4647-a72e-508b0127cf59 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:30.447111 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cd41d-988f-4647-a72e-508b0127cf59 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:30.530422 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ca1c2-2da7-4061-a355-c1c7cc4cd181 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:30.536653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 420/829] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jun 22 16:41:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 16:41:30.539741 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b14be-2443-43bc-b4bb-aea47eede2db None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:30.540036 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b14be-2443-43bc-b4bb-aea47eede2db None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:30.540344 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b14be-2443-43bc-b4bb-aea47eede2db None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:30.541720 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 421/830] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:30.550290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1c9c7-66fe-4341-8d21-03b4bede2c2e None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:30.550579 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1c9c7-66fe-4341-8d21-03b4bede2c2e None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:30.550851 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1c9c7-66fe-4341-8d21-03b4bede2c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:30.590193 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-eec1c9c7-66fe-4341-8d21-03b4bede2c2e None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:30.592158 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-eec1c9c7-66fe-4341-8d21-03b4bede2c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:30.615640 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093b0d8-fca6-4f17-a264-e570e068de44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:30.617632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093b0d8-fca6-4f17-a264-e570e068de44 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:30.617632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093b0d8-fca6-4f17-a264-e570e068de44 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:30.617632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093b0d8-fca6-4f17-a264-e570e068de44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:30.625969 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093b0d8-fca6-4f17-a264-e570e068de44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:30.627760 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093b0d8-fca6-4f17-a264-e570e068de44 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:30.644518 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:30.656651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-1093b0d8-fca6-4f17-a264-e570e068de44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:30.656651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:30.656651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:30.656651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:30.656651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:30.656651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:30.656651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:30.656651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:30.656651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:30.656651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:30.656651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:30.656651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:30.656651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:30.656651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:30.656651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:30.663318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:30.663318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:30.663318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:30.663318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:30.663318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:30.663318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:30.663318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:30.663318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:30.663318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:30.663318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:30.663318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:30.663318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:30.663318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:30.663318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:30.663318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:30.663318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:30.663318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:30.664299 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:30.664299 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:30.664299 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:30.664299 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:30.664299 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:30.664299 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:30.664299 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:30.664299 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:30.664299 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 410/831] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:30.667441 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093b0d8-fca6-4f17-a264-e570e068de44 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:30.728939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 422/832] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:30.754488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1c9c7-66fe-4341-8d21-03b4bede2c2e None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:30.766988 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:30.810626 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093b0d8-fca6-4f17-a264-e570e068de44 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:30.855490 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc3c7e-6f50-490a-9d32-25e96e14f735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:30.856432 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc3c7e-6f50-490a-9d32-25e96e14f735 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:30.857235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc3c7e-6f50-490a-9d32-25e96e14f735 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:30.857665 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc3c7e-6f50-490a-9d32-25e96e14f735 None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:30.859189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc3c7e-6f50-490a-9d32-25e96e14f735 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:30.859655 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc3c7e-6f50-490a-9d32-25e96e14f735 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:30.861802 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc3c7e-6f50-490a-9d32-25e96e14f735 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:30.876906 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 411/833] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:30.882933 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc3c7e-6f50-490a-9d32-25e96e14f735 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:30.888272 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1c9c7-66fe-4341-8d21-03b4bede2c2e None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:30.928357 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d8866-1800-4f21-9811-718abbf847cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:30.929320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d8866-1800-4f21-9811-718abbf847cc None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:30.929604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d8866-1800-4f21-9811-718abbf847cc None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:30.929927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d8866-1800-4f21-9811-718abbf847cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:30.942817 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d8866-1800-4f21-9811-718abbf847cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:30.952582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-bd8d8866-1800-4f21-9811-718abbf847cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:41:30.952582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:30.952582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:30.952582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:30.952582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:30.952582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:30.952582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:30.952582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:30.952582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:30.952582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:30.952582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:30.952582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:30.952582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:30.952582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:30.952582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:30.952582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:30.953677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:30.953677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:30.953677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:30.953677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:30.953677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:30.953677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:30.953677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:30.953677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:30.953677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:30.953677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:30.953677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:30.953677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:30.953677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:30.953677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:30.953677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:30.953677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:30.959837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:30.959837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:30.959837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:30.959837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:30.959837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:30.959837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:30.959837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:30.959837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:30.959837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:30.959837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:30.959837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:41:30.959837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:30.959837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 423/834] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:41:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:30.962243 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d8866-1800-4f21-9811-718abbf847cc None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:30.973630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:31.023614 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc3c7e-6f50-490a-9d32-25e96e14f735 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:31.048471 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:31.057389 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba582d3-43d8-4138-9398-065a7b4f7c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:31.058257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba582d3-43d8-4138-9398-065a7b4f7c79 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:31.058705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba582d3-43d8-4138-9398-065a7b4f7c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:31.059192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba582d3-43d8-4138-9398-065a7b4f7c79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:31.060243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba582d3-43d8-4138-9398-065a7b4f7c79 None admin] RBAC: Adding query filter params (role.id=459b0e5c21c94fb1b81f76c65780fdb5, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=78e7bdfffdc84465a570d135d1d86380) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:31.060758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba582d3-43d8-4138-9398-065a7b4f7c79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:31.062343 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba582d3-43d8-4138-9398-065a7b4f7c79 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:31.069259 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 412/835] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:41:30 2022] GET /identity/v3/role_assignments?user.id=78e7bdfffdc84465a570d135d1d86380&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=459b0e5c21c94fb1b81f76c65780fdb5 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:31.079180 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d8866-1800-4f21-9811-718abbf847cc None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:31.118451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe111861-d7df-474d-b6d4-5aa8ca343a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:31.119469 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe111861-d7df-474d-b6d4-5aa8ca343a97 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:31.119932 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe111861-d7df-474d-b6d4-5aa8ca343a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:31.120424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe111861-d7df-474d-b6d4-5aa8ca343a97 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:31.121386 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe111861-d7df-474d-b6d4-5aa8ca343a97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:31.121901 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe111861-d7df-474d-b6d4-5aa8ca343a97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:31.123519 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe111861-d7df-474d-b6d4-5aa8ca343a97 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:31.134300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 424/836] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:41:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:31.141250 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba582d3-43d8-4138-9398-065a7b4f7c79 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:31.251628 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba582d3-43d8-4138-9398-065a7b4f7c79 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:31.277292 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:31.288056 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b9cfe-e829-4c82-86eb-95ecdbe4ba37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:31.288894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b9cfe-e829-4c82-86eb-95ecdbe4ba37 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:31.289176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b9cfe-e829-4c82-86eb-95ecdbe4ba37 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:31.289451 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b9cfe-e829-4c82-86eb-95ecdbe4ba37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:31.300200 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b9cfe-e829-4c82-86eb-95ecdbe4ba37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:31.301650 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b9cfe-e829-4c82-86eb-95ecdbe4ba37 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:31.320678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-631b9cfe-e829-4c82-86eb-95ecdbe4ba37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:31.320678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:31.320678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:31.320678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:31.320678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:31.320678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:31.320678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:31.320678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:31.320678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:31.320678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:31.320678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:31.320678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:31.320678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:31.320678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:31.320678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:31.321611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:31.321611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:31.321611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:31.321611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:31.321611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:31.321611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:31.321611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:31.321611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:31.321611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:31.321611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:31.321611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:31.321611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:31.321611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:31.321611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:31.321611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:31.321611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:31.321611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:31.322787 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:31.322787 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:31.322787 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:31.322787 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:31.322787 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 413/837] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:31.328928 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe111861-d7df-474d-b6d4-5aa8ca343a97 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:31.440658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe111861-d7df-474d-b6d4-5aa8ca343a97 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:31.470271 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:31.476603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedadcee-5537-4270-af73-5865f510220c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:31.477261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedadcee-5537-4270-af73-5865f510220c None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:31.477542 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedadcee-5537-4270-af73-5865f510220c None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:31.477814 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedadcee-5537-4270-af73-5865f510220c None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:31.478537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedadcee-5537-4270-af73-5865f510220c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:31.478842 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedadcee-5537-4270-af73-5865f510220c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:31.480228 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedadcee-5537-4270-af73-5865f510220c None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:31.492817 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 425/838] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:31.498493 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b9cfe-e829-4c82-86eb-95ecdbe4ba37 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:31.605988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b9cfe-e829-4c82-86eb-95ecdbe4ba37 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:31.644091 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb1e98-d77a-4063-995e-2177beaae240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:31.645259 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb1e98-d77a-4063-995e-2177beaae240 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:31.645770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb1e98-d77a-4063-995e-2177beaae240 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:31.646280 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb1e98-d77a-4063-995e-2177beaae240 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:31.655057 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb1e98-d77a-4063-995e-2177beaae240 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:31.656767 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb1e98-d77a-4063-995e-2177beaae240 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:31.671703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-58cb1e98-d77a-4063-995e-2177beaae240 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 22 16:41:31.671703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:31.671703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:31.671703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:31.671703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:31.671703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:31.671703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:31.671703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:31.671703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:31.671703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:31.671703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:31.671703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:31.671703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:31.671703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:31.671703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:31.671703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:31.672697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:31.672697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:31.672697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:31.672697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:31.672697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:31.672697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:31.672697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:31.672697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:31.672697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:31.672697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:31.672697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:31.672697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:31.672697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:31.672697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:31.672697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:31.672697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:31.672697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:31.672697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:31.673651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:31.673651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:31.673651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:31.673651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:31.673651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:31.673651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:31.673651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:31.673651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:31.673651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 22 16:41:31.673651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:31.680196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 414/839] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:41:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:31.682719 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedadcee-5537-4270-af73-5865f510220c None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:31.784752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedadcee-5537-4270-af73-5865f510220c None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:31.828080 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a37544-6e37-4a88-926f-8cb842a4a468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:31.828788 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a37544-6e37-4a88-926f-8cb842a4a468 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:31.829073 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a37544-6e37-4a88-926f-8cb842a4a468 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:31.829349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a37544-6e37-4a88-926f-8cb842a4a468 None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:31.830186 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a37544-6e37-4a88-926f-8cb842a4a468 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:31.830494 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a37544-6e37-4a88-926f-8cb842a4a468 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:31.831913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a37544-6e37-4a88-926f-8cb842a4a468 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:31.850097 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 426/840] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jun 22 16:41:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:31.855788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb1e98-d77a-4063-995e-2177beaae240 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:31.862906 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7aff1-6bcd-4ea3-843f-b162fdfab7c8 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:31.863196 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7aff1-6bcd-4ea3-843f-b162fdfab7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:31.863515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7aff1-6bcd-4ea3-843f-b162fdfab7c8 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:31.865793 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 427/841] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:41:31.870968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ffa49-8979-4217-ac0e-88180ad90d34 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:31.871422 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ffa49-8979-4217-ac0e-88180ad90d34 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:31.871841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ffa49-8979-4217-ac0e-88180ad90d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:31.888489 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-bc3ffa49-8979-4217-ac0e-88180ad90d34 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:31.889855 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-bc3ffa49-8979-4217-ac0e-88180ad90d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:31.895146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:31.934669 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:31.964742 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 428/842] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 16:41:31.965608 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb1e98-d77a-4063-995e-2177beaae240 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:31.981131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ffa49-8979-4217-ac0e-88180ad90d34 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:32.004128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09d1bd-4b18-426f-8b07-79e70122324b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:32.005101 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09d1bd-4b18-426f-8b07-79e70122324b None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:32.005707 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09d1bd-4b18-426f-8b07-79e70122324b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:32.006194 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09d1bd-4b18-426f-8b07-79e70122324b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:32.079935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ffa49-8979-4217-ac0e-88180ad90d34 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:32.083233 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09d1bd-4b18-426f-8b07-79e70122324b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:32.085607 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09d1bd-4b18-426f-8b07-79e70122324b None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:32.114294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177971a-3946-475c-a304-7371473de0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:32.115110 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177971a-3946-475c-a304-7371473de0fc None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:32.115394 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177971a-3946-475c-a304-7371473de0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:32.115666 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177971a-3946-475c-a304-7371473de0fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:32.122536 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:32.127489 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177971a-3946-475c-a304-7371473de0fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:32.135399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-6177971a-3946-475c-a304-7371473de0fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:32.135399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:32.135399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:32.135399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:32.135399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:32.135399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:32.135399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:32.135399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:32.135399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:32.135399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:32.135399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:32.135399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:32.135399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:32.135399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:32.135399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:32.135399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:32.141062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:32.141062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:32.141062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:32.141062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:32.141062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:32.141062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:32.141062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:32.141062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:32.141062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:32.141062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:32.141062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:32.141062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:32.141062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:32.141062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:32.141062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:32.141062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:32.141913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:32.141913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:32.141913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:32.141913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:32.141913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:32.141913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:32.141913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:32.141913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:32.141913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:32.141913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:32.141913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:41:32.141913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:32.143244 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 429/843] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:41:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:32.145934 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177971a-3946-475c-a304-7371473de0fc None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:32.188446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:32.199177 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 415/844] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:41:31 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 16:41:32.207516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09d1bd-4b18-426f-8b07-79e70122324b None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:32.251291 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177971a-3946-475c-a304-7371473de0fc None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:32.298386 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb9a1d-42ed-43e3-8526-e26aaad7d824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:32.299831 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb9a1d-42ed-43e3-8526-e26aaad7d824 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:32.300256 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb9a1d-42ed-43e3-8526-e26aaad7d824 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:32.300634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb9a1d-42ed-43e3-8526-e26aaad7d824 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:32.301748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb9a1d-42ed-43e3-8526-e26aaad7d824 None admin] RBAC: Adding query filter params (name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:32.302172 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb9a1d-42ed-43e3-8526-e26aaad7d824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:32.304474 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb9a1d-42ed-43e3-8526-e26aaad7d824 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:32.305927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09d1bd-4b18-426f-8b07-79e70122324b None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:32.320400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 430/845] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 16:41:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:32.321852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb9a1d-42ed-43e3-8526-e26aaad7d824 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:32.349915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099530a-6377-4fb0-8753-a0073c496eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:32.350745 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099530a-6377-4fb0-8753-a0073c496eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:32.351067 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099530a-6377-4fb0-8753-a0073c496eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:32.351394 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099530a-6377-4fb0-8753-a0073c496eb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:32.354876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:32.362741 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099530a-6377-4fb0-8753-a0073c496eb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:32.364243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099530a-6377-4fb0-8753-a0073c496eb6 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:32.382986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-f099530a-6377-4fb0-8753-a0073c496eb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:32.382986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:32.382986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:32.382986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:32.382986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:32.382986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:32.382986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:32.382986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:32.382986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:32.382986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:32.382986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:32.382986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:32.382986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:32.382986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:32.382986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:32.384159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:32.384159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:32.384159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:32.384159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:32.384159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:32.384159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:32.384159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:32.384159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:32.384159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:32.384159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:32.384159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:32.384159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:32.384159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:32.384159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:32.384159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:32.384159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:32.384159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:32.385279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:32.385279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:32.385279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:32.385279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:32.388837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 416/846] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:32.390213 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e0e9c-56dd-4880-8e0a-027f2d40c959 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:32.390506 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e0e9c-56dd-4880-8e0a-027f2d40c959 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:32.390788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e0e9c-56dd-4880-8e0a-027f2d40c959 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:32.396140 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 417/847] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:32.396140 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e0e9c-56dd-4880-8e0a-027f2d40c959 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:32.442594 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:32.446138 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb9a1d-42ed-43e3-8526-e26aaad7d824 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:32.479726 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183325b-701e-4660-b25e-8f073685ab03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:32.480558 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183325b-701e-4660-b25e-8f073685ab03 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:32.480855 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183325b-701e-4660-b25e-8f073685ab03 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:32.481135 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183325b-701e-4660-b25e-8f073685ab03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:32.491693 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183325b-701e-4660-b25e-8f073685ab03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:32.493198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183325b-701e-4660-b25e-8f073685ab03 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:32.501446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e0e9c-56dd-4880-8e0a-027f2d40c959 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:32.510871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-0183325b-701e-4660-b25e-8f073685ab03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:32.510871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:32.510871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:32.510871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:32.510871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:32.510871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:32.510871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:32.510871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:32.510871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:32.510871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:32.510871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:32.510871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:32.510871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:32.510871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:32.510871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:32.511778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:32.511778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:32.511778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:32.511778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:32.511778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:32.511778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:32.511778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:32.511778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:32.511778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:32.511778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:32.511778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:32.511778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:32.511778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:32.511778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:32.511778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:32.511778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:32.511778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:32.513725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:32.513725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:32.513725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:32.513725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:32.513725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 431/848] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:32.514005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3110f8-cc56-45e7-9d36-50c637056785 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:32.514257 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3110f8-cc56-45e7-9d36-50c637056785 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:32.514456 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3110f8-cc56-45e7-9d36-50c637056785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:32.531472 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-bb3110f8-cc56-45e7-9d36-50c637056785 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:32.532668 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-bb3110f8-cc56-45e7-9d36-50c637056785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:32.544672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77b987-42a5-4301-bc12-804f0cefe395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:32.545681 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77b987-42a5-4301-bc12-804f0cefe395 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:32.546193 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77b987-42a5-4301-bc12-804f0cefe395 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:32.546649 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77b987-42a5-4301-bc12-804f0cefe395 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:32.547556 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77b987-42a5-4301-bc12-804f0cefe395 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:32.548223 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77b987-42a5-4301-bc12-804f0cefe395 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:32.549866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77b987-42a5-4301-bc12-804f0cefe395 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:32.567436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 418/849] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:32.569090 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77b987-42a5-4301-bc12-804f0cefe395 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:32.623265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 432/850] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:32.623265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3110f8-cc56-45e7-9d36-50c637056785 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:32.623555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:32.674139 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77b987-42a5-4301-bc12-804f0cefe395 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:32.707889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:32.709843 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cc7fb-2d16-4d3a-b1c1-46d30de6da21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:32.710517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cc7fb-2d16-4d3a-b1c1-46d30de6da21 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:32.710802 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cc7fb-2d16-4d3a-b1c1-46d30de6da21 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:32.711080 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cc7fb-2d16-4d3a-b1c1-46d30de6da21 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:32.711816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cc7fb-2d16-4d3a-b1c1-46d30de6da21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:32.712143 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cc7fb-2d16-4d3a-b1c1-46d30de6da21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:32.713518 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cc7fb-2d16-4d3a-b1c1-46d30de6da21 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:32.725420 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 419/851] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:32.726225 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cc7fb-2d16-4d3a-b1c1-46d30de6da21 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:32.726650 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3110f8-cc56-45e7-9d36-50c637056785 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:32.766229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633c300-7570-44c9-adad-0e7097f7f272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:32.767026 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633c300-7570-44c9-adad-0e7097f7f272 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:32.767314 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633c300-7570-44c9-adad-0e7097f7f272 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:32.767599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633c300-7570-44c9-adad-0e7097f7f272 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:32.776242 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633c300-7570-44c9-adad-0e7097f7f272 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:32.777720 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633c300-7570-44c9-adad-0e7097f7f272 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:32.791544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-3633c300-7570-44c9-adad-0e7097f7f272 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:32.791544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:32.791544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:32.791544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:32.791544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:32.791544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:32.791544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:32.791544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:32.791544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:32.791544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:32.791544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:32.791544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:32.791544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:32.791544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:32.791544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:32.792694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:32.792694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:32.792694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:32.792694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:32.792694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:32.792694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:32.792694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:32.792694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:32.792694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:32.792694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:32.792694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:32.792694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:32.792694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:32.792694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:32.792694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:32.792694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:32.792694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:32.793613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:32.793613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:32.793613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:32.793613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:32.793613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:32.793613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:32.793613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:32.793613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:32.793613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 433/852] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:32.793613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633c300-7570-44c9-adad-0e7097f7f272 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:32.837108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cc7fb-2d16-4d3a-b1c1-46d30de6da21 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:32.846505 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:32.871486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc785080-3e5f-4f34-a312-51eb7f4ffff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:32.872295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc785080-3e5f-4f34-a312-51eb7f4ffff6 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:32.872578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc785080-3e5f-4f34-a312-51eb7f4ffff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:32.872845 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc785080-3e5f-4f34-a312-51eb7f4ffff6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:32.873550 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc785080-3e5f-4f34-a312-51eb7f4ffff6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:32.874876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc785080-3e5f-4f34-a312-51eb7f4ffff6 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:32.887910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-dc785080-3e5f-4f34-a312-51eb7f4ffff6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 16:41:32.887910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:32.887910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:32.887910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:32.887910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:32.887910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:32.887910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:32.887910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:32.887910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 16:41:32.887910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:32.887910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:32.887910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:32.887910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:32.887910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:32.887910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:32.887910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:32.887910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:32.888978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:32.888978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:32.888978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:32.888978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:32.888978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:32.888978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:32.888978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:32.888978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:32.888978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:32.888978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:32.888978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:32.888978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:32.888978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:32.888978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:32.888978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:32.888978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:32.890463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:32.890463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:32.890463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:32.890463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:32.890463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:32.890463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:32.890463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:32.890463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:32.890463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:32.890463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:32.890463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:32.890463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:32.890463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 16:41:32.890463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:32.890463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 420/853] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:41:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:32.891318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc785080-3e5f-4f34-a312-51eb7f4ffff6 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:32.904834 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633c300-7570-44c9-adad-0e7097f7f272 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:32.939598 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad68e63-e7b3-4b2d-a926-2a0a74178964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:32.940435 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad68e63-e7b3-4b2d-a926-2a0a74178964 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:32.940718 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad68e63-e7b3-4b2d-a926-2a0a74178964 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:32.940991 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad68e63-e7b3-4b2d-a926-2a0a74178964 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:32.949229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad68e63-e7b3-4b2d-a926-2a0a74178964 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:32.950652 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad68e63-e7b3-4b2d-a926-2a0a74178964 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:32.964841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-bad68e63-e7b3-4b2d-a926-2a0a74178964 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 16:41:32.964841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:32.964841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:32.964841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:32.964841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:32.964841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:32.964841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:32.964841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:32.964841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:32.964841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:32.964841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:32.964841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:32.964841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:32.964841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:32.964841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:32.964841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:32.965779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:32.965779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:32.965779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:32.965779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:32.965779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:32.965779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:32.965779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:32.965779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:32.965779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:32.965779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:32.965779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:32.965779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:32.965779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:32.965779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:32.965779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:32.965779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:32.965779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:32.965779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:32.966747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:32.966747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:32.966747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:32.966747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:32.966747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:32.966747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:32.966747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:32.966747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:32.966747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 16:41:32.966747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:32.970650 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 434/854] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jun 22 16:41:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:32.971246 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad68e63-e7b3-4b2d-a926-2a0a74178964 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:32.974032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:32.995756 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc785080-3e5f-4f34-a312-51eb7f4ffff6 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:33.041816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08c52a-bbe5-4469-8813-3123c6735389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:33.042477 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08c52a-bbe5-4469-8813-3123c6735389 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:33.042756 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08c52a-bbe5-4469-8813-3123c6735389 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:33.043028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08c52a-bbe5-4469-8813-3123c6735389 None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:33.043815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08c52a-bbe5-4469-8813-3123c6735389 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:33.044149 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08c52a-bbe5-4469-8813-3123c6735389 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:33.045566 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08c52a-bbe5-4469-8813-3123c6735389 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:33.058638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 421/855] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:33.059449 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08c52a-bbe5-4469-8813-3123c6735389 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:33.086970 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad68e63-e7b3-4b2d-a926-2a0a74178964 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:33.095546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:33.123723 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af6ae6-08f0-4dc3-939f-947acadf1067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:33.124440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af6ae6-08f0-4dc3-939f-947acadf1067 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:33.124742 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af6ae6-08f0-4dc3-939f-947acadf1067 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:33.125070 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af6ae6-08f0-4dc3-939f-947acadf1067 None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:33.125787 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af6ae6-08f0-4dc3-939f-947acadf1067 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:33.126095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af6ae6-08f0-4dc3-939f-947acadf1067 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:33.127460 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af6ae6-08f0-4dc3-939f-947acadf1067 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:33.132899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 435/856] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:41:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:33.133598 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af6ae6-08f0-4dc3-939f-947acadf1067 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:33.175010 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08c52a-bbe5-4469-8813-3123c6735389 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:33.201827 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:33.212791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf3e3f-d3fe-46bd-b4fa-c89a3494b4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:33.213458 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf3e3f-d3fe-46bd-b4fa-c89a3494b4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:33.213744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf3e3f-d3fe-46bd-b4fa-c89a3494b4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:33.214019 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf3e3f-d3fe-46bd-b4fa-c89a3494b4f3 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:33.214865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf3e3f-d3fe-46bd-b4fa-c89a3494b4f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:33.215174 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf3e3f-d3fe-46bd-b4fa-c89a3494b4f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:33.216768 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf3e3f-d3fe-46bd-b4fa-c89a3494b4f3 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:33.234582 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 422/857] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jun 22 16:41:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:33.235414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf3e3f-d3fe-46bd-b4fa-c89a3494b4f3 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:33.244098 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af6ae6-08f0-4dc3-939f-947acadf1067 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:33.278658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534605e-f475-4503-9f54-1e0b1bd7e973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:33.279315 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534605e-f475-4503-9f54-1e0b1bd7e973 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:33.279602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534605e-f475-4503-9f54-1e0b1bd7e973 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:33.279885 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534605e-f475-4503-9f54-1e0b1bd7e973 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:33.280758 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534605e-f475-4503-9f54-1e0b1bd7e973 None admin] RBAC: Adding query filter params (role.id=459b0e5c21c94fb1b81f76c65780fdb5, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=861452a1dc634bf69ce630d7dcd8a2d7) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:33.281079 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534605e-f475-4503-9f54-1e0b1bd7e973 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:33.282547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534605e-f475-4503-9f54-1e0b1bd7e973 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:33.289417 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 436/858] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:41:33 2022] GET /identity/v3/role_assignments?user.id=861452a1dc634bf69ce630d7dcd8a2d7&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=459b0e5c21c94fb1b81f76c65780fdb5 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:33.290341 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534605e-f475-4503-9f54-1e0b1bd7e973 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:33.330522 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:33.341998 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf3e3f-d3fe-46bd-b4fa-c89a3494b4f3 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:33.379931 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb700cd0-97e5-43e2-974b-65ac3d241ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:33.380575 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb700cd0-97e5-43e2-974b-65ac3d241ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:33.380865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb700cd0-97e5-43e2-974b-65ac3d241ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:33.381139 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb700cd0-97e5-43e2-974b-65ac3d241ba3 None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:33.381860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb700cd0-97e5-43e2-974b-65ac3d241ba3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:33.382163 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb700cd0-97e5-43e2-974b-65ac3d241ba3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:33.383629 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb700cd0-97e5-43e2-974b-65ac3d241ba3 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:33.396167 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 423/859] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:41:33 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:33.396167 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a3651-09ae-4a44-a3ef-0822ad6c7b34 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:33.396167 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a3651-09ae-4a44-a3ef-0822ad6c7b34 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:33.396167 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a3651-09ae-4a44-a3ef-0822ad6c7b34 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:33.396167 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 424/860] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:33.399809 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcabc3-ae81-42e4-bab6-87c4e89114f0 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:33.399809 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcabc3-ae81-42e4-bab6-87c4e89114f0 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:33.399809 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcabc3-ae81-42e4-bab6-87c4e89114f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:33.418302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-1fbcabc3-ae81-42e4-bab6-87c4e89114f0 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:33.419586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-1fbcabc3-ae81-42e4-bab6-87c4e89114f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:33.430453 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534605e-f475-4503-9f54-1e0b1bd7e973 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:33.464479 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:33.476601 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58713403-648d-4946-9065-8c6c10859cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:33.477615 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58713403-648d-4946-9065-8c6c10859cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:33.477907 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58713403-648d-4946-9065-8c6c10859cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:33.478232 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58713403-648d-4946-9065-8c6c10859cb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:33.511093 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 425/861] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 16:41:33.534156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcabc3-ae81-42e4-bab6-87c4e89114f0 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:33.563956 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58713403-648d-4946-9065-8c6c10859cb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:33.565665 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58713403-648d-4946-9065-8c6c10859cb1 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:33.649453 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:33.667176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcabc3-ae81-42e4-bab6-87c4e89114f0 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:33.692465 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 437/862] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:41:33 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 16:41:33.697525 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58713403-648d-4946-9065-8c6c10859cb1 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:33.711743 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991114e-1460-41ba-839f-c89d93b1cbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:33.712858 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991114e-1460-41ba-839f-c89d93b1cbff None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:33.713152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991114e-1460-41ba-839f-c89d93b1cbff None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:33.713430 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991114e-1460-41ba-839f-c89d93b1cbff None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:33.714092 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991114e-1460-41ba-839f-c89d93b1cbff None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:33.716204 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991114e-1460-41ba-839f-c89d93b1cbff None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:33.732062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:33.733827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-a991114e-1460-41ba-839f-c89d93b1cbff None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 16:41:33.733827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:33.733827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:33.733827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:33.733827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:33.733827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:33.733827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:33.733827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:33.733827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 16:41:33.733827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:33.733827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:33.733827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:33.733827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:33.733827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:33.733827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:33.733827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:33.734752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:33.734752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:33.734752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:33.734752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:33.734752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:33.734752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:33.734752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:33.734752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:33.734752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:33.734752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:33.734752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:33.734752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:33.734752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:33.734752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:33.734752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:33.734752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:33.735599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:33.735599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:33.735599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:33.735599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:33.735599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:33.735599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:33.735599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:33.735599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:33.735599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:33.735599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:33.735599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:33.735599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:33.735599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:33.735599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 16:41:33.735599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:33.735599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 426/863] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Jun 22 16:41:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:33.741031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991114e-1460-41ba-839f-c89d93b1cbff None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:33.812567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58713403-648d-4946-9065-8c6c10859cb1 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:33.849938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60032b-eb8e-4e9c-98ad-21d6c87f989c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:33.851079 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60032b-eb8e-4e9c-98ad-21d6c87f989c None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:33.851588 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60032b-eb8e-4e9c-98ad-21d6c87f989c None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:33.852075 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60032b-eb8e-4e9c-98ad-21d6c87f989c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:33.862872 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60032b-eb8e-4e9c-98ad-21d6c87f989c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:33.864748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60032b-eb8e-4e9c-98ad-21d6c87f989c None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:33.874683 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991114e-1460-41ba-839f-c89d93b1cbff None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:33.883937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-5e60032b-eb8e-4e9c-98ad-21d6c87f989c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:33.883937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:33.883937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:33.883937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:33.883937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:33.883937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:33.883937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:33.883937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:33.883937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:33.883937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:33.883937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:33.883937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:33.883937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:33.883937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:33.883937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:33.884844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:33.884844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:33.884844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:33.884844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:33.884844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:33.884844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:33.884844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:33.884844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:33.884844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:33.884844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:33.884844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:33.884844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:33.884844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:33.884844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:33.884844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:33.884844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:33.884844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:33.885764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:33.885764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:33.885764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:33.885764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:33.888486 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 438/864] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:33.893711 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60032b-eb8e-4e9c-98ad-21d6c87f989c None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:33.916498 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79511800-4f28-4cac-af6f-4f1acf5d3d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:33.917075 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79511800-4f28-4cac-af6f-4f1acf5d3d3e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:33.917356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79511800-4f28-4cac-af6f-4f1acf5d3d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:33.917627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79511800-4f28-4cac-af6f-4f1acf5d3d3e None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:33.918334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79511800-4f28-4cac-af6f-4f1acf5d3d3e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:33.918635 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79511800-4f28-4cac-af6f-4f1acf5d3d3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:33.920084 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79511800-4f28-4cac-af6f-4f1acf5d3d3e None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:33.929016 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 427/865] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 16:41:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:33.934287 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79511800-4f28-4cac-af6f-4f1acf5d3d3e None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:33.949976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:34.010545 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:34.022148 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60032b-eb8e-4e9c-98ad-21d6c87f989c None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:34.058714 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79511800-4f28-4cac-af6f-4f1acf5d3d3e None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:34.066141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91700b8-f494-4a15-bfd0-8874f21a392b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:34.066959 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91700b8-f494-4a15-bfd0-8874f21a392b None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:34.067850 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91700b8-f494-4a15-bfd0-8874f21a392b None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:34.068295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91700b8-f494-4a15-bfd0-8874f21a392b None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:34.069126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91700b8-f494-4a15-bfd0-8874f21a392b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:34.069533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91700b8-f494-4a15-bfd0-8874f21a392b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:34.071376 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91700b8-f494-4a15-bfd0-8874f21a392b None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:34.088630 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 439/866] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:34.097104 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91700b8-f494-4a15-bfd0-8874f21a392b None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:34.104870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4b133-a059-42ef-a9a8-884b49a2024c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:34.105776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4b133-a059-42ef-a9a8-884b49a2024c None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:34.106201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4b133-a059-42ef-a9a8-884b49a2024c None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:34.107143 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4b133-a059-42ef-a9a8-884b49a2024c None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:34.108001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4b133-a059-42ef-a9a8-884b49a2024c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:34.108950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4b133-a059-42ef-a9a8-884b49a2024c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:34.110894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4b133-a059-42ef-a9a8-884b49a2024c None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:34.116975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 428/867] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 16:41:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:34.209132 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91700b8-f494-4a15-bfd0-8874f21a392b None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:34.246556 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b368e-a2bb-48ee-be02-a0d01b254074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:34.247372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b368e-a2bb-48ee-be02-a0d01b254074 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:34.247948 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b368e-a2bb-48ee-be02-a0d01b254074 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:34.248323 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b368e-a2bb-48ee-be02-a0d01b254074 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:34.256140 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b368e-a2bb-48ee-be02-a0d01b254074 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:34.257704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b368e-a2bb-48ee-be02-a0d01b254074 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:34.273575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-c03b368e-a2bb-48ee-be02-a0d01b254074 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:34.273575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:34.273575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:34.273575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:34.273575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:34.273575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:34.273575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:34.273575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:34.273575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:34.273575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:34.273575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:34.273575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:34.273575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:34.273575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:34.273575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:34.274673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:34.274673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:34.274673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:34.274673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:34.274673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:34.274673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:34.274673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:34.274673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:34.274673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:34.274673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:34.274673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:34.274673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:34.274673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:34.274673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:34.274673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:34.274673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:34.274673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:34.275621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:34.275621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:34.275621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:34.275621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:34.275621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:34.275621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:34.275621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:34.275621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:34.275621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 440/868] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:34.280585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4b133-a059-42ef-a9a8-884b49a2024c None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:34.364255 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:34.387133 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4b133-a059-42ef-a9a8-884b49a2024c None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:34.423757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcd646-0046-4576-b21c-4ee8c1291117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:34.424449 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcd646-0046-4576-b21c-4ee8c1291117 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:34.424733 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcd646-0046-4576-b21c-4ee8c1291117 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:34.425026 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcd646-0046-4576-b21c-4ee8c1291117 None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:34.425871 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcd646-0046-4576-b21c-4ee8c1291117 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:34.426179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcd646-0046-4576-b21c-4ee8c1291117 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:34.428229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcd646-0046-4576-b21c-4ee8c1291117 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:34.441345 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 429/869] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:34.447612 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b368e-a2bb-48ee-be02-a0d01b254074 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:34.450611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:34.552326 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b368e-a2bb-48ee-be02-a0d01b254074 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:34.588065 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56ab0d-6a4e-4f93-93ba-a2434be8ca17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:34.588764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56ab0d-6a4e-4f93-93ba-a2434be8ca17 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:34.589055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56ab0d-6a4e-4f93-93ba-a2434be8ca17 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:34.589340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56ab0d-6a4e-4f93-93ba-a2434be8ca17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:34.590203 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56ab0d-6a4e-4f93-93ba-a2434be8ca17 None admin] RBAC: Adding query filter params (role.id=acb8e1bf2db94178bdd6fc69b191d6b0, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=2a0a8cfb2482466a98340adab9980d53) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:34.590521 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56ab0d-6a4e-4f93-93ba-a2434be8ca17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:34.591991 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56ab0d-6a4e-4f93-93ba-a2434be8ca17 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:34.604240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 441/870] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:41:34 2022] GET /identity/v3/role_assignments?user.id=2a0a8cfb2482466a98340adab9980d53&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=acb8e1bf2db94178bdd6fc69b191d6b0 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:35.444148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446d43c-e26c-4756-b821-daaea616c3b9 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:35.444662 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446d43c-e26c-4756-b821-daaea616c3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:35.444739 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446d43c-e26c-4756-b821-daaea616c3b9 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:35.446343 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 430/871] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:35.451561 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e6103-95e6-48ab-ae29-036dbf73e53b None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:35.451854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e6103-95e6-48ab-ae29-036dbf73e53b None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:35.452166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e6103-95e6-48ab-ae29-036dbf73e53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:35.468861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-765e6103-95e6-48ab-ae29-036dbf73e53b None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:35.470033 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-765e6103-95e6-48ab-ae29-036dbf73e53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:35.527202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ffc83-db14-4833-acd0-43ce37e49bba None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:35.527854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ffc83-db14-4833-acd0-43ce37e49bba None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:35.528345 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ffc83-db14-4833-acd0-43ce37e49bba None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:35.530110 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 431/872] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:35.534956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68be758-051f-4cc1-a059-3f829b805400 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:35.535451 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68be758-051f-4cc1-a059-3f829b805400 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:35.535940 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68be758-051f-4cc1-a059-3f829b805400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:35.536145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 442/873] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:35.538531 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:35.555199 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-f68be758-051f-4cc1-a059-3f829b805400 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:35.556782 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-f68be758-051f-4cc1-a059-3f829b805400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:35.559837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e6103-95e6-48ab-ae29-036dbf73e53b None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:35.636128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 432/874] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 16:41:35.653309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68be758-051f-4cc1-a059-3f829b805400 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:35.663037 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e6103-95e6-48ab-ae29-036dbf73e53b None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:35.697981 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179bd23-7ff7-41a7-b674-557e49171b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:35.698711 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179bd23-7ff7-41a7-b674-557e49171b39 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:35.698997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179bd23-7ff7-41a7-b674-557e49171b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:35.699274 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179bd23-7ff7-41a7-b674-557e49171b39 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:35.699937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179bd23-7ff7-41a7-b674-557e49171b39 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:35.701343 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179bd23-7ff7-41a7-b674-557e49171b39 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:35.713660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-e179bd23-7ff7-41a7-b674-557e49171b39 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 16:41:35.713660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:35.713660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:35.713660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:35.713660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:35.713660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:35.713660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:35.713660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:35.713660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 16:41:35.713660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:35.713660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:35.713660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:35.713660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:35.713660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:35.713660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:35.713660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:35.713660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:35.714658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:35.714658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:35.714658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:35.714658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:35.714658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:35.714658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:35.714658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:35.714658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:35.714658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:35.714658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:35.714658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:35.714658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:35.714658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:35.714658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:35.714658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:35.714658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:35.715495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:35.715495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:35.715495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:35.715495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:35.715495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:35.715495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:35.715495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:35.715495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:35.715495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:35.715495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:35.715495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:35.715495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:35.715495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 16:41:35.715495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:35.715495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 443/875] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 16:41:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:35.720630 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179bd23-7ff7-41a7-b674-557e49171b39 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:35.728431 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:35.763970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68be758-051f-4cc1-a059-3f829b805400 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:35.782570 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:35.802379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c4aaa-b6ee-474d-8a1f-3abcd88c7550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:35.803397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c4aaa-b6ee-474d-8a1f-3abcd88c7550 None admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:35.803914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c4aaa-b6ee-474d-8a1f-3abcd88c7550 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:35.804868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c4aaa-b6ee-474d-8a1f-3abcd88c7550 None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:35.805855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c4aaa-b6ee-474d-8a1f-3abcd88c7550 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:35.807472 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c4aaa-b6ee-474d-8a1f-3abcd88c7550 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:35.826924 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179bd23-7ff7-41a7-b674-557e49171b39 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:35.862638 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98760b09-6e7d-40c8-a3a3-822dc44e35fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:35.863304 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98760b09-6e7d-40c8-a3a3-822dc44e35fc None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:35.863591 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98760b09-6e7d-40c8-a3a3-822dc44e35fc None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:35.863868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98760b09-6e7d-40c8-a3a3-822dc44e35fc None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:35.864619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98760b09-6e7d-40c8-a3a3-822dc44e35fc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:35.864961 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98760b09-6e7d-40c8-a3a3-822dc44e35fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:35.866319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98760b09-6e7d-40c8-a3a3-822dc44e35fc None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:35.875688 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 444/876] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jun 22 16:41:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:35.876610 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98760b09-6e7d-40c8-a3a3-822dc44e35fc None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:35.882720 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 433/877] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 16:41:35 2022] POST /identity/v3/services => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:41:35.987855 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98760b09-6e7d-40c8-a3a3-822dc44e35fc None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:36.013941 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:36.032170 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037730d-4708-45e2-92ff-b8fd3edc4fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:36.032837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037730d-4708-45e2-92ff-b8fd3edc4fdc None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:36.033125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037730d-4708-45e2-92ff-b8fd3edc4fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:36.033408 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037730d-4708-45e2-92ff-b8fd3edc4fdc None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:36.039013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037730d-4708-45e2-92ff-b8fd3edc4fdc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:36.039013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037730d-4708-45e2-92ff-b8fd3edc4fdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:36.039013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037730d-4708-45e2-92ff-b8fd3edc4fdc None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:36.041811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 445/878] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jun 22 16:41:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:36.264880 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcea30d-efa4-4d17-9b01-c85e1b366ac3 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:36.265072 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcea30d-efa4-4d17-9b01-c85e1b366ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:36.265337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcea30d-efa4-4d17-9b01-c85e1b366ac3 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:36.266972 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 434/879] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:36.272840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079911d2-d432-4fb4-a26d-09fa16f2fa09 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:36.273126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079911d2-d432-4fb4-a26d-09fa16f2fa09 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:36.273400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079911d2-d432-4fb4-a26d-09fa16f2fa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:36.291424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-079911d2-d432-4fb4-a26d-09fa16f2fa09 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:36.292631 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-079911d2-d432-4fb4-a26d-09fa16f2fa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:36.359392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 446/880] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:36 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:36.382671 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcea30d-efa4-4d17-9b01-c85e1b366ac3 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:36.486584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcea30d-efa4-4d17-9b01-c85e1b366ac3 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:36.519713 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:36.523775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247e1e7-0afd-4f7a-ae4e-7d67138e7edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:36.524690 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247e1e7-0afd-4f7a-ae4e-7d67138e7edf None admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:36.525187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247e1e7-0afd-4f7a-ae4e-7d67138e7edf None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:36.525670 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247e1e7-0afd-4f7a-ae4e-7d67138e7edf None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:36.526602 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247e1e7-0afd-4f7a-ae4e-7d67138e7edf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:36.528191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247e1e7-0afd-4f7a-ae4e-7d67138e7edf None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:36.654062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 435/881] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 16:41:36 2022] POST /identity/v3/services => generated 269 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:41:36.768222 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236883ba-69a4-45c3-a582-a353fa593b4b None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:36.768748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236883ba-69a4-45c3-a582-a353fa593b4b None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:36.768862 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236883ba-69a4-45c3-a582-a353fa593b4b None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:36.770670 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 447/882] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:36.776587 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85657c-c6d0-41cc-a446-8882e5561ed7 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:36.776876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85657c-c6d0-41cc-a446-8882e5561ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:36.777151 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85657c-c6d0-41cc-a446-8882e5561ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:36.796530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-6e85657c-c6d0-41cc-a446-8882e5561ed7 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:36.797735 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6e85657c-c6d0-41cc-a446-8882e5561ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:36.874515 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 436/883] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 16:41:36.898602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236883ba-69a4-45c3-a582-a353fa593b4b None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:37.002775 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236883ba-69a4-45c3-a582-a353fa593b4b None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:37.017819 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:37.038543 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6c634-9d0f-4503-9d17-29f0f9d389cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:37.039359 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6c634-9d0f-4503-9d17-29f0f9d389cd None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:37.039642 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6c634-9d0f-4503-9d17-29f0f9d389cd None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:37.039920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6c634-9d0f-4503-9d17-29f0f9d389cd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:37.050427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6c634-9d0f-4503-9d17-29f0f9d389cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:37.062755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-27b6c634-9d0f-4503-9d17-29f0f9d389cd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 16:41:37.062755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:37.062755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:37.062755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:37.062755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:37.062755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:37.062755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:37.062755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:37.062755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:37.062755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:37.062755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:37.062755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:37.062755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:37.062755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:37.062755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:37.062755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:37.063767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:37.063767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:37.063767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:37.063767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:37.063767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:37.063767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:37.063767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:37.063767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:37.063767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:37.063767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:37.063767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:37.063767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:37.063767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:37.063767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:37.063767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:37.063767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:37.064703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:37.064703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:37.064703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:37.064703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:37.064703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:37.064703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:37.064703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:37.064703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:37.064703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:37.064703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:37.064703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 16:41:37.064703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:37.065856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 448/884] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jun 22 16:41:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:37.073430 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85657c-c6d0-41cc-a446-8882e5561ed7 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:37.178329 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e85657c-c6d0-41cc-a446-8882e5561ed7 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:37.193001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:37.220823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463f4df-b28f-4d37-bd73-3b24cfdb469c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:37.221785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463f4df-b28f-4d37-bd73-3b24cfdb469c None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:37.222248 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463f4df-b28f-4d37-bd73-3b24cfdb469c None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:37.222729 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463f4df-b28f-4d37-bd73-3b24cfdb469c None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:37.223663 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463f4df-b28f-4d37-bd73-3b24cfdb469c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:37.224776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463f4df-b28f-4d37-bd73-3b24cfdb469c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:37.226439 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463f4df-b28f-4d37-bd73-3b24cfdb469c None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:37.239659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 437/885] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jun 22 16:41:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:37.241799 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6c634-9d0f-4503-9d17-29f0f9d389cd None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:37.348969 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6c634-9d0f-4503-9d17-29f0f9d389cd None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:37.388163 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cb5b5-f12a-4c2d-ba34-12701f5c7475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:37.388953 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cb5b5-f12a-4c2d-ba34-12701f5c7475 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:37.389239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cb5b5-f12a-4c2d-ba34-12701f5c7475 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:37.389517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cb5b5-f12a-4c2d-ba34-12701f5c7475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:37.400958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cb5b5-f12a-4c2d-ba34-12701f5c7475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:37.402405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cb5b5-f12a-4c2d-ba34-12701f5c7475 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:37.419986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-776cb5b5-f12a-4c2d-ba34-12701f5c7475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:37.419986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:37.419986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:37.419986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:37.419986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:37.419986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:37.419986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:37.419986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:37.419986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:37.419986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:37.419986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:37.419986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:37.419986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:37.419986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:37.419986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:37.420942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:37.420942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:37.420942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:37.420942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:37.420942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:37.420942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:37.420942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:37.420942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:37.420942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:37.420942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:37.420942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:37.420942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:37.420942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:37.420942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:37.420942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:37.420942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:37.420942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:37.422032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:37.422032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:37.422032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:37.422032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:37.422032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 449/886] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:37.428610 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463f4df-b28f-4d37-bd73-3b24cfdb469c None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:37.531081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463f4df-b28f-4d37-bd73-3b24cfdb469c None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:37.564868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22762a14-0e0f-41a1-a59a-b3009cb7f2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:37.565531 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22762a14-0e0f-41a1-a59a-b3009cb7f2fb None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:37.565818 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22762a14-0e0f-41a1-a59a-b3009cb7f2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:37.566100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22762a14-0e0f-41a1-a59a-b3009cb7f2fb None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:37.566823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22762a14-0e0f-41a1-a59a-b3009cb7f2fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:37.567135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22762a14-0e0f-41a1-a59a-b3009cb7f2fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:37.568720 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22762a14-0e0f-41a1-a59a-b3009cb7f2fb None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:37.581442 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 438/887] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:37.587497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cb5b5-f12a-4c2d-ba34-12701f5c7475 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:37.617291 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:37.697823 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cb5b5-f12a-4c2d-ba34-12701f5c7475 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:37.734345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6a700-cd0f-4d04-a5d6-020d3c1f1cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:37.735504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6a700-cd0f-4d04-a5d6-020d3c1f1cba None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:37.735988 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6a700-cd0f-4d04-a5d6-020d3c1f1cba None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:37.736485 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6a700-cd0f-4d04-a5d6-020d3c1f1cba None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:37.744946 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6a700-cd0f-4d04-a5d6-020d3c1f1cba None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:37.746655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6a700-cd0f-4d04-a5d6-020d3c1f1cba None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:37.762249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-86d6a700-cd0f-4d04-a5d6-020d3c1f1cba None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 16:41:37.762249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:37.762249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:37.762249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:37.762249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:37.762249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:37.762249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:37.762249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:37.762249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:37.762249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:37.762249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:37.762249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:37.762249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:37.762249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:37.762249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:37.762249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:37.763562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:37.763562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:37.763562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:37.763562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:37.763562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:37.763562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:37.763562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:37.763562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:37.763562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:37.763562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:37.763562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:37.763562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:37.763562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:37.763562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:37.763562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:37.763562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:37.763562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:37.763562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:37.764603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:37.764603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:37.764603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:37.764603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:37.764603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:37.764603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:37.764603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:37.764603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:37.764603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 16:41:37.764603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:37.770677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 450/888] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jun 22 16:41:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:37.774952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22762a14-0e0f-41a1-a59a-b3009cb7f2fb None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:37.810415 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:37.887240 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22762a14-0e0f-41a1-a59a-b3009cb7f2fb None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:37.929215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d20a89-7ea0-433c-a162-ee877e67b935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:37.929881 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d20a89-7ea0-433c-a162-ee877e67b935 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:37.930160 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d20a89-7ea0-433c-a162-ee877e67b935 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:37.930430 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d20a89-7ea0-433c-a162-ee877e67b935 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:37.931269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d20a89-7ea0-433c-a162-ee877e67b935 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:37.931572 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d20a89-7ea0-433c-a162-ee877e67b935 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:37.933020 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d20a89-7ea0-433c-a162-ee877e67b935 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:37.955797 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 439/889] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jun 22 16:41:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:37.962169 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6a700-cd0f-4d04-a5d6-020d3c1f1cba None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:38.043470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cb021-b7c4-48a8-99dd-e6469b5021d0 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:38.043814 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cb021-b7c4-48a8-99dd-e6469b5021d0 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:38.044024 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cb021-b7c4-48a8-99dd-e6469b5021d0 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:38.045899 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 440/890] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:41:38.050988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4450720-d1d0-4f70-bd19-28ac553be466 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:38.051275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4450720-d1d0-4f70-bd19-28ac553be466 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:38.051549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4450720-d1d0-4f70-bd19-28ac553be466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:38.070442 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-e4450720-d1d0-4f70-bd19-28ac553be466 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:38.072246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e4450720-d1d0-4f70-bd19-28ac553be466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:38.081681 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:38.103594 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6a700-cd0f-4d04-a5d6-020d3c1f1cba None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:38.150361 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22e27b-79d3-4652-9a3e-d5f4eddd67d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:38.151285 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22e27b-79d3-4652-9a3e-d5f4eddd67d1 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:38.151724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22e27b-79d3-4652-9a3e-d5f4eddd67d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:38.152184 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22e27b-79d3-4652-9a3e-d5f4eddd67d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:38.158200 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 441/891] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:38.189116 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4450720-d1d0-4f70-bd19-28ac553be466 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:38.217525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:38.242406 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22e27b-79d3-4652-9a3e-d5f4eddd67d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:38.244327 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22e27b-79d3-4652-9a3e-d5f4eddd67d1 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:38.308724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4450720-d1d0-4f70-bd19-28ac553be466 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:38.346302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:38.361572 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427c096-3366-40eb-8887-a8293eb7fc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:38.362377 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427c096-3366-40eb-8887-a8293eb7fc73 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:38.362751 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427c096-3366-40eb-8887-a8293eb7fc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:38.363028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427c096-3366-40eb-8887-a8293eb7fc73 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:38.363688 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427c096-3366-40eb-8887-a8293eb7fc73 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:38.365710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427c096-3366-40eb-8887-a8293eb7fc73 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:38.368064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 451/892] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:41:37 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 16:41:38.369432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640662-071c-423f-8ff1-6f48b2ff286b None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:38.369722 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640662-071c-423f-8ff1-6f48b2ff286b None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:38.369999 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640662-071c-423f-8ff1-6f48b2ff286b None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:38.375511 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 452/893] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:38.375511 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e640662-071c-423f-8ff1-6f48b2ff286b None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:38.379411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-0427c096-3366-40eb-8887-a8293eb7fc73 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 16:41:38.379411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:38.379411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:38.379411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:38.379411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:38.379411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:38.379411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:38.379411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:38.379411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 16:41:38.379411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:38.379411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:38.379411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:38.379411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:38.379411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:38.379411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:38.379411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:38.379411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:38.382361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:38.382361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:38.382361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:38.382361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:38.382361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:38.382361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:38.382361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:38.382361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:38.382361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:38.382361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:38.382361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:38.382361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:38.382361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:38.382361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:38.382361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:38.382361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:38.383215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:38.383215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:38.383215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:38.383215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:38.383215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:38.383215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:38.383215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:38.383215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:38.383215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:38.383215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:38.383215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:38.383215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:38.383215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 16:41:38.383215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:38.383215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 442/894] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:41:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:38.384210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f0fe3-6bba-424e-a1c3-910772f6c422 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:38.384210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f0fe3-6bba-424e-a1c3-910772f6c422 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:38.384363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f0fe3-6bba-424e-a1c3-910772f6c422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:38.401479 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-614f0fe3-6bba-424e-a1c3-910772f6c422 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:38.402580 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-614f0fe3-6bba-424e-a1c3-910772f6c422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:38.488156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 443/895] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:38.488156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f0fe3-6bba-424e-a1c3-910772f6c422 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:38.511448 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e640662-071c-423f-8ff1-6f48b2ff286b None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:38.517808 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:38.549279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509dce7-5cf1-4ca3-bbe2-b4970837f9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:38.550070 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509dce7-5cf1-4ca3-bbe2-b4970837f9bf None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:38.550355 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509dce7-5cf1-4ca3-bbe2-b4970837f9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:38.550638 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509dce7-5cf1-4ca3-bbe2-b4970837f9bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:38.566354 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6509dce7-5cf1-4ca3-bbe2-b4970837f9bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:38.567812 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6509dce7-5cf1-4ca3-bbe2-b4970837f9bf None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:38.587623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-6509dce7-5cf1-4ca3-bbe2-b4970837f9bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:38.587623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:38.587623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:38.587623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:38.587623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:38.587623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:38.587623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:38.587623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:38.587623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:38.587623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:38.587623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:38.587623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:38.587623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:38.587623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:38.587623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:38.588886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:38.588886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:38.588886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:38.588886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:38.588886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:38.588886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:38.588886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:38.588886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:38.588886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:38.588886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:38.588886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:38.588886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:38.588886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:38.588886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:38.588886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:38.588886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:38.588886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:38.589955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:38.589955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:38.589955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:38.589955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:38.589955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 453/896] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:38.594277 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509dce7-5cf1-4ca3-bbe2-b4970837f9bf None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:38.616199 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f0fe3-6bba-424e-a1c3-910772f6c422 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:38.640128 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:38.653650 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac2689-d2f1-488f-acce-17a8530cd10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:38.654263 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac2689-d2f1-488f-acce-17a8530cd10d None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:38.654528 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac2689-d2f1-488f-acce-17a8530cd10d None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:38.654801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac2689-d2f1-488f-acce-17a8530cd10d None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:38.655511 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac2689-d2f1-488f-acce-17a8530cd10d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:38.655817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac2689-d2f1-488f-acce-17a8530cd10d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:38.657216 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac2689-d2f1-488f-acce-17a8530cd10d None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:38.667017 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 444/897] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:41:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:38.667017 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac2689-d2f1-488f-acce-17a8530cd10d None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:38.709263 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6509dce7-5cf1-4ca3-bbe2-b4970837f9bf None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:38.746233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2c9f9-f3f2-4c8c-82b4-026ee9994540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:38.747234 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2c9f9-f3f2-4c8c-82b4-026ee9994540 None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:38.747673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2c9f9-f3f2-4c8c-82b4-026ee9994540 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:38.748164 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2c9f9-f3f2-4c8c-82b4-026ee9994540 None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:38.749039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2c9f9-f3f2-4c8c-82b4-026ee9994540 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:38.749787 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:38.750565 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc2c9f9-f3f2-4c8c-82b4-026ee9994540 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:38.769192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac2689-d2f1-488f-acce-17a8530cd10d None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:38.803621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c2198-11f9-4bcd-8cb9-5578cfe14f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:38.804312 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c2198-11f9-4bcd-8cb9-5578cfe14f58 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:38.804594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c2198-11f9-4bcd-8cb9-5578cfe14f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:38.804864 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c2198-11f9-4bcd-8cb9-5578cfe14f58 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:38.805585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c2198-11f9-4bcd-8cb9-5578cfe14f58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:38.805890 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c2198-11f9-4bcd-8cb9-5578cfe14f58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:38.807296 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c2198-11f9-4bcd-8cb9-5578cfe14f58 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:38.819297 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 454/898] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 16:41:38 2022] POST /identity/v3/services => generated 241 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:41:38.824847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2c9f9-f3f2-4c8c-82b4-026ee9994540 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:38.826620 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 445/899] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:38.826620 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c2198-11f9-4bcd-8cb9-5578cfe14f58 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:38.942251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c2198-11f9-4bcd-8cb9-5578cfe14f58 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:38.953272 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:38.964186 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2c9f9-f3f2-4c8c-82b4-026ee9994540 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:38.980965 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16743639-206f-4f88-a837-796bda843b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:38.982413 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16743639-206f-4f88-a837-796bda843b2e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:38.982413 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16743639-206f-4f88-a837-796bda843b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:38.982413 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16743639-206f-4f88-a837-796bda843b2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:38.989396 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16743639-206f-4f88-a837-796bda843b2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:38.991358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16743639-206f-4f88-a837-796bda843b2e None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:38.994098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:38.999072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0feae2-e359-4fbc-9865-ca960d753ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:38.999729 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0feae2-e359-4fbc-9865-ca960d753ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:39.000010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0feae2-e359-4fbc-9865-ca960d753ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:39.000313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0feae2-e359-4fbc-9865-ca960d753ea7 None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:39.001031 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0feae2-e359-4fbc-9865-ca960d753ea7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:39.001337 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0feae2-e359-4fbc-9865-ca960d753ea7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:39.002684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0feae2-e359-4fbc-9865-ca960d753ea7 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:39.008097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-16743639-206f-4f88-a837-796bda843b2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:39.008097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:39.008097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:39.008097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:39.008097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:39.008097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:39.008097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:39.008097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:39.008097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:39.008097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:39.008097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:39.008097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:39.008097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:39.008097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:39.008097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:39.009037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:39.009037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:39.009037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:39.009037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:39.009037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:39.009037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:39.009037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:39.009037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:39.009037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:39.009037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:39.009037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:39.009037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:39.009037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:39.009037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:39.009037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:39.009037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:39.009037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:39.009944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:39.009944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:39.009944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:39.009944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:39.009944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:39.009944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:39.009944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:39.009944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:39.009944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 446/900] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:39.010436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b925e0c-1fd8-447a-bf10-9a89af72ac7c None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:39.010436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b925e0c-1fd8-447a-bf10-9a89af72ac7c None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:39.011152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b925e0c-1fd8-447a-bf10-9a89af72ac7c None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:39.016054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 447/901] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:39.016893 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b925e0c-1fd8-447a-bf10-9a89af72ac7c None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:39.018282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 455/902] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:41:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:39.025673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ee6bc-fd13-48eb-a8de-577746864f3b None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:39.025673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ee6bc-fd13-48eb-a8de-577746864f3b None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:39.025673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ee6bc-fd13-48eb-a8de-577746864f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:39.036799 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-747ee6bc-fd13-48eb-a8de-577746864f3b None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:39.038000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-747ee6bc-fd13-48eb-a8de-577746864f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:39.120127 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 456/903] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:39.120127 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ee6bc-fd13-48eb-a8de-577746864f3b None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:39.154669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b925e0c-1fd8-447a-bf10-9a89af72ac7c None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:39.194786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c62011-d165-457a-90c3-2f106767a1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:39.195745 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c62011-d165-457a-90c3-2f106767a1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:39.196230 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c62011-d165-457a-90c3-2f106767a1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:39.196780 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c62011-d165-457a-90c3-2f106767a1e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:39.197717 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c62011-d165-457a-90c3-2f106767a1e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:39.198174 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c62011-d165-457a-90c3-2f106767a1e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:39.199870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c62011-d165-457a-90c3-2f106767a1e6 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:39.209307 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:39.213883 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 448/904] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:39.214847 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c62011-d165-457a-90c3-2f106767a1e6 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:39.226396 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ee6bc-fd13-48eb-a8de-577746864f3b None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:39.262670 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f241c-8082-458c-af1c-67700df181f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:39.263550 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f241c-8082-458c-af1c-67700df181f7 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:39.263973 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f241c-8082-458c-af1c-67700df181f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:39.264431 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f241c-8082-458c-af1c-67700df181f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:39.265230 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f241c-8082-458c-af1c-67700df181f7 None admin] RBAC: Adding query filter params (interface=public, service_id=2d53909ec5ee4017941b883fe9f47749, region_id=RegionOne) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:39.265542 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f241c-8082-458c-af1c-67700df181f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:39.266966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f241c-8082-458c-af1c-67700df181f7 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:39.272217 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 457/905] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jun 22 16:41:39 2022] GET /identity/v3/endpoints?service_id=2d53909ec5ee4017941b883fe9f47749&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:39.273014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f241c-8082-458c-af1c-67700df181f7 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:39.283151 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:39.327218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c62011-d165-457a-90c3-2f106767a1e6 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:39.361947 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b918e-7a84-4a96-91ce-e4e831b0e642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:39.362751 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b918e-7a84-4a96-91ce-e4e831b0e642 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:39.363032 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b918e-7a84-4a96-91ce-e4e831b0e642 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:39.363305 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b918e-7a84-4a96-91ce-e4e831b0e642 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:39.363963 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b918e-7a84-4a96-91ce-e4e831b0e642 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:39.365940 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b918e-7a84-4a96-91ce-e4e831b0e642 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:39.377957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-4e6b918e-7a84-4a96-91ce-e4e831b0e642 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 16:41:39.377957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:39.377957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:39.377957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:39.377957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:39.377957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:39.377957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:39.377957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:39.377957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 16:41:39.377957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:39.377957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:39.377957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:39.377957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:39.377957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:39.377957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:39.377957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:39.378902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:39.378902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:39.378902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:39.378902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:39.378902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:39.378902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:39.378902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:39.378902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:39.378902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:39.378902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:39.378902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:39.378902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:39.378902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:39.378902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:39.378902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:39.378902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:39.379728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:39.379728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:39.379728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:39.379728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:39.379728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:39.379728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:39.379728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:39.379728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:39.379728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:39.379728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:39.379728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:39.379728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:39.379728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:39.379728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 16:41:39.379728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:39.380631 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f241c-8082-458c-af1c-67700df181f7 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:39.384060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 449/906] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Jun 22 16:41:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:39.384829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b918e-7a84-4a96-91ce-e4e831b0e642 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:39.425919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad37ed-4114-4f64-b828-7ded3b32be17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:39.426629 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad37ed-4114-4f64-b828-7ded3b32be17 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:39.426910 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad37ed-4114-4f64-b828-7ded3b32be17 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:39.427319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad37ed-4114-4f64-b828-7ded3b32be17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:39.428748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad37ed-4114-4f64-b828-7ded3b32be17 None admin] RBAC: Adding query filter params (role.id=4887dd0c588d4929bb553ce097a3b236, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=2a0a8cfb2482466a98340adab9980d53) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:39.429060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad37ed-4114-4f64-b828-7ded3b32be17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:39.430486 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad37ed-4114-4f64-b828-7ded3b32be17 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:39.436652 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 458/907] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:41:39 2022] GET /identity/v3/role_assignments?user.id=2a0a8cfb2482466a98340adab9980d53&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=4887dd0c588d4929bb553ce097a3b236 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:39.437258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad37ed-4114-4f64-b828-7ded3b32be17 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:39.456973 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:39.526008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b918e-7a84-4a96-91ce-e4e831b0e642 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:39.552918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad37ed-4114-4f64-b828-7ded3b32be17 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:39.563828 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:39.576434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba290c32-1d1c-44c2-99b5-054310a60dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:39.581104 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba290c32-1d1c-44c2-99b5-054310a60dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:39.581104 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba290c32-1d1c-44c2-99b5-054310a60dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:39.581104 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba290c32-1d1c-44c2-99b5-054310a60dd2 None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:39.581104 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba290c32-1d1c-44c2-99b5-054310a60dd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:39.581104 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba290c32-1d1c-44c2-99b5-054310a60dd2 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:39.588081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 450/908] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jun 22 16:41:39 2022] GET /identity/v3/services => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:41:39.603334 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e12228-059e-4127-8e27-28cb6572551c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:39.604028 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e12228-059e-4127-8e27-28cb6572551c None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:39.604351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e12228-059e-4127-8e27-28cb6572551c None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:39.604632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e12228-059e-4127-8e27-28cb6572551c None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:39.605925 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e12228-059e-4127-8e27-28cb6572551c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:39.606144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e12228-059e-4127-8e27-28cb6572551c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:39.607556 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e12228-059e-4127-8e27-28cb6572551c None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:39.617901 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 459/909] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 16:41:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:39.622385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba290c32-1d1c-44c2-99b5-054310a60dd2 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:39.732639 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba290c32-1d1c-44c2-99b5-054310a60dd2 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:39.767990 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2885d-4c96-4c93-97d0-8c8fd5c0c5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:39.768680 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2885d-4c96-4c93-97d0-8c8fd5c0c5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:39.768968 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2885d-4c96-4c93-97d0-8c8fd5c0c5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:39.769244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2885d-4c96-4c93-97d0-8c8fd5c0c5c5 None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:39.769961 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2885d-4c96-4c93-97d0-8c8fd5c0c5c5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:39.770270 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2885d-4c96-4c93-97d0-8c8fd5c0c5c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:39.772206 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2885d-4c96-4c93-97d0-8c8fd5c0c5c5 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:39.777472 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 451/910] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 16:41:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:39.783369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e12228-059e-4127-8e27-28cb6572551c None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:39.870804 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:39.890913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e12228-059e-4127-8e27-28cb6572551c None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:39.930937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884f7df-d00b-4095-bbfb-5b4cdab1c1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:39.931596 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884f7df-d00b-4095-bbfb-5b4cdab1c1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:39.931879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884f7df-d00b-4095-bbfb-5b4cdab1c1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:39.932180 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884f7df-d00b-4095-bbfb-5b4cdab1c1a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:39.932976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884f7df-d00b-4095-bbfb-5b4cdab1c1a7 None admin] RBAC: Adding query filter params (interface=public, service_id=93638c72bb0b40f193c333ee1511b712, region_id=RegionOne) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:39.933288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884f7df-d00b-4095-bbfb-5b4cdab1c1a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:39.934651 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884f7df-d00b-4095-bbfb-5b4cdab1c1a7 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:39.940295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 460/911] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jun 22 16:41:39 2022] GET /identity/v3/endpoints?service_id=93638c72bb0b40f193c333ee1511b712&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:39.946255 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2885d-4c96-4c93-97d0-8c8fd5c0c5c5 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:40.006533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:40.056242 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2885d-4c96-4c93-97d0-8c8fd5c0c5c5 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:40.090556 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa94fa3-8ad1-42c2-b4ea-cb77d73e41d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:40.091213 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa94fa3-8ad1-42c2-b4ea-cb77d73e41d2 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:40.091494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa94fa3-8ad1-42c2-b4ea-cb77d73e41d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:40.091781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa94fa3-8ad1-42c2-b4ea-cb77d73e41d2 None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:40.092525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa94fa3-8ad1-42c2-b4ea-cb77d73e41d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:40.093892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa94fa3-8ad1-42c2-b4ea-cb77d73e41d2 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:40.100291 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 452/912] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jun 22 16:41:39 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:41:40.920272 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eabc2-e46b-4c56-ab1d-36ae0615e748 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:40.920829 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eabc2-e46b-4c56-ab1d-36ae0615e748 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:40.920829 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eabc2-e46b-4c56-ab1d-36ae0615e748 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:40.922451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 461/913] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:40.927906 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b25a9-abf8-4ae8-af9b-5f6693d6b0cc None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:40.928318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b25a9-abf8-4ae8-af9b-5f6693d6b0cc None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:40.928506 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b25a9-abf8-4ae8-af9b-5f6693d6b0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:40.945390 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-733b25a9-abf8-4ae8-af9b-5f6693d6b0cc None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:40.946571 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-733b25a9-abf8-4ae8-af9b-5f6693d6b0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:41.023039 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 453/914] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:41.039136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008eabc2-e46b-4c56-ab1d-36ae0615e748 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:41.146679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008eabc2-e46b-4c56-ab1d-36ae0615e748 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:41.182186 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d16c44-2bfe-46bf-b68b-562105cdaec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:41.182911 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d16c44-2bfe-46bf-b68b-562105cdaec5 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:41.183195 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d16c44-2bfe-46bf-b68b-562105cdaec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:41.183472 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d16c44-2bfe-46bf-b68b-562105cdaec5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:41.184143 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d16c44-2bfe-46bf-b68b-562105cdaec5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:41.185514 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d16c44-2bfe-46bf-b68b-562105cdaec5 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:41.197844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-d3d16c44-2bfe-46bf-b68b-562105cdaec5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 16:41:41.197844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:41.197844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:41.197844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:41.197844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:41.197844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:41.197844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:41.197844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:41.197844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 16:41:41.197844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:41.197844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:41.197844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:41.197844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:41.197844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:41.197844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:41.197844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:41.197844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:41.198861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:41.198861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:41.198861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:41.198861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:41.198861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:41.198861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:41.198861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:41.198861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:41.198861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:41.198861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:41.198861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:41.198861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:41.198861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:41.198861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:41.198861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:41.198861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:41.199704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:41.199704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:41.199704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:41.199704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:41.199704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:41.199704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:41.199704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:41.199704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:41.199704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:41.199704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:41.199704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:41.199704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:41.199704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 16:41:41.199704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:41.199704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 462/915] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 16:41:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:41.205080 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b25a9-abf8-4ae8-af9b-5f6693d6b0cc None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:41.253673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:41.310733 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b25a9-abf8-4ae8-af9b-5f6693d6b0cc None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:41.346134 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d94551-3c82-4c3d-99cc-97d139584bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:41.346790 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d94551-3c82-4c3d-99cc-97d139584bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:41.347070 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d94551-3c82-4c3d-99cc-97d139584bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:41.347340 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d94551-3c82-4c3d-99cc-97d139584bc7 None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:41.348047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d94551-3c82-4c3d-99cc-97d139584bc7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:41.348382 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d94551-3c82-4c3d-99cc-97d139584bc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:41.350293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d94551-3c82-4c3d-99cc-97d139584bc7 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:41.355418 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 454/916] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jun 22 16:41:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:41.360868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d16c44-2bfe-46bf-b68b-562105cdaec5 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:41.373540 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:41.470807 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d16c44-2bfe-46bf-b68b-562105cdaec5 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:41.504700 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bda20-df3e-4c45-82e2-48aa632d9877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:41.505882 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bda20-df3e-4c45-82e2-48aa632d9877 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:41.506166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bda20-df3e-4c45-82e2-48aa632d9877 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:41.506438 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bda20-df3e-4c45-82e2-48aa632d9877 None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:41.507144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bda20-df3e-4c45-82e2-48aa632d9877 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:41.507449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bda20-df3e-4c45-82e2-48aa632d9877 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:41.508838 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bda20-df3e-4c45-82e2-48aa632d9877 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:41.514356 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 463/917] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jun 22 16:41:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:41.520070 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d94551-3c82-4c3d-99cc-97d139584bc7 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:41.599555 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a9e86-c146-4f3f-b34f-c6170e1f7689 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:41.600235 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a9e86-c146-4f3f-b34f-c6170e1f7689 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:41.600734 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a9e86-c146-4f3f-b34f-c6170e1f7689 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:41.602745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 464/918] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:41.607847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd3059-1d88-49fb-af92-3db90ead04d1 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:41.608279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd3059-1d88-49fb-af92-3db90ead04d1 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:41.608632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd3059-1d88-49fb-af92-3db90ead04d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:41.625918 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d94551-3c82-4c3d-99cc-97d139584bc7 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:41.627057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-65cd3059-1d88-49fb-af92-3db90ead04d1 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:41.629434 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-65cd3059-1d88-49fb-af92-3db90ead04d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:41.638355 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:41.670188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd47ee-009f-44ca-ba7d-2856d0bc1152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:41.671104 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd47ee-009f-44ca-ba7d-2856d0bc1152 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:41.671392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd47ee-009f-44ca-ba7d-2856d0bc1152 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:41.671674 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd47ee-009f-44ca-ba7d-2856d0bc1152 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:41.672516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd47ee-009f-44ca-ba7d-2856d0bc1152 None admin] RBAC: Adding query filter params (interface=public, service_id=57b08780e4ee439ca1d3e60f620a9c5b, region_id=RegionOne) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:41.672834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd47ee-009f-44ca-ba7d-2856d0bc1152 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:41.674212 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd47ee-009f-44ca-ba7d-2856d0bc1152 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:41.684268 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 455/919] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jun 22 16:41:41 2022] GET /identity/v3/endpoints?service_id=57b08780e4ee439ca1d3e60f620a9c5b&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:41.685155 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd47ee-009f-44ca-ba7d-2856d0bc1152 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:41.727761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 465/920] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 16:41:41.740268 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a28b30-c7be-498f-b290-eb8c5ef7ee7e None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:41.740549 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a28b30-c7be-498f-b290-eb8c5ef7ee7e None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:41.740830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a28b30-c7be-498f-b290-eb8c5ef7ee7e None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:41.742433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 466/921] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:41.747668 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf04d5-eef7-4a25-88eb-b869d21a933a None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:41.747960 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf04d5-eef7-4a25-88eb-b869d21a933a None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:41.748272 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf04d5-eef7-4a25-88eb-b869d21a933a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:41.755934 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:41.770068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-e9cf04d5-eef7-4a25-88eb-b869d21a933a None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:41.771877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e9cf04d5-eef7-4a25-88eb-b869d21a933a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:41.805302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd47ee-009f-44ca-ba7d-2856d0bc1152 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:41.838792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171cce8-d9e6-4b37-b7f9-d0dea1723c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:41.839452 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171cce8-d9e6-4b37-b7f9-d0dea1723c17 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:41.839739 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171cce8-d9e6-4b37-b7f9-d0dea1723c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:41.840017 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171cce8-d9e6-4b37-b7f9-d0dea1723c17 None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:41.840736 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171cce8-d9e6-4b37-b7f9-d0dea1723c17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:41.842248 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171cce8-d9e6-4b37-b7f9-d0dea1723c17 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:41.847383 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 467/922] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 16:41:41.848255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf04d5-eef7-4a25-88eb-b869d21a933a None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:41.860763 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 456/923] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jun 22 16:41:41 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:41:41.870532 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171cce8-d9e6-4b37-b7f9-d0dea1723c17 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:41.916331 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:41.983115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf04d5-eef7-4a25-88eb-b869d21a933a None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:41.985809 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171cce8-d9e6-4b37-b7f9-d0dea1723c17 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:42.026320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:42.033762 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e78412-6baa-48dd-8f3b-6f62e693de61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:42.034958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e78412-6baa-48dd-8f3b-6f62e693de61 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:42.035248 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e78412-6baa-48dd-8f3b-6f62e693de61 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:42.035528 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e78412-6baa-48dd-8f3b-6f62e693de61 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:42.039700 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964ad34-c141-413f-aa19-fd9482b211d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:42.040809 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964ad34-c141-413f-aa19-fd9482b211d3 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:42.041290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964ad34-c141-413f-aa19-fd9482b211d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:42.041739 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964ad34-c141-413f-aa19-fd9482b211d3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:42.042599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964ad34-c141-413f-aa19-fd9482b211d3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:42.044967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964ad34-c141-413f-aa19-fd9482b211d3 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:42.048202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e78412-6baa-48dd-8f3b-6f62e693de61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:42.058350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-f8e78412-6baa-48dd-8f3b-6f62e693de61 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 16:41:42.058350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:42.058350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:42.058350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:42.058350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:42.058350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:42.058350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:42.058350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:42.058350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:42.058350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:42.058350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:42.058350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:42.058350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:42.058350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:42.058350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:42.058350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:42.059449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:42.059449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:42.059449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:42.059449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:42.059449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:42.059449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:42.059449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:42.059449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:42.059449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:42.059449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:42.059449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:42.059449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:42.059449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:42.059449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:42.059449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:42.059449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:42.060515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:42.060515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:42.060515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:42.060515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:42.060515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:42.060515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:42.060515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:42.060515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:42.060515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:42.060515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:42.060515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 16:41:42.060515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:42.060515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 468/924] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jun 22 16:41:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:42.065577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e78412-6baa-48dd-8f3b-6f62e693de61 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:42.067543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-4964ad34-c141-413f-aa19-fd9482b211d3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 16:41:42.067543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:42.067543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:42.067543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:42.067543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:42.067543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:42.067543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:42.067543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:42.067543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 16:41:42.067543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:42.067543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:42.067543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:42.067543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:42.067543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:42.067543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:42.067543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:42.067543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:42.069770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:42.069770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:42.069770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:42.069770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:42.069770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:42.069770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:42.069770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:42.069770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:42.069770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:42.069770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:42.069770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:42.069770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:42.069770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:42.069770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:42.069770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:42.069770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:42.070622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:42.070622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:42.070622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:42.070622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:42.070622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:42.070622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:42.070622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:42.070622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:42.070622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:42.070622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:42.070622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:42.070622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:42.070622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 22 16:41:42.070622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:42.071382 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 457/925] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:41:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:42.077542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964ad34-c141-413f-aa19-fd9482b211d3 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:42.179091 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e78412-6baa-48dd-8f3b-6f62e693de61 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:42.207572 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964ad34-c141-413f-aa19-fd9482b211d3 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:42.209405 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:42.221804 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1052b82-e054-4f6b-a242-87b664e31f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:42.223176 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1052b82-e054-4f6b-a242-87b664e31f74 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:42.223841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1052b82-e054-4f6b-a242-87b664e31f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:42.225053 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1052b82-e054-4f6b-a242-87b664e31f74 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:42.226228 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1052b82-e054-4f6b-a242-87b664e31f74 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:42.226705 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1052b82-e054-4f6b-a242-87b664e31f74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:42.228609 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1052b82-e054-4f6b-a242-87b664e31f74 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:42.240940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 469/926] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jun 22 16:41:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:42.246270 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1052b82-e054-4f6b-a242-87b664e31f74 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:42.249149 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83898479-0681-4d6c-8778-c03cb12108dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:42.249864 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83898479-0681-4d6c-8778-c03cb12108dc None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:42.250136 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83898479-0681-4d6c-8778-c03cb12108dc None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:42.250422 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83898479-0681-4d6c-8778-c03cb12108dc None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:42.251133 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83898479-0681-4d6c-8778-c03cb12108dc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:42.251440 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83898479-0681-4d6c-8778-c03cb12108dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:42.252875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83898479-0681-4d6c-8778-c03cb12108dc None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:42.261355 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 458/927] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:41:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:42.263135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff680d6-6b16-4a65-9fc7-a3de7d3c4437 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:42.263418 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff680d6-6b16-4a65-9fc7-a3de7d3c4437 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:42.263746 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff680d6-6b16-4a65-9fc7-a3de7d3c4437 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:42.265213 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 459/928] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:42.265775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff680d6-6b16-4a65-9fc7-a3de7d3c4437 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:42.309718 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:42.357451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1052b82-e054-4f6b-a242-87b664e31f74 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:42.375640 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff680d6-6b16-4a65-9fc7-a3de7d3c4437 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:42.398880 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d6dac-9f63-49ab-bde1-fcb5bf57965c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:42.399681 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d6dac-9f63-49ab-bde1-fcb5bf57965c None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:42.399967 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d6dac-9f63-49ab-bde1-fcb5bf57965c None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:42.400277 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d6dac-9f63-49ab-bde1-fcb5bf57965c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:42.411273 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d6dac-9f63-49ab-bde1-fcb5bf57965c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:42.412017 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb7aae-fe95-4893-ad22-a416b6c8ba1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:42.412705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb7aae-fe95-4893-ad22-a416b6c8ba1a None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:42.412804 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d6dac-9f63-49ab-bde1-fcb5bf57965c None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:42.412993 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb7aae-fe95-4893-ad22-a416b6c8ba1a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:42.413271 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb7aae-fe95-4893-ad22-a416b6c8ba1a None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:42.413978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb7aae-fe95-4893-ad22-a416b6c8ba1a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:42.414287 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb7aae-fe95-4893-ad22-a416b6c8ba1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:42.415634 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb7aae-fe95-4893-ad22-a416b6c8ba1a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:42.425039 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 460/929] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jun 22 16:41:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:42.425039 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b72c2-ada1-40c8-ae80-a7e6cf09aa6a None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:42.425039 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b72c2-ada1-40c8-ae80-a7e6cf09aa6a None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:42.425039 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b72c2-ada1-40c8-ae80-a7e6cf09aa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:42.435088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-cc6d6dac-9f63-49ab-bde1-fcb5bf57965c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:42.435088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:42.435088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:42.435088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:42.435088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:42.435088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:42.435088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:42.435088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:42.435088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:42.435088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:42.435088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:42.435088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:42.435088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:42.435088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:42.435088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:42.435966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:42.435966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:42.435966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:42.435966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:42.435966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:42.435966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:42.435966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:42.435966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:42.435966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:42.435966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:42.435966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:42.435966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:42.435966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:42.435966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:42.435966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:42.435966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:42.435966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:42.436901 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:42.436901 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:42.436901 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:42.436901 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:42.436901 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 470/930] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:42.437182 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d6dac-9f63-49ab-bde1-fcb5bf57965c None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:42.445408 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-fc7b72c2-ada1-40c8-ae80-a7e6cf09aa6a None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:42.446581 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-fc7b72c2-ada1-40c8-ae80-a7e6cf09aa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:42.471744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:42.514467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 461/931] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:42.515526 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b72c2-ada1-40c8-ae80-a7e6cf09aa6a None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:42.549999 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d6dac-9f63-49ab-bde1-fcb5bf57965c None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:42.558275 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:42.589744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6898c-b91d-45f8-ba10-69e903c70c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:42.590553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6898c-b91d-45f8-ba10-69e903c70c54 None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:42.590836 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6898c-b91d-45f8-ba10-69e903c70c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:42.591588 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6898c-b91d-45f8-ba10-69e903c70c54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:42.592517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6898c-b91d-45f8-ba10-69e903c70c54 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:42.594158 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6898c-b91d-45f8-ba10-69e903c70c54 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:42.624414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b72c2-ada1-40c8-ae80-a7e6cf09aa6a None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:42.659023 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2ba58-977c-4b17-8f0d-df9721ddc0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:42.659724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2ba58-977c-4b17-8f0d-df9721ddc0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:42.660014 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2ba58-977c-4b17-8f0d-df9721ddc0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:42.660330 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2ba58-977c-4b17-8f0d-df9721ddc0b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:42.661064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2ba58-977c-4b17-8f0d-df9721ddc0b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:42.661373 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2ba58-977c-4b17-8f0d-df9721ddc0b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:42.662773 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2ba58-977c-4b17-8f0d-df9721ddc0b0 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:42.670159 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 471/932] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jun 22 16:41:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:41:42.671653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6898c-b91d-45f8-ba10-69e903c70c54 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:42.679443 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 462/933] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:42.681377 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2ba58-977c-4b17-8f0d-df9721ddc0b0 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:42.706066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:42.790511 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2ba58-977c-4b17-8f0d-df9721ddc0b0 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:42.806266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6898c-b91d-45f8-ba10-69e903c70c54 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:42.831734 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cc3f1-4278-47dd-a817-80793a5999e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:42.832654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cc3f1-4278-47dd-a817-80793a5999e6 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:42.832942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cc3f1-4278-47dd-a817-80793a5999e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:42.833221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cc3f1-4278-47dd-a817-80793a5999e6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:42.842034 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cc3f1-4278-47dd-a817-80793a5999e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:42.843530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cc3f1-4278-47dd-a817-80793a5999e6 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:42.851942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20548c-636e-4e09-ae97-ed6f4bdfae14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:42.853055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20548c-636e-4e09-ae97-ed6f4bdfae14 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:42.853364 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20548c-636e-4e09-ae97-ed6f4bdfae14 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:42.853643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20548c-636e-4e09-ae97-ed6f4bdfae14 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:42.854309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20548c-636e-4e09-ae97-ed6f4bdfae14 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:42.855690 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20548c-636e-4e09-ae97-ed6f4bdfae14 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:42.862842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-b51cc3f1-4278-47dd-a817-80793a5999e6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 16:41:42.862842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:42.862842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:42.862842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:42.862842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:42.862842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:42.862842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:42.862842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:42.862842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:42.862842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:42.862842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:42.862842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:42.862842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:42.862842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:42.862842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:42.862842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:42.863789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:42.863789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:42.863789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:42.863789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:42.863789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:42.863789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:42.863789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:42.863789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:42.863789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:42.863789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:42.863789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:42.863789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:42.863789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:42.863789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:42.863789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:42.863789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:42.863789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:42.863789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:42.865333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:42.865333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:42.865333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:42.865333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:42.865333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:42.865333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:42.865333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:42.865333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:42.865333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 16:41:42.865333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:42.868395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 463/934] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jun 22 16:41:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:42.869944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-0d20548c-636e-4e09-ae97-ed6f4bdfae14 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 16:41:42.869944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:42.869944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:42.869944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:42.869944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:42.869944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:42.869944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:42.869944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:42.869944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 16:41:42.869944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:42.869944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:42.869944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:42.869944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:42.869944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:42.869944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:42.869944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:42.871365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:42.871365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:42.871365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:42.871365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:42.871365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:42.871365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:42.871365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:42.871365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:42.871365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:42.871365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:42.871365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:42.871365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:42.871365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:42.871365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:42.871365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:42.871365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:42.872378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:42.872378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:42.872378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:42.872378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:42.872378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:42.872378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:42.872378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:42.872378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:42.872378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:42.872378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:42.872378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:42.872378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:42.872378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:42.872378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 22 16:41:42.872378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:42.873194 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cc3f1-4278-47dd-a817-80793a5999e6 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:42.873277 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 472/935] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Jun 22 16:41:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:42.877713 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20548c-636e-4e09-ae97-ed6f4bdfae14 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:42.905000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:42.970735 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:42.994534 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20548c-636e-4e09-ae97-ed6f4bdfae14 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:42.995410 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cc3f1-4278-47dd-a817-80793a5999e6 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:43.041522 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153d52b-708d-41ad-a7f9-0e447a349d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:43.041813 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1087e-a7c3-495c-9058-9cd7efda1f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:43.042157 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153d52b-708d-41ad-a7f9-0e447a349d94 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:43.042446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153d52b-708d-41ad-a7f9-0e447a349d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:43.042727 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153d52b-708d-41ad-a7f9-0e447a349d94 None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:43.042826 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1087e-a7c3-495c-9058-9cd7efda1f55 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:43.043096 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1087e-a7c3-495c-9058-9cd7efda1f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:43.043442 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1087e-a7c3-495c-9058-9cd7efda1f55 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:43.043549 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153d52b-708d-41ad-a7f9-0e447a349d94 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:43.043756 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153d52b-708d-41ad-a7f9-0e447a349d94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:43.044477 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1087e-a7c3-495c-9058-9cd7efda1f55 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:43.044853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1087e-a7c3-495c-9058-9cd7efda1f55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:43.045179 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153d52b-708d-41ad-a7f9-0e447a349d94 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:43.046662 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1087e-a7c3-495c-9058-9cd7efda1f55 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:43.052893 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 473/936] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 16:41:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:43.058573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153d52b-708d-41ad-a7f9-0e447a349d94 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:43.076161 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 464/937] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jun 22 16:41:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:43.079423 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1087e-a7c3-495c-9058-9cd7efda1f55 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:43.167632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:43.182902 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153d52b-708d-41ad-a7f9-0e447a349d94 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:43.219278 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f9164-36c5-4034-9678-cf4502fe892d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:43.219945 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f9164-36c5-4034-9678-cf4502fe892d None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:43.220279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f9164-36c5-4034-9678-cf4502fe892d None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:43.220561 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f9164-36c5-4034-9678-cf4502fe892d None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:43.221369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f9164-36c5-4034-9678-cf4502fe892d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:43.221638 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f9164-36c5-4034-9678-cf4502fe892d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:43.223063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f9164-36c5-4034-9678-cf4502fe892d None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:43.224824 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1087e-a7c3-495c-9058-9cd7efda1f55 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:43.233087 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 474/938] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 16:41:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:43.234214 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f9164-36c5-4034-9678-cf4502fe892d None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:43.269218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1905c-d52f-4410-9247-1b42353ef3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:43.271972 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1905c-d52f-4410-9247-1b42353ef3cd None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:43.272481 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1905c-d52f-4410-9247-1b42353ef3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:43.272952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1905c-d52f-4410-9247-1b42353ef3cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:43.281657 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:43.287803 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1905c-d52f-4410-9247-1b42353ef3cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:43.289972 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1905c-d52f-4410-9247-1b42353ef3cd None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:43.313179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-aca1905c-d52f-4410-9247-1b42353ef3cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:43.313179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:43.313179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:43.313179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:43.313179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:43.313179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:43.313179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:43.313179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:43.313179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:43.313179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:43.313179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:43.313179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:43.313179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:43.313179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:43.313179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:43.314100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:43.314100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:43.314100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:43.314100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:43.314100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:43.314100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:43.314100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:43.314100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:43.314100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:43.314100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:43.314100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:43.314100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:43.314100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:43.314100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:43.314100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:43.314100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:43.314100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:43.314995 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:43.314995 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:43.314995 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:43.314995 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:43.323044 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 465/939] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:43.324700 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1905c-d52f-4410-9247-1b42353ef3cd None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:43.348306 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f9164-36c5-4034-9678-cf4502fe892d None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:43.387946 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f42aa-ab35-4add-9b15-2f08c06da9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:43.388734 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f42aa-ab35-4add-9b15-2f08c06da9e6 None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:43.389026 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f42aa-ab35-4add-9b15-2f08c06da9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:43.389308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f42aa-ab35-4add-9b15-2f08c06da9e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:43.392512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f42aa-ab35-4add-9b15-2f08c06da9e6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:43.394054 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f42aa-ab35-4add-9b15-2f08c06da9e6 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:43.443876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1905c-d52f-4410-9247-1b42353ef3cd None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:43.478360 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf877db-0d9b-4c24-9373-1d4a80cc8e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:43.479250 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf877db-0d9b-4c24-9373-1d4a80cc8e47 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:43.479680 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf877db-0d9b-4c24-9373-1d4a80cc8e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:43.480091 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf877db-0d9b-4c24-9373-1d4a80cc8e47 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:43.481002 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf877db-0d9b-4c24-9373-1d4a80cc8e47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:43.481449 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf877db-0d9b-4c24-9373-1d4a80cc8e47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:43.482950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf877db-0d9b-4c24-9373-1d4a80cc8e47 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:43.499770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 466/940] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:43.501373 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf877db-0d9b-4c24-9373-1d4a80cc8e47 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:43.512683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 475/941] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jun 22 16:41:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 16:41:43.558573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:43.615457 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf877db-0d9b-4c24-9373-1d4a80cc8e47 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:43.658817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdad6f8-ea89-45e2-ae93-18f480d0fc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:43.660010 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdad6f8-ea89-45e2-ae93-18f480d0fc04 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:43.660540 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdad6f8-ea89-45e2-ae93-18f480d0fc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:43.661039 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdad6f8-ea89-45e2-ae93-18f480d0fc04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:43.669250 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdad6f8-ea89-45e2-ae93-18f480d0fc04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:43.670969 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdad6f8-ea89-45e2-ae93-18f480d0fc04 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:43.686207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-dcdad6f8-ea89-45e2-ae93-18f480d0fc04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:43.686207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:43.686207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:43.686207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:43.686207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:43.686207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:43.686207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:43.686207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:43.686207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:43.686207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:43.686207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:43.686207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:43.686207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:43.686207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:43.686207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:43.687129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:43.687129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:43.687129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:43.687129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:43.687129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:43.687129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:43.687129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:43.687129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:43.687129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:43.687129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:43.687129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:43.687129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:43.687129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:43.687129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:43.687129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:43.687129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:43.687129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:43.688021 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:43.688021 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:43.688021 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:43.688021 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:43.688021 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:43.688021 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:43.688021 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:43.688021 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:43.690840 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 467/942] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:43.695991 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f42aa-ab35-4add-9b15-2f08c06da9e6 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:43.707462 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:43.810964 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f42aa-ab35-4add-9b15-2f08c06da9e6 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:43.845057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5184a1-4147-4051-8ca9-3997dce405f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:43.846091 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5184a1-4147-4051-8ca9-3997dce405f2 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:43.846573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5184a1-4147-4051-8ca9-3997dce405f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:43.847072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5184a1-4147-4051-8ca9-3997dce405f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:43.848130 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5184a1-4147-4051-8ca9-3997dce405f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:43.848641 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5184a1-4147-4051-8ca9-3997dce405f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:43.850787 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5184a1-4147-4051-8ca9-3997dce405f2 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:43.868278 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 476/943] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:43.870632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdad6f8-ea89-45e2-ae93-18f480d0fc04 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:43.975908 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdad6f8-ea89-45e2-ae93-18f480d0fc04 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:43.985014 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:44.002732 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2241b6d-44e4-41b0-beec-0652ae5dbcec None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:44.003272 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2241b6d-44e4-41b0-beec-0652ae5dbcec None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:44.003272 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2241b6d-44e4-41b0-beec-0652ae5dbcec None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:44.004954 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 477/944] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:44.016188 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b570762-0e79-4de8-923a-726d8c5565df None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:44.016494 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b570762-0e79-4de8-923a-726d8c5565df None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:44.016779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b570762-0e79-4de8-923a-726d8c5565df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:44.024952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105fe52-a62b-4fd3-9bfc-89ed1a5c5c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:44.026000 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105fe52-a62b-4fd3-9bfc-89ed1a5c5c4b None admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:44.026285 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105fe52-a62b-4fd3-9bfc-89ed1a5c5c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:44.026669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105fe52-a62b-4fd3-9bfc-89ed1a5c5c4b None admin] PATH_INFO: `/v3/projects/59d78923fdef459abaf240bd0975494a/users/2a0a8cfb2482466a98340adab9980d53/roles/4887dd0c588d4929bb553ce097a3b236` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:44.029202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105fe52-a62b-4fd3-9bfc-89ed1a5c5c4b None admin] RBAC: Authorizing `identity:create_grant(project_id=59d78923fdef459abaf240bd0975494a, user_id=2a0a8cfb2482466a98340adab9980d53, role_id=4887dd0c588d4929bb553ce097a3b236)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:44.031079 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105fe52-a62b-4fd3-9bfc-89ed1a5c5c4b None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:44.040621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-9b570762-0e79-4de8-923a-726d8c5565df None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:44.041814 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-9b570762-0e79-4de8-923a-726d8c5565df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:44.109810 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 468/945] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:41:43 2022] PUT /identity/v3/projects/59d78923fdef459abaf240bd0975494a/users/2a0a8cfb2482466a98340adab9980d53/roles/4887dd0c588d4929bb553ce097a3b236 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:41:44.121251 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:44.129879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 478/946] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 16:41:44.154458 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105fe52-a62b-4fd3-9bfc-89ed1a5c5c4b None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:44.268730 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105fe52-a62b-4fd3-9bfc-89ed1a5c5c4b None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:44.311621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa56ea9-8e22-46e4-8e01-38698d5c68e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:44.312858 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa56ea9-8e22-46e4-8e01-38698d5c68e3 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:44.313387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa56ea9-8e22-46e4-8e01-38698d5c68e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:44.313801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa56ea9-8e22-46e4-8e01-38698d5c68e3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:44.314599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa56ea9-8e22-46e4-8e01-38698d5c68e3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:44.316115 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa56ea9-8e22-46e4-8e01-38698d5c68e3 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:44.328374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-2aa56ea9-8e22-46e4-8e01-38698d5c68e3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 16:41:44.328374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:44.328374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:44.328374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:44.328374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:44.328374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:44.328374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:44.328374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:44.328374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 16:41:44.328374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:44.328374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:44.328374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:44.328374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:44.328374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:44.328374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:44.328374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:44.328374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:44.329643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:44.329643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:44.329643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:44.329643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:44.329643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:44.329643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:44.329643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:44.329643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:44.329643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:44.329643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:44.329643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:44.329643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:44.329643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:44.329643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:44.329643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:44.329643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:44.330709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:44.330709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:44.330709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:44.330709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:44.330709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:44.330709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:44.330709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:44.330709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:44.330709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:44.330709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:44.330709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:44.330709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:44.330709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 16:41:44.330709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:44.333204 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 469/947] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 16:41:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:44.339900 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b570762-0e79-4de8-923a-726d8c5565df None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:44.444949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b570762-0e79-4de8-923a-726d8c5565df None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:44.480803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d555ff-1076-407d-b692-319adaaa2504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:44.481776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d555ff-1076-407d-b692-319adaaa2504 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:44.482204 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d555ff-1076-407d-b692-319adaaa2504 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:44.482622 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d555ff-1076-407d-b692-319adaaa2504 None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:44.483485 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d555ff-1076-407d-b692-319adaaa2504 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:44.483948 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d555ff-1076-407d-b692-319adaaa2504 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:44.485470 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d555ff-1076-407d-b692-319adaaa2504 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:44.491454 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 479/948] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jun 22 16:41:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:44.497243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa56ea9-8e22-46e4-8e01-38698d5c68e3 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:44.529815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:44.601408 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa56ea9-8e22-46e4-8e01-38698d5c68e3 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:44.635458 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297e54c-a405-4fbb-823a-f22c0cdbfb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:44.636141 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297e54c-a405-4fbb-823a-f22c0cdbfb16 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:44.636432 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297e54c-a405-4fbb-823a-f22c0cdbfb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:44.636707 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297e54c-a405-4fbb-823a-f22c0cdbfb16 None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:44.637671 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297e54c-a405-4fbb-823a-f22c0cdbfb16 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:44.637975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297e54c-a405-4fbb-823a-f22c0cdbfb16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:44.639340 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297e54c-a405-4fbb-823a-f22c0cdbfb16 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:44.645440 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 470/949] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jun 22 16:41:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:44.651705 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d555ff-1076-407d-b692-319adaaa2504 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:44.716428 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:44.759968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d555ff-1076-407d-b692-319adaaa2504 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:44.794877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd425d-223f-47b4-86d6-e7ba7d372955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:44.795538 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd425d-223f-47b4-86d6-e7ba7d372955 None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:44.795821 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd425d-223f-47b4-86d6-e7ba7d372955 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:44.796097 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd425d-223f-47b4-86d6-e7ba7d372955 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:44.796872 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd425d-223f-47b4-86d6-e7ba7d372955 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:44.798233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd425d-223f-47b4-86d6-e7ba7d372955 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:44.876489 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 480/950] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jun 22 16:41:44 2022] POST /identity/v3/endpoints => generated 349 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:41:44.965236 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677403e-725d-4616-9bbd-9deee91b2956 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:44.965591 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677403e-725d-4616-9bbd-9deee91b2956 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:44.965807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677403e-725d-4616-9bbd-9deee91b2956 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:44.967565 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 471/951] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:44.973305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fdffa-368f-4c0b-8006-2b90a6cd58f9 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:44.973592 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fdffa-368f-4c0b-8006-2b90a6cd58f9 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:44.973877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fdffa-368f-4c0b-8006-2b90a6cd58f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:44.992398 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-c87fdffa-368f-4c0b-8006-2b90a6cd58f9 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:44.993665 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c87fdffa-368f-4c0b-8006-2b90a6cd58f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:45.073386 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 481/952] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:45.097258 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677403e-725d-4616-9bbd-9deee91b2956 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:45.204929 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:45.212533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677403e-725d-4616-9bbd-9deee91b2956 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:45.248620 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9a39e-bad1-4339-8e05-4b3a9d3547e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:45.249195 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9a39e-bad1-4339-8e05-4b3a9d3547e7 None admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:45.249478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9a39e-bad1-4339-8e05-4b3a9d3547e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:45.249749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9a39e-bad1-4339-8e05-4b3a9d3547e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:45.250463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9a39e-bad1-4339-8e05-4b3a9d3547e7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:45.252313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9a39e-bad1-4339-8e05-4b3a9d3547e7 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:45.253906 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: WARNING keystone.server.flask.common [None req-adc9a39e-bad1-4339-8e05-4b3a9d3547e7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 22 16:41:45.309025 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.sql.core [None req-adc9a39e-bad1-4339-8e05-4b3a9d3547e7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 16:41:45.309025 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 22 16:41:45.309025 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [parameters: {'id': 'ee1da8d7539a4fa4994eaad0eaaccc1d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 22 16:41:45.309025 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80543) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 16:41:45.326409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-adc9a39e-bad1-4339-8e05-4b3a9d3547e7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ee1da8d7539a4fa4994eaad0eaaccc1d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ee1da8d7539a4fa4994eaad0eaaccc1d. Jun 22 16:41:45.326409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:45.326409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 16:41:45.326409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 16:41:45.326409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 16:41:45.326409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 16:41:45.326409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 16:41:45.326409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 16:41:45.326409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 16:41:45.326409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application conn.query(q) Jun 22 16:41:45.326409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 16:41:45.326409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 16:41:45.326409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 16:41:45.327304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application result.read() Jun 22 16:41:45.327304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 16:41:45.327304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 16:41:45.327304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 16:41:45.327304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 16:41:45.327304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 16:41:45.327304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 16:41:45.327304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 16:41:45.327304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 16:41:45.327304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 16:41:45.327304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:45.327304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 16:41:45.327304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:45.327304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:45.327304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 16:41:45.327304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 16:41:45.327304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 22 16:41:45.327304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 22 16:41:45.328781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 16:41:45.328781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application next(self.gen) Jun 22 16:41:45.328781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 16:41:45.328781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application yield resource Jun 22 16:41:45.328781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 16:41:45.328781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application next(self.gen) Jun 22 16:41:45.328781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 16:41:45.328781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 16:41:45.328781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 16:41:45.328781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 16:41:45.328781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 16:41:45.328781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise self.value Jun 22 16:41:45.328781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 16:41:45.328781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 16:41:45.328781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 16:41:45.328781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application session.commit() Jun 22 16:41:45.328781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 16:41:45.329889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 16:41:45.329889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 16:41:45.329889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 16:41:45.329889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 16:41:45.329889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self.session.flush() Jun 22 16:41:45.329889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 16:41:45.329889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 16:41:45.329889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 16:41:45.329889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 16:41:45.329889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 16:41:45.329889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application compat.raise_( Jun 22 16:41:45.329889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 16:41:45.329889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception Jun 22 16:41:45.329889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 16:41:45.329889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 16:41:45.329889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 16:41:45.329889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 16:41:45.330785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 16:41:45.330785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 16:41:45.330785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 16:41:45.330785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 16:41:45.330785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 22 16:41:45.330785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 22 16:41:45.330785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 16:41:45.330785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 16:41:45.330785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 16:41:45.330785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 16:41:45.330785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 16:41:45.330785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 16:41:45.330785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 16:41:45.330785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 16:41:45.330785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 16:41:45.331573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 16:41:45.331573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 16:41:45.331573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception Jun 22 16:41:45.331573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 16:41:45.331573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 16:41:45.331573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 16:41:45.331573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 16:41:45.331573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 16:41:45.331573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 16:41:45.331573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 16:41:45.331573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application conn.query(q) Jun 22 16:41:45.331573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 16:41:45.331573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 16:41:45.331573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 16:41:45.331573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application result.read() Jun 22 16:41:45.331573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 16:41:45.331573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 16:41:45.332468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 16:41:45.332468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 16:41:45.332468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 16:41:45.332468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 16:41:45.332468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 16:41:45.332468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 16:41:45.332468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 22 16:41:45.332468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 22 16:41:45.332468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [parameters: {'id': 'ee1da8d7539a4fa4994eaad0eaaccc1d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 22 16:41:45.332468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 16:41:45.332468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:45.332468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:45.332468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:45.332468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:45.332468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 22 16:41:45.334870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 22 16:41:45.334870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 16:41:45.334870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 16:41:45.334870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 22 16:41:45.334870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:45.334870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:45.334870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:45.334870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:45.334870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:45.334870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:45.334870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:45.334870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:45.334870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:45.334870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:45.334870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:45.334870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:45.334870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:45.337805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:45.337805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 22 16:41:45.337805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 22 16:41:45.337805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:45.337805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:45.337805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 22 16:41:45.337805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 22 16:41:45.337805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ee1da8d7539a4fa4994eaad0eaaccc1d. Jun 22 16:41:45.337805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:45.337805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 472/953] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Jun 22 16:41:45 2022] POST /identity/v3/projects => generated 262 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:45.338461 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fdffa-368f-4c0b-8006-2b90a6cd58f9 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:45.382376 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:45.442409 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fdffa-368f-4c0b-8006-2b90a6cd58f9 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:45.478529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0365f1-23e7-402d-8f9e-c5d6b45e3f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:45.479693 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0365f1-23e7-402d-8f9e-c5d6b45e3f97 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:45.480203 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0365f1-23e7-402d-8f9e-c5d6b45e3f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:45.480690 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0365f1-23e7-402d-8f9e-c5d6b45e3f97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:45.487761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0365f1-23e7-402d-8f9e-c5d6b45e3f97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:45.489578 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0365f1-23e7-402d-8f9e-c5d6b45e3f97 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:45.504171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-5a0365f1-23e7-402d-8f9e-c5d6b45e3f97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:45.504171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:45.504171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:45.504171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:45.504171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:45.504171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:45.504171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:45.504171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:45.504171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:45.504171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:45.504171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:45.504171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:45.504171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:45.504171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:45.504171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:45.505088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:45.505088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:45.505088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:45.505088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:45.505088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:45.505088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:45.505088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:45.505088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:45.505088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:45.505088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:45.505088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:45.505088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:45.505088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:45.505088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:45.505088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:45.505088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:45.505088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:45.506100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:45.506100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:45.506100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:45.506100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:45.506100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:45.506100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:45.506100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:45.506100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:45.508322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 482/954] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:45.517612 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9a39e-bad1-4339-8e05-4b3a9d3547e7 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:45.623544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9a39e-bad1-4339-8e05-4b3a9d3547e7 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:45.658959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0375ab-cbad-4b24-a995-1c654c51e445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:45.659892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0375ab-cbad-4b24-a995-1c654c51e445 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:45.660363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0375ab-cbad-4b24-a995-1c654c51e445 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:45.660801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0375ab-cbad-4b24-a995-1c654c51e445 None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:45.662426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0375ab-cbad-4b24-a995-1c654c51e445 None admin] RBAC: Adding query filter params (name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:45.663107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0375ab-cbad-4b24-a995-1c654c51e445 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:45.665013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0375ab-cbad-4b24-a995-1c654c51e445 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:45.686018 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6fe20-9a06-472d-b593-46ea336c9c94 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:45.686309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6fe20-9a06-472d-b593-46ea336c9c94 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:45.686594 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6fe20-9a06-472d-b593-46ea336c9c94 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:45.687427 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 473/955] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 16:41:45 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:45.691769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 483/956] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:45.694162 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66311c51-47c7-4be8-bbb4-f8c09b2a0732 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:45.694465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66311c51-47c7-4be8-bbb4-f8c09b2a0732 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:45.694752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66311c51-47c7-4be8-bbb4-f8c09b2a0732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:45.714347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-66311c51-47c7-4be8-bbb4-f8c09b2a0732 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:45.715942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-66311c51-47c7-4be8-bbb4-f8c09b2a0732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:45.719581 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:45.794685 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 474/957] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 16:41:45.817082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6fe20-9a06-472d-b593-46ea336c9c94 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:45.927724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6fe20-9a06-472d-b593-46ea336c9c94 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:45.929768 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:45.964889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de47707-c7de-4879-b5a6-31be7211f52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:45.965684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de47707-c7de-4879-b5a6-31be7211f52a None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:45.965970 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de47707-c7de-4879-b5a6-31be7211f52a None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:45.966250 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de47707-c7de-4879-b5a6-31be7211f52a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:45.966912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de47707-c7de-4879-b5a6-31be7211f52a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:45.968370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de47707-c7de-4879-b5a6-31be7211f52a None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:45.980506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-8de47707-c7de-4879-b5a6-31be7211f52a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 16:41:45.980506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:45.980506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:45.980506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:45.980506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:45.980506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:45.980506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:45.980506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:45.980506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 16:41:45.980506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:45.980506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:45.980506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:45.980506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:45.980506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:45.980506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:45.980506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:45.980506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:45.981649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:45.981649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:45.981649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:45.981649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:45.981649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:45.981649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:45.981649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:45.981649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:45.981649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:45.981649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:45.981649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:45.981649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:45.981649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:45.981649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:45.981649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:45.981649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:45.982509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:45.982509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:45.982509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:45.982509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:45.982509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:45.982509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:45.982509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:45.982509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:45.982509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:45.982509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:45.982509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:45.982509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:45.982509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 16:41:45.982509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:45.982509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 484/958] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:45.988055 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66311c51-47c7-4be8-bbb4-f8c09b2a0732 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:46.091843 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66311c51-47c7-4be8-bbb4-f8c09b2a0732 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:46.128264 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304788a-eb97-4922-bf9a-a21def92840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:46.128918 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304788a-eb97-4922-bf9a-a21def92840b None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:46.129198 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304788a-eb97-4922-bf9a-a21def92840b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:46.129475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304788a-eb97-4922-bf9a-a21def92840b None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:46.130729 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304788a-eb97-4922-bf9a-a21def92840b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:46.131043 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304788a-eb97-4922-bf9a-a21def92840b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:46.132448 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304788a-eb97-4922-bf9a-a21def92840b None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:46.138196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 475/959] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 16:41:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:46.144382 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de47707-c7de-4879-b5a6-31be7211f52a None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:46.250005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de47707-c7de-4879-b5a6-31be7211f52a None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:46.268152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13728085-51a2-4893-b53d-0a37590549a7 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:46.268435 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13728085-51a2-4893-b53d-0a37590549a7 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:46.268714 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13728085-51a2-4893-b53d-0a37590549a7 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:46.270448 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 476/960] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:46.276894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707b981-2ff9-4e77-9adb-971e5a8e7629 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:46.277294 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707b981-2ff9-4e77-9adb-971e5a8e7629 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:46.277675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707b981-2ff9-4e77-9adb-971e5a8e7629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:46.284958 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:46.290094 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd78c57-e0e3-4a39-9c69-6229b259b12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:46.295173 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd78c57-e0e3-4a39-9c69-6229b259b12b None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:46.295173 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd78c57-e0e3-4a39-9c69-6229b259b12b None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:46.295173 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd78c57-e0e3-4a39-9c69-6229b259b12b None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:46.295173 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd78c57-e0e3-4a39-9c69-6229b259b12b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:46.295173 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd78c57-e0e3-4a39-9c69-6229b259b12b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:46.295173 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd78c57-e0e3-4a39-9c69-6229b259b12b None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:46.297278 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-2707b981-2ff9-4e77-9adb-971e5a8e7629 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:46.298876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-2707b981-2ff9-4e77-9adb-971e5a8e7629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:46.299882 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 485/961] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 16:41:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:46.385097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 477/962] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 16:41:46.409972 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd78c57-e0e3-4a39-9c69-6229b259b12b None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:46.444740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:46.517269 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd78c57-e0e3-4a39-9c69-6229b259b12b None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:46.552781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8ba6d-44e3-4d2b-92ac-9c62da364bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:46.553970 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8ba6d-44e3-4d2b-92ac-9c62da364bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:46.554451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8ba6d-44e3-4d2b-92ac-9c62da364bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:46.554957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8ba6d-44e3-4d2b-92ac-9c62da364bf4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:46.565756 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8ba6d-44e3-4d2b-92ac-9c62da364bf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:46.574041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-bce8ba6d-44e3-4d2b-92ac-9c62da364bf4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 16:41:46.574041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:46.574041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:46.574041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:46.574041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:46.574041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:46.574041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:46.574041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:46.574041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:46.574041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:46.574041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:46.574041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:46.574041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:46.574041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:46.574041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:46.574041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:46.575005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:46.575005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:46.575005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:46.575005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:46.575005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:46.575005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:46.575005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:46.575005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:46.575005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:46.575005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:46.575005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:46.575005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:46.575005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:46.575005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:46.575005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:46.575005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:46.575874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:46.575874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:46.575874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:46.575874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:46.575874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:46.575874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:46.575874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:46.575874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:46.575874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:46.575874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:46.575874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 16:41:46.575874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:46.578700 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 486/963] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jun 22 16:41:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:46.584807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707b981-2ff9-4e77-9adb-971e5a8e7629 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:46.688064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707b981-2ff9-4e77-9adb-971e5a8e7629 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:46.723386 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba99f34-a276-4409-96fc-02b331be2c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:46.724466 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba99f34-a276-4409-96fc-02b331be2c9e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:46.724948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba99f34-a276-4409-96fc-02b331be2c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:46.725438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba99f34-a276-4409-96fc-02b331be2c9e None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:46.726402 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba99f34-a276-4409-96fc-02b331be2c9e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:46.726909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba99f34-a276-4409-96fc-02b331be2c9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:46.728488 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba99f34-a276-4409-96fc-02b331be2c9e None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:46.730153 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:46.738699 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 478/964] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jun 22 16:41:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:46.745226 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8ba6d-44e3-4d2b-92ac-9c62da364bf4 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:46.847762 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:46.858678 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8ba6d-44e3-4d2b-92ac-9c62da364bf4 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:46.897681 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6a9f3-c1d3-4d37-bbe9-b8600bfe9142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:46.898478 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6a9f3-c1d3-4d37-bbe9-b8600bfe9142 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:46.898765 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6a9f3-c1d3-4d37-bbe9-b8600bfe9142 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:46.899043 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6a9f3-c1d3-4d37-bbe9-b8600bfe9142 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:46.910852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6a9f3-c1d3-4d37-bbe9-b8600bfe9142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:46.912364 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6a9f3-c1d3-4d37-bbe9-b8600bfe9142 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:46.929506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-f9c6a9f3-c1d3-4d37-bbe9-b8600bfe9142 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:46.929506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:46.929506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:46.929506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:46.929506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:46.929506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:46.929506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:46.929506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:46.929506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:46.929506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:46.929506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:46.929506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:46.929506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:46.929506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:46.929506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:46.930440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:46.930440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:46.930440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:46.930440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:46.930440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:46.930440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:46.930440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:46.930440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:46.930440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:46.930440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:46.930440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:46.930440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:46.930440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:46.930440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:46.930440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:46.930440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:46.930440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:46.931583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:46.931583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:46.931583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:46.931583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:46.931583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 487/965] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:46.936600 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba99f34-a276-4409-96fc-02b331be2c9e None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:47.045465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba99f34-a276-4409-96fc-02b331be2c9e None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:47.059066 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e77ba3-26cd-481e-aa9c-611cd2c8fecc None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:47.059510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e77ba3-26cd-481e-aa9c-611cd2c8fecc None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:47.059912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e77ba3-26cd-481e-aa9c-611cd2c8fecc None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:47.061759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 488/966] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:47.067301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c90842-6c6e-4982-bfc6-404fdfe8b71c None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:47.068328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c90842-6c6e-4982-bfc6-404fdfe8b71c None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:47.068718 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c90842-6c6e-4982-bfc6-404fdfe8b71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:47.085919 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873d03e-206b-4536-bf03-82c8cd76d741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:47.086481 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-60c90842-6c6e-4982-bfc6-404fdfe8b71c None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:47.086610 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873d03e-206b-4536-bf03-82c8cd76d741 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:47.086856 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873d03e-206b-4536-bf03-82c8cd76d741 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:47.087140 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873d03e-206b-4536-bf03-82c8cd76d741 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:47.087673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-60c90842-6c6e-4982-bfc6-404fdfe8b71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:47.087867 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873d03e-206b-4536-bf03-82c8cd76d741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:47.088218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873d03e-206b-4536-bf03-82c8cd76d741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:47.089871 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873d03e-206b-4536-bf03-82c8cd76d741 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:47.105890 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 479/967] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:47.111018 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873d03e-206b-4536-bf03-82c8cd76d741 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:47.180126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 489/968] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 16:41:47.184409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:47.203224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c90842-6c6e-4982-bfc6-404fdfe8b71c None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:47.239110 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873d03e-206b-4536-bf03-82c8cd76d741 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:47.281021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:47.289269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae18d3f-7a64-4340-a3da-8d38cf22653f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:47.292229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae18d3f-7a64-4340-a3da-8d38cf22653f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:47.292229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae18d3f-7a64-4340-a3da-8d38cf22653f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:47.292229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae18d3f-7a64-4340-a3da-8d38cf22653f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:47.301192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae18d3f-7a64-4340-a3da-8d38cf22653f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:47.303318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae18d3f-7a64-4340-a3da-8d38cf22653f None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:47.312910 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c90842-6c6e-4982-bfc6-404fdfe8b71c None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:47.322633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-3ae18d3f-7a64-4340-a3da-8d38cf22653f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 16:41:47.322633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:47.322633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:47.322633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:47.322633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:47.322633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:47.322633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:47.322633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:47.322633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:47.322633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:47.322633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:47.322633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:47.322633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:47.322633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:47.322633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:47.322633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:47.323817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:47.323817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:47.323817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:47.323817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:47.323817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:47.323817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:47.323817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:47.323817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:47.323817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:47.323817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:47.323817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:47.323817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:47.323817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:47.323817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:47.323817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:47.323817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:47.323817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:47.323817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:47.325128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:47.325128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:47.325128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:47.325128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:47.325128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:47.325128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:47.325128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:47.325128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:47.325128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 22 16:41:47.325128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:47.327888 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 480/969] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jun 22 16:41:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:47.333058 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae18d3f-7a64-4340-a3da-8d38cf22653f None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:47.356899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dcf79-ffe4-45b4-bd8b-7c80197b54ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:47.357708 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dcf79-ffe4-45b4-bd8b-7c80197b54ad None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:47.357990 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dcf79-ffe4-45b4-bd8b-7c80197b54ad None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:47.358265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dcf79-ffe4-45b4-bd8b-7c80197b54ad None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:47.358926 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7dcf79-ffe4-45b4-bd8b-7c80197b54ad None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:47.360388 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7dcf79-ffe4-45b4-bd8b-7c80197b54ad None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:47.376523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-6a7dcf79-ffe4-45b4-bd8b-7c80197b54ad None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 16:41:47.376523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:47.376523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:47.376523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:47.376523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:47.376523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:47.376523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:47.376523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:47.376523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 16:41:47.376523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:47.376523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:47.376523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:47.376523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:47.376523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:47.376523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:47.376523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:47.376523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:47.377567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:47.377567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:47.377567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:47.377567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:47.377567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:47.377567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:47.377567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:47.377567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:47.377567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:47.377567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:47.377567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:47.377567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:47.377567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:47.377567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:47.377567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:47.377567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:47.378441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:47.378441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:47.378441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:47.378441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:47.378441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:47.378441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:47.378441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:47.378441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:47.378441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:47.378441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:47.378441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:47.378441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:47.378441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 16:41:47.378441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:47.383146 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 490/970] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 16:41:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:47.384445 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dcf79-ffe4-45b4-bd8b-7c80197b54ad None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:47.463814 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae18d3f-7a64-4340-a3da-8d38cf22653f None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:47.481131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:47.499243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93ebc9-ed2b-485e-ba5f-e7bf85f28bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:47.499876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93ebc9-ed2b-485e-ba5f-e7bf85f28bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:47.500194 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93ebc9-ed2b-485e-ba5f-e7bf85f28bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:47.500479 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93ebc9-ed2b-485e-ba5f-e7bf85f28bf6 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:47.501356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93ebc9-ed2b-485e-ba5f-e7bf85f28bf6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:47.501673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93ebc9-ed2b-485e-ba5f-e7bf85f28bf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:47.503149 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93ebc9-ed2b-485e-ba5f-e7bf85f28bf6 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:47.509137 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dcf79-ffe4-45b4-bd8b-7c80197b54ad None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:47.527793 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 481/971] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jun 22 16:41:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:47.529150 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93ebc9-ed2b-485e-ba5f-e7bf85f28bf6 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:47.554663 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe376a-0a87-49d8-a3c9-22cab2db77b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:47.555454 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe376a-0a87-49d8-a3c9-22cab2db77b5 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:47.555566 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe376a-0a87-49d8-a3c9-22cab2db77b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:47.555782 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe376a-0a87-49d8-a3c9-22cab2db77b5 None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:47.556544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe376a-0a87-49d8-a3c9-22cab2db77b5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:47.556863 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe376a-0a87-49d8-a3c9-22cab2db77b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:47.558233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe376a-0a87-49d8-a3c9-22cab2db77b5 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:47.560142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:47.563437 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 491/972] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jun 22 16:41:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:47.569216 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe376a-0a87-49d8-a3c9-22cab2db77b5 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:47.660577 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93ebc9-ed2b-485e-ba5f-e7bf85f28bf6 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:47.682819 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe376a-0a87-49d8-a3c9-22cab2db77b5 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:47.695455 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3b23a-6f1f-4d73-a1b5-687b3513a63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:47.696122 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3b23a-6f1f-4d73-a1b5-687b3513a63f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:47.696407 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3b23a-6f1f-4d73-a1b5-687b3513a63f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:47.696681 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3b23a-6f1f-4d73-a1b5-687b3513a63f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:47.720919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484954e-fb82-466c-b9d7-69addba5dc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:47.721670 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484954e-fb82-466c-b9d7-69addba5dc30 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:47.722112 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484954e-fb82-466c-b9d7-69addba5dc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:47.722466 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484954e-fb82-466c-b9d7-69addba5dc30 None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:47.723340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484954e-fb82-466c-b9d7-69addba5dc30 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:47.723714 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484954e-fb82-466c-b9d7-69addba5dc30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:47.725483 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484954e-fb82-466c-b9d7-69addba5dc30 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:47.730953 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 492/973] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jun 22 16:41:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:47.736178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484954e-fb82-466c-b9d7-69addba5dc30 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:47.746259 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:47.772886 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3b23a-6f1f-4d73-a1b5-687b3513a63f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:47.774325 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3b23a-6f1f-4d73-a1b5-687b3513a63f None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:47.808614 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:47.848494 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484954e-fb82-466c-b9d7-69addba5dc30 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:47.878988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 482/974] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:41:47 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 16:41:47.880662 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3b23a-6f1f-4d73-a1b5-687b3513a63f None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:47.892065 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075b542-5bc6-45ee-bda6-8a6ff813ad6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:47.893065 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075b542-5bc6-45ee-bda6-8a6ff813ad6d None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:47.893554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075b542-5bc6-45ee-bda6-8a6ff813ad6d None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:47.894057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075b542-5bc6-45ee-bda6-8a6ff813ad6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:47.895168 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075b542-5bc6-45ee-bda6-8a6ff813ad6d None admin] RBAC: Adding query filter params (interface=admin, service_id=57b08780e4ee439ca1d3e60f620a9c5b, region_id=RegionOne) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:47.895790 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075b542-5bc6-45ee-bda6-8a6ff813ad6d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:47.897401 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075b542-5bc6-45ee-bda6-8a6ff813ad6d None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:47.903668 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 493/975] 10.222.0.18 () {56 vars in 1249 bytes} [Wed Jun 22 16:41:47 2022] GET /identity/v3/endpoints?service_id=57b08780e4ee439ca1d3e60f620a9c5b&interface=admin®ion_id=RegionOne => generated 193 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:47.909694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075b542-5bc6-45ee-bda6-8a6ff813ad6d None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:47.962261 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:47.998992 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3b23a-6f1f-4d73-a1b5-687b3513a63f None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:48.026711 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075b542-5bc6-45ee-bda6-8a6ff813ad6d None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:48.046038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baca77b-d608-41b3-944f-eebb35afc827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:48.046828 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baca77b-d608-41b3-944f-eebb35afc827 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:48.047395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baca77b-d608-41b3-944f-eebb35afc827 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:48.047395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baca77b-d608-41b3-944f-eebb35afc827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:48.055122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:48.058690 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baca77b-d608-41b3-944f-eebb35afc827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:48.060077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baca77b-d608-41b3-944f-eebb35afc827 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:48.063429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d024dc-a8e4-4cb7-933d-b00923e66af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:48.064090 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d024dc-a8e4-4cb7-933d-b00923e66af1 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:48.083348 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d024dc-a8e4-4cb7-933d-b00923e66af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:48.083348 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d024dc-a8e4-4cb7-933d-b00923e66af1 None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:48.083348 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d024dc-a8e4-4cb7-933d-b00923e66af1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:48.083348 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d024dc-a8e4-4cb7-933d-b00923e66af1 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:48.083348 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 494/976] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jun 22 16:41:47 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 16:41:48.083348 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0ac73-7d5b-4674-bf1b-40757d98df82 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:48.083825 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0ac73-7d5b-4674-bf1b-40757d98df82 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:48.083825 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0ac73-7d5b-4674-bf1b-40757d98df82 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:48.083825 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 495/977] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:48.084027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-3baca77b-d608-41b3-944f-eebb35afc827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:48.084027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:48.084027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:48.084027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:48.084027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:48.084027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:48.084027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:48.084027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:48.084027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:48.084027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:48.084027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:48.084027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:48.084027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:48.084027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:48.084027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:48.084879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:48.084879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:48.084879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:48.084879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:48.084879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:48.084879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:48.084879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:48.084879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:48.084879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:48.084879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:48.084879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:48.084879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:48.084879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:48.084879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:48.084879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:48.084879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:48.084879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:48.085782 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:48.085782 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:48.085782 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:48.085782 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:48.085782 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 483/978] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:48.086068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce6e29-97ce-4b01-9380-47034526d9a8 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:48.086273 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce6e29-97ce-4b01-9380-47034526d9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:48.086530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce6e29-97ce-4b01-9380-47034526d9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:48.087573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baca77b-d608-41b3-944f-eebb35afc827 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:48.104142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-22ce6e29-97ce-4b01-9380-47034526d9a8 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:48.105438 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-22ce6e29-97ce-4b01-9380-47034526d9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:48.181693 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 496/979] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:48.206707 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce6e29-97ce-4b01-9380-47034526d9a8 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:48.225384 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baca77b-d608-41b3-944f-eebb35afc827 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:48.264798 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:48.277970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac6934-3cec-41a2-a4b8-5d4def96a3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:48.279512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac6934-3cec-41a2-a4b8-5d4def96a3fd None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:48.279703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac6934-3cec-41a2-a4b8-5d4def96a3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:48.279995 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac6934-3cec-41a2-a4b8-5d4def96a3fd None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:48.281061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac6934-3cec-41a2-a4b8-5d4def96a3fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:48.281367 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac6934-3cec-41a2-a4b8-5d4def96a3fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:48.282978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac6934-3cec-41a2-a4b8-5d4def96a3fd None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:48.303325 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 484/980] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:48.309122 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac6934-3cec-41a2-a4b8-5d4def96a3fd None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:48.326667 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce6e29-97ce-4b01-9380-47034526d9a8 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:48.352461 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:48.365360 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb4b0a-90bf-4592-bc70-6efdca846e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:48.367664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb4b0a-90bf-4592-bc70-6efdca846e8a None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:48.367664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb4b0a-90bf-4592-bc70-6efdca846e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:48.367664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb4b0a-90bf-4592-bc70-6efdca846e8a None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:48.367664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb4b0a-90bf-4592-bc70-6efdca846e8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:48.369216 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb4b0a-90bf-4592-bc70-6efdca846e8a None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:48.370656 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: WARNING keystone.server.flask.common [None req-a4eb4b0a-90bf-4592-bc70-6efdca846e8a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 22 16:41:48.421941 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac6934-3cec-41a2-a4b8-5d4def96a3fd None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:48.446108 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.sql.core [None req-a4eb4b0a-90bf-4592-bc70-6efdca846e8a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 16:41:48.446108 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 22 16:41:48.446108 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [parameters: {'user_id': '89b6dee0aad24a78a2eea55321be5510', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 22 16:41:48.446108 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80542) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 22 16:41:48.453897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-a4eb4b0a-90bf-4592-bc70-6efdca846e8a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 22 16:41:48.453897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:48.453897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 16:41:48.453897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 16:41:48.453897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 16:41:48.453897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 16:41:48.453897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 16:41:48.453897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 16:41:48.453897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 16:41:48.453897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application conn.query(q) Jun 22 16:41:48.453897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 16:41:48.453897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 16:41:48.453897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 16:41:48.453897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application result.read() Jun 22 16:41:48.453897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 16:41:48.454985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 16:41:48.454985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 16:41:48.454985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 16:41:48.454985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 16:41:48.454985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 16:41:48.454985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 16:41:48.454985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 16:41:48.454985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 16:41:48.454985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:48.454985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 22 16:41:48.454985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:48.454985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:48.454985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 22 16:41:48.454985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 22 16:41:48.454985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 22 16:41:48.454985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 22 16:41:48.454985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 16:41:48.454985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application next(self.gen) Jun 22 16:41:48.460870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 22 16:41:48.460870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application yield resource Jun 22 16:41:48.460870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 22 16:41:48.460870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application next(self.gen) Jun 22 16:41:48.460870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 22 16:41:48.460870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self.session.rollback() Jun 22 16:41:48.460870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 22 16:41:48.460870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self.force_reraise() Jun 22 16:41:48.460870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 22 16:41:48.460870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise self.value Jun 22 16:41:48.460870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 22 16:41:48.460870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 22 16:41:48.460870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 22 16:41:48.460870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application session.commit() Jun 22 16:41:48.460870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 22 16:41:48.460870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 22 16:41:48.460870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 22 16:41:48.462102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._prepare_impl() Jun 22 16:41:48.462102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 22 16:41:48.462102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self.session.flush() Jun 22 16:41:48.462102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 22 16:41:48.462102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._flush(objects) Jun 22 16:41:48.462102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 22 16:41:48.462102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 22 16:41:48.462102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 22 16:41:48.462102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application compat.raise_( Jun 22 16:41:48.462102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 16:41:48.462102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception Jun 22 16:41:48.462102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 22 16:41:48.462102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application flush_context.execute() Jun 22 16:41:48.462102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 22 16:41:48.462102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rec.execute(self) Jun 22 16:41:48.462102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 22 16:41:48.462102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 22 16:41:48.463233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 22 16:41:48.463233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 22 16:41:48.463233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 22 16:41:48.463233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 22 16:41:48.463233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 22 16:41:48.463233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 22 16:41:48.463233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 22 16:41:48.463233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 22 16:41:48.463233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 22 16:41:48.463233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 22 16:41:48.463233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 22 16:41:48.463233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 22 16:41:48.463233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 22 16:41:48.463233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 22 16:41:48.463233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 22 16:41:48.463233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception Jun 22 16:41:48.464347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 22 16:41:48.464347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 22 16:41:48.464347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 22 16:41:48.464347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 22 16:41:48.464347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 22 16:41:48.464347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application result = self._query(query) Jun 22 16:41:48.464347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 22 16:41:48.464347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application conn.query(q) Jun 22 16:41:48.464347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 22 16:41:48.464347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 22 16:41:48.464347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 22 16:41:48.464347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application result.read() Jun 22 16:41:48.464347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 22 16:41:48.464347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 22 16:41:48.464347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 22 16:41:48.464347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 22 16:41:48.465420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 22 16:41:48.465420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 22 16:41:48.465420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 22 16:41:48.465420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 22 16:41:48.465420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 22 16:41:48.465420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 22 16:41:48.465420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [parameters: {'user_id': '89b6dee0aad24a78a2eea55321be5510', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 22 16:41:48.465420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 22 16:41:48.465420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:48.465420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:48.465420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:48.465420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:48.465420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:48.465420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:48.465420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:48.466403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:48.466403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:48.466403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:48.466403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:48.466403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:48.466403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:48.466403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:48.466403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 22 16:41:48.466403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 22 16:41:48.466403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:48.466403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:48.466403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:48.466403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:48.466403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:48.466403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:48.466403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 22 16:41:48.466403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 22 16:41:48.467551 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 22 16:41:48.467551 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 22 16:41:48.467551 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 22 16:41:48.467551 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 22 16:41:48.467551 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 22 16:41:48.467551 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:48.467551 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 497/981] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Jun 22 16:41:48 2022] POST /identity/v3/users => generated 160 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:48.467551 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff110df-24b9-43d1-a2c7-d53e1e26bc78 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:48.467551 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff110df-24b9-43d1-a2c7-d53e1e26bc78 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:48.467551 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff110df-24b9-43d1-a2c7-d53e1e26bc78 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:48.468269 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 498/982] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:48.468269 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff110df-24b9-43d1-a2c7-d53e1e26bc78 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:48.472389 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9931cd3-3cc0-4209-81c7-3fa912046b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:48.473188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9931cd3-3cc0-4209-81c7-3fa912046b1f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:48.473583 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9931cd3-3cc0-4209-81c7-3fa912046b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:48.474412 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9931cd3-3cc0-4209-81c7-3fa912046b1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:48.482183 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9931cd3-3cc0-4209-81c7-3fa912046b1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:48.483630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9931cd3-3cc0-4209-81c7-3fa912046b1f None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:48.499434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-f9931cd3-3cc0-4209-81c7-3fa912046b1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:48.499434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:48.499434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:48.499434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:48.499434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:48.499434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:48.499434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:48.499434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:48.499434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:48.499434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:48.499434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:48.499434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:48.499434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:48.499434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:48.499434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:48.500399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:48.500399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:48.500399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:48.500399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:48.500399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:48.500399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:48.500399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:48.500399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:48.500399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:48.500399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:48.500399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:48.500399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:48.500399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:48.500399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:48.500399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:48.500399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:48.500399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:48.505980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:48.505980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:48.505980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:48.505980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:48.505980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:48.505980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:48.505980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:48.505980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:48.505980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 485/983] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:48.505980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d116358-1224-4834-b434-2816a6815dd2 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:48.505980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d116358-1224-4834-b434-2816a6815dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:48.506607 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d116358-1224-4834-b434-2816a6815dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:48.520334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-9d116358-1224-4834-b434-2816a6815dd2 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:48.522416 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-9d116358-1224-4834-b434-2816a6815dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:48.567216 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:48.592904 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff110df-24b9-43d1-a2c7-d53e1e26bc78 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:48.603913 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 486/984] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:48.608244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d116358-1224-4834-b434-2816a6815dd2 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:48.640527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d1e67-2b63-4d60-bf5e-807d1a15fe25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:48.641443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d1e67-2b63-4d60-bf5e-807d1a15fe25 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:48.641731 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d1e67-2b63-4d60-bf5e-807d1a15fe25 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:48.642117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d1e67-2b63-4d60-bf5e-807d1a15fe25 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:48.650965 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d1e67-2b63-4d60-bf5e-807d1a15fe25 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:48.652890 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d1e67-2b63-4d60-bf5e-807d1a15fe25 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:48.668299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-997d1e67-2b63-4d60-bf5e-807d1a15fe25 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 16:41:48.668299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:48.668299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:48.668299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:48.668299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:48.668299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:48.668299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:48.668299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:48.668299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:48.668299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:48.668299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:48.668299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:48.668299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:48.668299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:48.668299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:48.668299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:48.669293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:48.669293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:48.669293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:48.669293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:48.669293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:48.669293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:48.669293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:48.669293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:48.669293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:48.669293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:48.669293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:48.669293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:48.669293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:48.669293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:48.669293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:48.669293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:48.669293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:48.669293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:48.670235 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:48.670235 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:48.670235 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:48.670235 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:48.670235 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:48.670235 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:48.670235 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:48.670235 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:48.670235 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 22 16:41:48.670235 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:48.670235 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 499/985] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:41:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:48.670829 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d1e67-2b63-4d60-bf5e-807d1a15fe25 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:48.719685 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:48.721480 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d116358-1224-4834-b434-2816a6815dd2 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:48.758472 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd24551-b234-4d37-a365-7e7d1a10b236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:48.759130 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd24551-b234-4d37-a365-7e7d1a10b236 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:48.759414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd24551-b234-4d37-a365-7e7d1a10b236 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:48.759696 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd24551-b234-4d37-a365-7e7d1a10b236 None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:48.760531 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd24551-b234-4d37-a365-7e7d1a10b236 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:48.760900 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd24551-b234-4d37-a365-7e7d1a10b236 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:48.762583 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd24551-b234-4d37-a365-7e7d1a10b236 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:48.775002 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 487/986] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:48.775730 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd24551-b234-4d37-a365-7e7d1a10b236 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:48.780655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d1e67-2b63-4d60-bf5e-807d1a15fe25 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:48.810418 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:48.815755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22884554-d138-489a-8181-1a3a85af4032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:48.819920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22884554-d138-489a-8181-1a3a85af4032 None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:48.819920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22884554-d138-489a-8181-1a3a85af4032 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:48.819920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22884554-d138-489a-8181-1a3a85af4032 None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:48.819920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22884554-d138-489a-8181-1a3a85af4032 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:48.819920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22884554-d138-489a-8181-1a3a85af4032 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:48.874618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd24551-b234-4d37-a365-7e7d1a10b236 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:48.892571 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 500/987] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 16:41:48 2022] POST /identity/v3/services => generated 242 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:41:48.893537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22884554-d138-489a-8181-1a3a85af4032 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:48.921218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff0d66-e800-4fe6-8447-68a388637391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:48.922410 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff0d66-e800-4fe6-8447-68a388637391 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:48.922986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff0d66-e800-4fe6-8447-68a388637391 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:48.923709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff0d66-e800-4fe6-8447-68a388637391 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:48.925855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff0d66-e800-4fe6-8447-68a388637391 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:48.926398 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff0d66-e800-4fe6-8447-68a388637391 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:48.929606 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff0d66-e800-4fe6-8447-68a388637391 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:48.974739 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 488/988] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jun 22 16:41:48 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:49.025929 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22884554-d138-489a-8181-1a3a85af4032 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:49.040861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:49.066742 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8608dc-fc28-4447-b253-f1c72cf5066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:49.067427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8608dc-fc28-4447-b253-f1c72cf5066e None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:49.068287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8608dc-fc28-4447-b253-f1c72cf5066e None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:49.068570 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8608dc-fc28-4447-b253-f1c72cf5066e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:49.069441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8608dc-fc28-4447-b253-f1c72cf5066e None admin] RBAC: Adding query filter params (role.id=4887dd0c588d4929bb553ce097a3b236, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=2a0a8cfb2482466a98340adab9980d53) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:49.069763 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8608dc-fc28-4447-b253-f1c72cf5066e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:49.071350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8608dc-fc28-4447-b253-f1c72cf5066e None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:49.078485 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 501/989] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:41:48 2022] GET /identity/v3/role_assignments?user.id=2a0a8cfb2482466a98340adab9980d53&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=4887dd0c588d4929bb553ce097a3b236 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:50.212120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adffc6-daa0-4557-b147-76d6440afd4e None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:50.212643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adffc6-daa0-4557-b147-76d6440afd4e None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:50.212643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adffc6-daa0-4557-b147-76d6440afd4e None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:50.214248 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 489/990] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:50.219603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09de06-8acf-4dfb-aa5a-f47c5d18d2c1 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:50.220026 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09de06-8acf-4dfb-aa5a-f47c5d18d2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:50.220219 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09de06-8acf-4dfb-aa5a-f47c5d18d2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:50.237258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-3a09de06-8acf-4dfb-aa5a-f47c5d18d2c1 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:50.238754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3a09de06-8acf-4dfb-aa5a-f47c5d18d2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:50.306621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 502/991] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:50.329589 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adffc6-daa0-4557-b147-76d6440afd4e None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:50.419256 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:50.430303 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adffc6-daa0-4557-b147-76d6440afd4e None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:50.463313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298996ae-06ef-4bd0-8f42-b51a5d941d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:50.464169 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298996ae-06ef-4bd0-8f42-b51a5d941d01 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:50.464464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298996ae-06ef-4bd0-8f42-b51a5d941d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:50.464730 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298996ae-06ef-4bd0-8f42-b51a5d941d01 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:50.465384 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298996ae-06ef-4bd0-8f42-b51a5d941d01 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:50.466733 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298996ae-06ef-4bd0-8f42-b51a5d941d01 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:50.478970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-298996ae-06ef-4bd0-8f42-b51a5d941d01 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 16:41:50.478970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:50.478970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:50.478970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:50.478970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:50.478970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:50.478970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:50.478970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:50.478970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 16:41:50.478970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:50.478970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:50.478970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:50.478970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:50.478970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:50.478970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:50.478970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:50.478970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:50.479978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:50.479978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:50.479978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:50.479978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:50.479978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:50.479978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:50.479978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:50.479978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:50.479978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:50.479978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:50.479978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:50.479978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:50.479978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:50.479978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:50.479978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:50.479978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:50.481152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:50.481152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:50.481152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:50.481152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:50.481152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:50.481152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:50.481152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:50.481152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:50.481152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:50.481152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:50.481152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:50.481152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:50.481152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 22 16:41:50.481152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:50.484428 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 490/992] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jun 22 16:41:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:50.487879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09de06-8acf-4dfb-aa5a-f47c5d18d2c1 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:50.581373 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:50.585822 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09de06-8acf-4dfb-aa5a-f47c5d18d2c1 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:50.619265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb4832-a188-4a58-b311-f6ebe44d21af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:50.619923 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb4832-a188-4a58-b311-f6ebe44d21af None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:50.620235 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb4832-a188-4a58-b311-f6ebe44d21af None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:50.620513 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb4832-a188-4a58-b311-f6ebe44d21af None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:50.621219 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb4832-a188-4a58-b311-f6ebe44d21af None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:50.621525 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb4832-a188-4a58-b311-f6ebe44d21af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:50.623149 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb4832-a188-4a58-b311-f6ebe44d21af None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:50.629325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 503/993] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jun 22 16:41:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:50.634660 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298996ae-06ef-4bd0-8f42-b51a5d941d01 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:50.734555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298996ae-06ef-4bd0-8f42-b51a5d941d01 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:50.768066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbd5cb-d833-4919-8388-b3bd26122497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:50.768748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbd5cb-d833-4919-8388-b3bd26122497 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:50.769028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbd5cb-d833-4919-8388-b3bd26122497 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:50.769298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbd5cb-d833-4919-8388-b3bd26122497 None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:50.770004 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbd5cb-d833-4919-8388-b3bd26122497 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:50.770307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbd5cb-d833-4919-8388-b3bd26122497 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:50.772243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbd5cb-d833-4919-8388-b3bd26122497 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:50.781676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 491/994] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jun 22 16:41:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:50.782868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb4832-a188-4a58-b311-f6ebe44d21af None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:50.881111 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb4832-a188-4a58-b311-f6ebe44d21af None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:50.914187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a93d57-8607-4a4c-bfd4-99fe7ebe5a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:50.914840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a93d57-8607-4a4c-bfd4-99fe7ebe5a68 None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:50.915121 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a93d57-8607-4a4c-bfd4-99fe7ebe5a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:50.915394 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a93d57-8607-4a4c-bfd4-99fe7ebe5a68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:50.916164 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a93d57-8607-4a4c-bfd4-99fe7ebe5a68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:50.917516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a93d57-8607-4a4c-bfd4-99fe7ebe5a68 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:50.980535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995d9db-dcd8-49fa-ba37-ae6516d4a1f0 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:50.980829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995d9db-dcd8-49fa-ba37-ae6516d4a1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:50.981112 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995d9db-dcd8-49fa-ba37-ae6516d4a1f0 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:50.982506 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 492/995] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:50.984654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 504/996] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jun 22 16:41:50 2022] POST /identity/v3/endpoints => generated 325 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:41:50.987633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35b6d5-d933-4e6f-90a9-acd2d7f9b96b None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:50.987940 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35b6d5-d933-4e6f-90a9-acd2d7f9b96b None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:50.988260 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35b6d5-d933-4e6f-90a9-acd2d7f9b96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:51.009360 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-0e35b6d5-d933-4e6f-90a9-acd2d7f9b96b None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:51.010600 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0e35b6d5-d933-4e6f-90a9-acd2d7f9b96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:51.027808 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:51.093478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 493/997] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:50 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:51.116601 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a93d57-8607-4a4c-bfd4-99fe7ebe5a68 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:51.145086 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca7e31-47c0-4f0b-a516-e199c0a75465 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:51.145307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca7e31-47c0-4f0b-a516-e199c0a75465 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:51.145625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca7e31-47c0-4f0b-a516-e199c0a75465 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:51.147140 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 494/998] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:41:51.147394 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:51.152351 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61560c32-ae4c-4429-8299-f5bfbf64493a None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:51.152882 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61560c32-ae4c-4429-8299-f5bfbf64493a None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:51.153163 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61560c32-ae4c-4429-8299-f5bfbf64493a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:51.170521 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-61560c32-ae4c-4429-8299-f5bfbf64493a None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:51.172609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-61560c32-ae4c-4429-8299-f5bfbf64493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:51.234083 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a93d57-8607-4a4c-bfd4-99fe7ebe5a68 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:51.252954 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 495/999] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 16:41:51.268581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92354d5a-aa47-402f-a030-ed0d11088a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:51.269380 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92354d5a-aa47-402f-a030-ed0d11088a47 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:51.269675 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92354d5a-aa47-402f-a030-ed0d11088a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:51.269956 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92354d5a-aa47-402f-a030-ed0d11088a47 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:51.270645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92354d5a-aa47-402f-a030-ed0d11088a47 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:51.272022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92354d5a-aa47-402f-a030-ed0d11088a47 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:51.275076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61560c32-ae4c-4429-8299-f5bfbf64493a None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:51.283847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-92354d5a-aa47-402f-a030-ed0d11088a47 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 16:41:51.283847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:51.283847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:51.283847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:51.283847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:51.283847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:51.283847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:51.283847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:51.283847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 16:41:51.283847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:51.283847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:51.283847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:51.283847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:51.283847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:51.283847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:51.283847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:51.283847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:51.285084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:51.285084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:51.285084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:51.285084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:51.285084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:51.285084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:51.285084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:51.285084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:51.285084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:51.285084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:51.285084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:51.285084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:51.285084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:51.285084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:51.285084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:51.285084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:51.286122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:51.286122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:51.286122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:51.286122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:51.286122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:51.286122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:51.286122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:51.286122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:51.286122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:51.286122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:51.286122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:51.286122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:51.286122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 16:41:51.286122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:51.286122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 505/1000] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:51.293302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92354d5a-aa47-402f-a030-ed0d11088a47 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:51.357782 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:51.384259 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61560c32-ae4c-4429-8299-f5bfbf64493a None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:51.385079 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:51.401119 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92354d5a-aa47-402f-a030-ed0d11088a47 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:51.420021 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61201f04-413f-4bf7-9f09-c5ab23565bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:51.420832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61201f04-413f-4bf7-9f09-c5ab23565bdf None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:51.421191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61201f04-413f-4bf7-9f09-c5ab23565bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:51.421466 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61201f04-413f-4bf7-9f09-c5ab23565bdf None admin] PATH_INFO: `/v3/services/image` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:51.422534 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61201f04-413f-4bf7-9f09-c5ab23565bdf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:51.423908 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61201f04-413f-4bf7-9f09-c5ab23565bdf None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:51.436747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-61201f04-413f-4bf7-9f09-c5ab23565bdf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 16:41:51.436747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:51.436747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:51.436747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:51.436747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:51.436747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:51.436747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:51.436747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:51.436747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 16:41:51.436747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:51.436747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:51.436747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:51.436747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:51.436747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:51.436747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:51.436747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:51.436747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:51.437957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:51.437957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:51.437957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:51.437957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:51.437957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:51.437957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:51.437957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:51.437957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:51.437957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:51.437957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:51.437957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:51.437957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:51.437957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:51.437957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:51.437957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:51.437957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:51.439328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:51.439328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:51.439328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:51.439328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:51.439328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:51.439328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:51.439328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:51.439328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:51.439328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:51.439328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:51.439328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:51.439328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:51.439328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 16:41:51.439328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:51.439328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 496/1001] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Jun 22 16:41:51 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:51.440887 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e46f7b-c980-4a21-b059-fc67e9b3e94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:51.441557 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e46f7b-c980-4a21-b059-fc67e9b3e94d None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:51.441844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e46f7b-c980-4a21-b059-fc67e9b3e94d None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:51.442121 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e46f7b-c980-4a21-b059-fc67e9b3e94d None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:51.442952 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e46f7b-c980-4a21-b059-fc67e9b3e94d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:51.443263 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e46f7b-c980-4a21-b059-fc67e9b3e94d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:51.443794 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61201f04-413f-4bf7-9f09-c5ab23565bdf None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:51.444656 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e46f7b-c980-4a21-b059-fc67e9b3e94d None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:51.455053 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 506/1002] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 16:41:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:51.455322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e46f7b-c980-4a21-b059-fc67e9b3e94d None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:51.552915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61201f04-413f-4bf7-9f09-c5ab23565bdf None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:51.562019 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e46f7b-c980-4a21-b059-fc67e9b3e94d None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:51.590621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1558b-de0c-4fd9-9475-c7ca5b315ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:51.591279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1558b-de0c-4fd9-9475-c7ca5b315ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:51.591567 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1558b-de0c-4fd9-9475-c7ca5b315ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:51.592001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1558b-de0c-4fd9-9475-c7ca5b315ce7 None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:51.592694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1558b-de0c-4fd9-9475-c7ca5b315ce7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:51.593003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1558b-de0c-4fd9-9475-c7ca5b315ce7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:51.594534 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1558b-de0c-4fd9-9475-c7ca5b315ce7 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:51.595399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e803625-3dbb-4b28-8bac-610e98264a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:51.596054 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e803625-3dbb-4b28-8bac-610e98264a6c None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:51.596373 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e803625-3dbb-4b28-8bac-610e98264a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:51.596658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e803625-3dbb-4b28-8bac-610e98264a6c None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:51.597363 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e803625-3dbb-4b28-8bac-610e98264a6c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:51.597673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e803625-3dbb-4b28-8bac-610e98264a6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:51.599595 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e803625-3dbb-4b28-8bac-610e98264a6c None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:51.605733 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 497/1003] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:51.609129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1558b-de0c-4fd9-9475-c7ca5b315ce7 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:51.609245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 507/1004] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 16:41:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:51.614367 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:51.614653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e803625-3dbb-4b28-8bac-610e98264a6c None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:51.630922 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:51.715393 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1558b-de0c-4fd9-9475-c7ca5b315ce7 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:51.718225 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e803625-3dbb-4b28-8bac-610e98264a6c None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:51.749598 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2328a-52f1-4dc7-84ed-bd76c4f46f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:51.750254 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2328a-52f1-4dc7-84ed-bd76c4f46f30 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:51.750534 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2328a-52f1-4dc7-84ed-bd76c4f46f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:51.750810 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2328a-52f1-4dc7-84ed-bd76c4f46f30 None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:51.751515 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2328a-52f1-4dc7-84ed-bd76c4f46f30 None admin] RBAC: Adding query filter params (type=image) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:51.751818 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2328a-52f1-4dc7-84ed-bd76c4f46f30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:51.752294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9df30c-3ca8-470e-abd4-f09b9f4aa556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:51.752948 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9df30c-3ca8-470e-abd4-f09b9f4aa556 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:51.753220 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2328a-52f1-4dc7-84ed-bd76c4f46f30 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:51.753332 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9df30c-3ca8-470e-abd4-f09b9f4aa556 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:51.753504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9df30c-3ca8-470e-abd4-f09b9f4aa556 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:51.754298 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9df30c-3ca8-470e-abd4-f09b9f4aa556 None admin] RBAC: Adding query filter params (interface=public, service_id=c09496bba3ae4dd2af1fc753f765a766, region_id=RegionOne) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:51.754613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9df30c-3ca8-470e-abd4-f09b9f4aa556 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:51.756004 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9df30c-3ca8-470e-abd4-f09b9f4aa556 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:51.758141 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 498/1005] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:51 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:51.766545 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 508/1006] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jun 22 16:41:51 2022] GET /identity/v3/endpoints?service_id=c09496bba3ae4dd2af1fc753f765a766&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:51.767493 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2328a-52f1-4dc7-84ed-bd76c4f46f30 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:51.840297 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:51.878441 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2328a-52f1-4dc7-84ed-bd76c4f46f30 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:51.915815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9dcfa6-a3fe-4890-9d48-a6c2a42143e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:51.916565 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dcfa6-a3fe-4890-9d48-a6c2a42143e7 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:51.916841 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dcfa6-a3fe-4890-9d48-a6c2a42143e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:51.917114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dcfa6-a3fe-4890-9d48-a6c2a42143e7 None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:51.917793 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9dcfa6-a3fe-4890-9d48-a6c2a42143e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:51.919152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9dcfa6-a3fe-4890-9d48-a6c2a42143e7 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:51.925373 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 499/1007] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jun 22 16:41:51 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 16:41:53.064777 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd985dd0-e971-479a-92fa-bfcf285cfd1c None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:53.065309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd985dd0-e971-479a-92fa-bfcf285cfd1c None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:53.065309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd985dd0-e971-479a-92fa-bfcf285cfd1c None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:53.066738 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 509/1008] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:53.071903 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac51f09-21a4-4665-9015-46505a955351 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:53.072323 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac51f09-21a4-4665-9015-46505a955351 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:53.072479 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac51f09-21a4-4665-9015-46505a955351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:53.089282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-6ac51f09-21a4-4665-9015-46505a955351 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:53.090451 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6ac51f09-21a4-4665-9015-46505a955351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:53.162123 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 500/1009] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:53 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:53.184985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd985dd0-e971-479a-92fa-bfcf285cfd1c None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:53.267314 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:53.290490 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd985dd0-e971-479a-92fa-bfcf285cfd1c None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:53.323567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555cc55-745d-496f-8675-b97bdcba2b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:53.324779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555cc55-745d-496f-8675-b97bdcba2b9b None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:53.325221 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555cc55-745d-496f-8675-b97bdcba2b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:53.325664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555cc55-745d-496f-8675-b97bdcba2b9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:53.327006 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555cc55-745d-496f-8675-b97bdcba2b9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:53.328621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555cc55-745d-496f-8675-b97bdcba2b9b None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:53.330723 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 510/1010] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:53.336611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac51f09-21a4-4665-9015-46505a955351 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:53.396158 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:53.438792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac51f09-21a4-4665-9015-46505a955351 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:53.473529 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34defb-1664-4d3e-9ed5-16135deee3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:53.474269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34defb-1664-4d3e-9ed5-16135deee3e3 None admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:53.474558 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34defb-1664-4d3e-9ed5-16135deee3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:53.474840 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34defb-1664-4d3e-9ed5-16135deee3e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:53.475582 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34defb-1664-4d3e-9ed5-16135deee3e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:53.477092 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34defb-1664-4d3e-9ed5-16135deee3e3 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:53.584243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 501/1011] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 16:41:53 2022] POST /identity/v3/projects => generated 311 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:41:53.809835 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3a3da-f482-4ca2-a98a-63df0cfc062d None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:53.810197 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3a3da-f482-4ca2-a98a-63df0cfc062d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:53.810487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3a3da-f482-4ca2-a98a-63df0cfc062d None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:53.811925 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 511/1012] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:53.817185 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710da22-8a29-4a33-9253-413ed791081f None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:53.818047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710da22-8a29-4a33-9253-413ed791081f None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:53.818329 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710da22-8a29-4a33-9253-413ed791081f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:53.835087 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-a710da22-8a29-4a33-9253-413ed791081f None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:53.836343 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-a710da22-8a29-4a33-9253-413ed791081f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:53.904948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 502/1013] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:53 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:53.928672 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3a3da-f482-4ca2-a98a-63df0cfc062d None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:53.995202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c22c3-a918-4dc5-82ee-19977f12500f None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:53.995486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c22c3-a918-4dc5-82ee-19977f12500f None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:53.995762 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c22c3-a918-4dc5-82ee-19977f12500f None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:53.997408 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 503/1014] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:41:54.008066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b31528-07bb-4642-bf0b-6338bf367ba6 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:54.008066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b31528-07bb-4642-bf0b-6338bf367ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:54.008066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b31528-07bb-4642-bf0b-6338bf367ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:54.022969 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-f2b31528-07bb-4642-bf0b-6338bf367ba6 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:54.024310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-f2b31528-07bb-4642-bf0b-6338bf367ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:54.050563 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3a3da-f482-4ca2-a98a-63df0cfc062d None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:54.063953 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:54.090724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8866f16-09c6-4dd4-b851-5946e8cf070b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:54.091714 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8866f16-09c6-4dd4-b851-5946e8cf070b None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:54.092224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8866f16-09c6-4dd4-b851-5946e8cf070b None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:54.092455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8866f16-09c6-4dd4-b851-5946e8cf070b None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:54.093195 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8866f16-09c6-4dd4-b851-5946e8cf070b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:54.094567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8866f16-09c6-4dd4-b851-5946e8cf070b None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:54.096331 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 504/1015] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 16:41:54.119074 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b31528-07bb-4642-bf0b-6338bf367ba6 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:54.189779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 512/1016] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 16:41:53 2022] POST /identity/v3/services => generated 242 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 16:41:54.222798 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b31528-07bb-4642-bf0b-6338bf367ba6 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:54.268493 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389dab46-a4cd-4e75-8982-c880bc74e0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:54.269358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dab46-a4cd-4e75-8982-c880bc74e0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:54.269647 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dab46-a4cd-4e75-8982-c880bc74e0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:54.269925 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dab46-a4cd-4e75-8982-c880bc74e0b2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:54.270635 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389dab46-a4cd-4e75-8982-c880bc74e0b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:54.272050 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389dab46-a4cd-4e75-8982-c880bc74e0b2 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:54.284643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-389dab46-a4cd-4e75-8982-c880bc74e0b2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 16:41:54.284643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:54.284643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:54.284643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:54.284643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:54.284643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:54.284643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:54.284643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:54.284643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 16:41:54.284643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:54.284643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:54.284643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:54.284643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:54.284643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:54.284643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:54.284643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:54.284643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:54.285799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:54.285799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:54.285799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:54.285799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:54.285799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:54.285799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:54.285799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:54.285799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:54.285799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:54.285799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:54.285799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:54.285799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:54.285799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:54.285799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:54.285799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:54.285799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:54.292397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:54.292397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:54.292397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:54.292397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:54.292397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:54.292397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:54.292397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:54.292397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:54.292397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:54.292397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:54.292397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:54.292397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:54.292397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 22 16:41:54.292397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:54.292397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 505/1017] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:54.293659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8866f16-09c6-4dd4-b851-5946e8cf070b None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:54.303704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:54.401984 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8866f16-09c6-4dd4-b851-5946e8cf070b None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:54.436129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb05e18-c650-4f8c-9a33-5b3931ffdb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:54.436789 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb05e18-c650-4f8c-9a33-5b3931ffdb13 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:54.437077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb05e18-c650-4f8c-9a33-5b3931ffdb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:54.437354 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb05e18-c650-4f8c-9a33-5b3931ffdb13 None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:54.438062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb05e18-c650-4f8c-9a33-5b3931ffdb13 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:54.438366 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb05e18-c650-4f8c-9a33-5b3931ffdb13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:54.439715 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb05e18-c650-4f8c-9a33-5b3931ffdb13 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:54.444941 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 513/1018] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 16:41:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:54.450335 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389dab46-a4cd-4e75-8982-c880bc74e0b2 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:54.484789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:54.561712 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389dab46-a4cd-4e75-8982-c880bc74e0b2 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:54.595782 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c0c4d-2133-4922-b069-38d60e9977bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:54.596538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c0c4d-2133-4922-b069-38d60e9977bc None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:54.596873 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c0c4d-2133-4922-b069-38d60e9977bc None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:54.597160 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c0c4d-2133-4922-b069-38d60e9977bc None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:54.597872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c0c4d-2133-4922-b069-38d60e9977bc None admin] RBAC: Adding query filter params (type=compute) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:54.598297 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c0c4d-2133-4922-b069-38d60e9977bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:54.600286 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c0c4d-2133-4922-b069-38d60e9977bc None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:54.609872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 506/1019] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jun 22 16:41:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:54.611101 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb05e18-c650-4f8c-9a33-5b3931ffdb13 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:54.681342 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:54.712511 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb05e18-c650-4f8c-9a33-5b3931ffdb13 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:54.748194 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759f9e9-e1b8-445a-b8a8-df52b04794be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:54.748860 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759f9e9-e1b8-445a-b8a8-df52b04794be None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:54.749150 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759f9e9-e1b8-445a-b8a8-df52b04794be None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:54.749432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759f9e9-e1b8-445a-b8a8-df52b04794be None admin] PATH_INFO: `/v3/endpoints` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:54.750197 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759f9e9-e1b8-445a-b8a8-df52b04794be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:54.751567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759f9e9-e1b8-445a-b8a8-df52b04794be None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:54.844134 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 514/1020] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jun 22 16:41:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:41:55.646734 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3384cda-f3ae-4714-b555-ef7619045a11 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:55.647285 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3384cda-f3ae-4714-b555-ef7619045a11 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:55.647285 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3384cda-f3ae-4714-b555-ef7619045a11 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:55.648824 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 507/1021] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:55.653867 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c9b1e-37d8-465e-b7cd-7cbc410aad69 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:55.654249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c9b1e-37d8-465e-b7cd-7cbc410aad69 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:55.654430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c9b1e-37d8-465e-b7cd-7cbc410aad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:55.671433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-e43c9b1e-37d8-465e-b7cd-7cbc410aad69 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:55.672634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e43c9b1e-37d8-465e-b7cd-7cbc410aad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:55.744172 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 515/1022] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:55.768669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3384cda-f3ae-4714-b555-ef7619045a11 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:55.866268 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:55.873371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3384cda-f3ae-4714-b555-ef7619045a11 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:55.906910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe6a78-7e14-477d-8d60-056bc59edc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:55.907621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe6a78-7e14-477d-8d60-056bc59edc14 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:55.907905 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe6a78-7e14-477d-8d60-056bc59edc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:55.908210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe6a78-7e14-477d-8d60-056bc59edc14 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:55.909433 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe6a78-7e14-477d-8d60-056bc59edc14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:55.910863 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe6a78-7e14-477d-8d60-056bc59edc14 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:55.917682 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 508/1023] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:55.918885 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c9b1e-37d8-465e-b7cd-7cbc410aad69 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:55.972554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:56.029739 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c9b1e-37d8-465e-b7cd-7cbc410aad69 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:56.066751 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bb723-63b8-4f94-b4f4-3fc2c200afda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:56.067443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bb723-63b8-4f94-b4f4-3fc2c200afda None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:56.067725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bb723-63b8-4f94-b4f4-3fc2c200afda None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:56.068050 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bb723-63b8-4f94-b4f4-3fc2c200afda None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:56.068791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0bb723-63b8-4f94-b4f4-3fc2c200afda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:56.070210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0bb723-63b8-4f94-b4f4-3fc2c200afda None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:56.183992 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 516/1024] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 16:41:55 2022] POST /identity/v3/users => generated 285 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:41:56.256368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24307c19-bc87-44ec-a55c-ee317a7bc10c None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:56.256695 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24307c19-bc87-44ec-a55c-ee317a7bc10c None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:56.256936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24307c19-bc87-44ec-a55c-ee317a7bc10c None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:56.258496 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 509/1025] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:56.264428 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0479b-aa11-407d-8f30-4eb749622389 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:56.264860 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0479b-aa11-407d-8f30-4eb749622389 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:56.265241 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0479b-aa11-407d-8f30-4eb749622389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:56.283098 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-5ef0479b-aa11-407d-8f30-4eb749622389 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:56.284511 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-5ef0479b-aa11-407d-8f30-4eb749622389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:56.364172 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 517/1026] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:56.380405 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24307c19-bc87-44ec-a55c-ee317a7bc10c None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:56.494421 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24307c19-bc87-44ec-a55c-ee317a7bc10c None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:56.530626 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5e82f-ad37-44a9-9e5f-a8310f6315d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:56.531410 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5e82f-ad37-44a9-9e5f-a8310f6315d4 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:56.531747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5e82f-ad37-44a9-9e5f-a8310f6315d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:56.532035 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5e82f-ad37-44a9-9e5f-a8310f6315d4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:56.532720 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5e82f-ad37-44a9-9e5f-a8310f6315d4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:56.534086 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5e82f-ad37-44a9-9e5f-a8310f6315d4 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:56.546478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-54e5e82f-ad37-44a9-9e5f-a8310f6315d4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 16:41:56.546478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:56.546478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:56.546478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:56.546478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:56.546478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:56.546478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:56.546478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:56.546478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 16:41:56.546478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:56.546478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:56.546478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:56.546478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:56.546478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:56.546478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:56.546478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:56.546478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:56.547764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:56.547764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:56.547764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:56.547764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:56.547764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:56.547764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:56.547764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:56.547764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:56.547764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:56.547764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:56.547764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:56.547764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:56.547764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:56.547764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:56.547764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:56.547764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:56.553630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:56.553630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:56.553630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:56.553630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:56.553630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:56.553630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:56.553630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:56.553630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:56.553630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:56.553630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:56.553630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:56.553630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:56.553630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 16:41:56.553630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:56.553630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 510/1027] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Jun 22 16:41:56 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:56.556228 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0479b-aa11-407d-8f30-4eb749622389 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:56.598451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:56.659292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0479b-aa11-407d-8f30-4eb749622389 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:56.693508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad0f6e-646e-4aa6-922e-6e32b5a394b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:56.694177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad0f6e-646e-4aa6-922e-6e32b5a394b3 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:56.694465 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad0f6e-646e-4aa6-922e-6e32b5a394b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:56.694745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad0f6e-646e-4aa6-922e-6e32b5a394b3 None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:56.695461 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad0f6e-646e-4aa6-922e-6e32b5a394b3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:56.695774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad0f6e-646e-4aa6-922e-6e32b5a394b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:56.697185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad0f6e-646e-4aa6-922e-6e32b5a394b3 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:56.702213 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 518/1028] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:56.707797 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5e82f-ad37-44a9-9e5f-a8310f6315d4 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:56.737451 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:56.809888 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5e82f-ad37-44a9-9e5f-a8310f6315d4 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:56.843311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95a265-4948-46c7-909b-2d2e93425264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:56.843969 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95a265-4948-46c7-909b-2d2e93425264 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:56.844286 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95a265-4948-46c7-909b-2d2e93425264 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:56.844570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95a265-4948-46c7-909b-2d2e93425264 None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:56.845286 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95a265-4948-46c7-909b-2d2e93425264 None admin] RBAC: Adding query filter params (type=image) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:56.845596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95a265-4948-46c7-909b-2d2e93425264 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:56.846967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95a265-4948-46c7-909b-2d2e93425264 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:56.852000 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 511/1029] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:56.857805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad0f6e-646e-4aa6-922e-6e32b5a394b3 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:56.967940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad0f6e-646e-4aa6-922e-6e32b5a394b3 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:56.969919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:56.985969 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13120c-30f4-43d9-b708-4036c4fedba2 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:56.986288 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13120c-30f4-43d9-b708-4036c4fedba2 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:56.986540 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13120c-30f4-43d9-b708-4036c4fedba2 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:56.991160 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 512/1030] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:56.993611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa02aa-2032-4407-a0b5-e5ec4a9cf090 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:56.993901 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa02aa-2032-4407-a0b5-e5ec4a9cf090 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:56.994186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa02aa-2032-4407-a0b5-e5ec4a9cf090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:57.005840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60283d-953d-4218-9387-bb31ab50b437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:57.006505 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60283d-953d-4218-9387-bb31ab50b437 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:57.006791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60283d-953d-4218-9387-bb31ab50b437 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:57.007074 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60283d-953d-4218-9387-bb31ab50b437 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:57.007882 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60283d-953d-4218-9387-bb31ab50b437 None admin] RBAC: Adding query filter params (interface=public, service_id=1f76d6b91648470aad4f2bbe0aff6f2e, region_id=RegionOne) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:57.008234 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60283d-953d-4218-9387-bb31ab50b437 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:57.009623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60283d-953d-4218-9387-bb31ab50b437 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:57.015224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 519/1031] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jun 22 16:41:56 2022] GET /identity/v3/endpoints?service_id=1f76d6b91648470aad4f2bbe0aff6f2e&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:57.015657 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-f8aa02aa-2032-4407-a0b5-e5ec4a9cf090 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:57.016885 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-f8aa02aa-2032-4407-a0b5-e5ec4a9cf090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:57.022599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60283d-953d-4218-9387-bb31ab50b437 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:57.099316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 513/1032] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:57.114076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa02aa-2032-4407-a0b5-e5ec4a9cf090 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:57.125897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60283d-953d-4218-9387-bb31ab50b437 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:57.138759 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:57.162702 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c76df-86ff-414a-87aa-a4c66e483ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:57.163363 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c76df-86ff-414a-87aa-a4c66e483ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:57.163675 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c76df-86ff-414a-87aa-a4c66e483ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:57.163940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c76df-86ff-414a-87aa-a4c66e483ac3 None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:57.164710 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c76df-86ff-414a-87aa-a4c66e483ac3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:57.166085 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c76df-86ff-414a-87aa-a4c66e483ac3 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:57.172855 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 520/1033] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jun 22 16:41:57 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 16:41:57.218890 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa02aa-2032-4407-a0b5-e5ec4a9cf090 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:57.258856 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854e25b-d113-4f0b-91e3-a8e07daa0b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:57.259693 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854e25b-d113-4f0b-91e3-a8e07daa0b75 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:57.259969 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854e25b-d113-4f0b-91e3-a8e07daa0b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:57.260271 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854e25b-d113-4f0b-91e3-a8e07daa0b75 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:57.275877 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854e25b-d113-4f0b-91e3-a8e07daa0b75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:57.284061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-e854e25b-d113-4f0b-91e3-a8e07daa0b75 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 16:41:57.284061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:57.284061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:57.284061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:57.284061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:57.284061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:57.284061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:57.284061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:57.284061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:57.284061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:57.284061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:57.284061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:57.284061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:57.284061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:57.284061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:57.284061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:57.285064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:57.285064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:57.285064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:57.285064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:57.285064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:57.285064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:57.285064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:57.285064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:57.285064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:57.285064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:57.285064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:57.285064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:57.285064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:57.285064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:57.285064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:57.285064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:57.285966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:57.285966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:57.285966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:57.285966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:57.285966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:57.285966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:57.285966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:57.285966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:57.285966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:57.285966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:57.285966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 16:41:57.285966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:57.285966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 514/1034] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jun 22 16:41:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:57.294173 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c76df-86ff-414a-87aa-a4c66e483ac3 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:57.329135 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:57.403646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c76df-86ff-414a-87aa-a4c66e483ac3 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:57.437577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae4be5-d20b-4d0f-871e-9649c3cc8b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:57.438244 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae4be5-d20b-4d0f-871e-9649c3cc8b06 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:57.438528 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae4be5-d20b-4d0f-871e-9649c3cc8b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:57.438805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae4be5-d20b-4d0f-871e-9649c3cc8b06 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:57.439553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae4be5-d20b-4d0f-871e-9649c3cc8b06 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:57.439858 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae4be5-d20b-4d0f-871e-9649c3cc8b06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:57.441255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae4be5-d20b-4d0f-871e-9649c3cc8b06 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:57.450157 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 521/1035] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jun 22 16:41:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:57.455866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854e25b-d113-4f0b-91e3-a8e07daa0b75 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:57.539486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:57.558273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854e25b-d113-4f0b-91e3-a8e07daa0b75 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:57.592780 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e27c03-6b7e-45b1-b569-bfb4b54225bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:57.593623 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e27c03-6b7e-45b1-b569-bfb4b54225bb None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:57.593909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e27c03-6b7e-45b1-b569-bfb4b54225bb None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:57.594177 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e27c03-6b7e-45b1-b569-bfb4b54225bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:57.606857 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e27c03-6b7e-45b1-b569-bfb4b54225bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:57.608338 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e27c03-6b7e-45b1-b569-bfb4b54225bb None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:57.626060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-45e27c03-6b7e-45b1-b569-bfb4b54225bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:57.626060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:57.626060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:57.626060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:57.626060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:57.626060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:57.626060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:57.626060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:57.626060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:57.626060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:57.626060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:57.626060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:57.626060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:57.626060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:57.626060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:57.627578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:57.627578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:57.627578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:57.627578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:57.627578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:57.627578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:57.627578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:57.627578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:57.627578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:57.627578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:57.627578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:57.627578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:57.627578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:57.627578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:57.627578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:57.627578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:57.627578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:57.628793 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:57.628793 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:57.628793 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:57.628793 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:57.632184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 515/1036] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:41:57.633700 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae4be5-d20b-4d0f-871e-9649c3cc8b06 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:57.725995 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:57.735233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae4be5-d20b-4d0f-871e-9649c3cc8b06 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:57.769206 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbd8c2-c0a4-4b96-b3a0-f285ea4d61f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:57.769862 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbd8c2-c0a4-4b96-b3a0-f285ea4d61f4 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:57.770150 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbd8c2-c0a4-4b96-b3a0-f285ea4d61f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:57.770456 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbd8c2-c0a4-4b96-b3a0-f285ea4d61f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:57.771178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbd8c2-c0a4-4b96-b3a0-f285ea4d61f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:57.771485 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbd8c2-c0a4-4b96-b3a0-f285ea4d61f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:57.772871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbd8c2-c0a4-4b96-b3a0-f285ea4d61f4 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:57.788932 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 522/1037] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:57.790330 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e27c03-6b7e-45b1-b569-bfb4b54225bb None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:57.889970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e27c03-6b7e-45b1-b569-bfb4b54225bb None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:57.923332 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9d2f2-69cd-4544-99c2-1b6e2416b42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:57.924193 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9d2f2-69cd-4544-99c2-1b6e2416b42e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:57.924479 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9d2f2-69cd-4544-99c2-1b6e2416b42e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:57.924754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9d2f2-69cd-4544-99c2-1b6e2416b42e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:57.927538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:57.934908 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9d2f2-69cd-4544-99c2-1b6e2416b42e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:57.936383 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9d2f2-69cd-4544-99c2-1b6e2416b42e None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:57.950234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-05d9d2f2-69cd-4544-99c2-1b6e2416b42e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 16:41:57.950234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:57.950234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:57.950234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:57.950234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:57.950234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:57.950234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:57.950234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:57.950234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:57.950234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:57.950234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:57.950234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:57.950234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:41:57.950234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:41:57.950234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:41:57.950234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:41:57.951164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:57.951164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:57.951164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:41:57.951164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:57.951164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:41:57.951164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:41:57.951164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:57.951164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:57.951164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:57.951164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:57.951164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:57.951164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:57.951164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:57.951164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:57.951164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:57.951164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:57.951164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:57.951164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:57.952148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:57.952148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:57.952148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:41:57.952148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:41:57.952148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:41:57.952148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:41:57.952148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:41:57.952148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:41:57.952148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 16:41:57.952148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:57.952148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 516/1038] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jun 22 16:41:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:57.958682 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbd8c2-c0a4-4b96-b3a0-f285ea4d61f4 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:58.062480 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbd8c2-c0a4-4b96-b3a0-f285ea4d61f4 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:58.094824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6f876-ce26-44e3-bce2-8152dfc138cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:58.095482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6f876-ce26-44e3-bce2-8152dfc138cd None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:58.095764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6f876-ce26-44e3-bce2-8152dfc138cd None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:58.096040 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6f876-ce26-44e3-bce2-8152dfc138cd None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:58.096901 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f6f876-ce26-44e3-bce2-8152dfc138cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:58.097210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f6f876-ce26-44e3-bce2-8152dfc138cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:58.099145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f6f876-ce26-44e3-bce2-8152dfc138cd None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:58.116390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 523/1039] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jun 22 16:41:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:58.121801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9d2f2-69cd-4544-99c2-1b6e2416b42e None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:58.219845 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9d2f2-69cd-4544-99c2-1b6e2416b42e None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:58.253034 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f4b43-08b5-401c-bcd1-af4c24f52d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:58.253676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f4b43-08b5-401c-bcd1-af4c24f52d7f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:58.253958 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f4b43-08b5-401c-bcd1-af4c24f52d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:58.254230 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f4b43-08b5-401c-bcd1-af4c24f52d7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:58.302485 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18332b36-88e9-4f91-80ea-5342622d8c29 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:58.302701 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18332b36-88e9-4f91-80ea-5342622d8c29 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:58.302981 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18332b36-88e9-4f91-80ea-5342622d8c29 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:58.304602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 524/1040] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:58.310252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd487a-c058-4b4d-b95f-e605f26e4bc3 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:58.310584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd487a-c058-4b4d-b95f-e605f26e4bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:58.310825 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd487a-c058-4b4d-b95f-e605f26e4bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:58.322706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:58.328732 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-efcd487a-c058-4b4d-b95f-e605f26e4bc3 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:58.329924 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-efcd487a-c058-4b4d-b95f-e605f26e4bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:58.330451 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f4b43-08b5-401c-bcd1-af4c24f52d7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:58.331892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f4b43-08b5-401c-bcd1-af4c24f52d7f None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:58.334368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:58.398708 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 525/1041] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 16:41:58.422284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd487a-c058-4b4d-b95f-e605f26e4bc3 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:58.443369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 517/1042] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:41:58 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 16:41:58.448723 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f4b43-08b5-401c-bcd1-af4c24f52d7f None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:58.528182 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd487a-c058-4b4d-b95f-e605f26e4bc3 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:58.543179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:58.549883 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f4b43-08b5-401c-bcd1-af4c24f52d7f None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:58.563009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa696f-ae57-4eae-94ff-a725e32f929a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:58.563726 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa696f-ae57-4eae-94ff-a725e32f929a None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:58.564009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa696f-ae57-4eae-94ff-a725e32f929a None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:58.564302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa696f-ae57-4eae-94ff-a725e32f929a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:58.572044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:58.575796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa696f-ae57-4eae-94ff-a725e32f929a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:41:58.583899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-5caa696f-ae57-4eae-94ff-a725e32f929a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:41:58.583899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:58.583899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:58.583899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:58.583899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:58.583899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:58.583899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:58.583899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:58.583899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:58.583899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:58.583899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:58.583899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:58.583899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:41:58.583899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:41:58.583899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:41:58.583899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:41:58.585010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:41:58.585010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:41:58.585010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:41:58.585010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:41:58.585010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:58.585010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:58.585010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:58.585010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:58.585010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:58.585010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:58.585010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:58.585010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:58.585010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:58.585010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:58.585010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:58.585010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:58.585888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:58.585888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:58.585888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:58.585888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:58.585888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:41:58.585888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:41:58.585888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:41:58.585888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:41:58.585888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:41:58.585888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:41:58.585888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:41:58.585888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:41:58.585888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 526/1043] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:41:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:58.587524 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07ce5b-9039-4707-9d55-5afc0b2ad7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:58.588333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07ce5b-9039-4707-9d55-5afc0b2ad7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:58.588616 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07ce5b-9039-4707-9d55-5afc0b2ad7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:58.588890 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07ce5b-9039-4707-9d55-5afc0b2ad7d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:58.590860 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa696f-ae57-4eae-94ff-a725e32f929a None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:58.600198 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07ce5b-9039-4707-9d55-5afc0b2ad7d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:58.601637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07ce5b-9039-4707-9d55-5afc0b2ad7d0 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:58.621385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-ac07ce5b-9039-4707-9d55-5afc0b2ad7d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:58.621385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:58.621385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:58.621385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:58.621385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:58.621385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:58.621385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:58.621385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:58.621385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:58.621385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:58.621385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:58.621385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:58.621385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:41:58.621385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:41:58.621385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:41:58.628164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:41:58.628164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:58.628164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:58.628164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:58.628164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:58.628164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:58.628164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:58.628164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:58.628164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:58.628164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:58.628164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:58.628164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:58.628164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:58.628164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:58.628164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:58.628164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:58.628164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:58.629128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:41:58.629128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:41:58.629128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:41:58.629128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:58.629128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 518/1044] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:58.629128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07ce5b-9039-4707-9d55-5afc0b2ad7d0 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:58.709830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa696f-ae57-4eae-94ff-a725e32f929a None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:58.735937 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07ce5b-9039-4707-9d55-5afc0b2ad7d0 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:58.744419 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41587424-f1cf-4554-a851-ae7533c59ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:58.745089 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41587424-f1cf-4554-a851-ae7533c59ddc None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:58.745378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41587424-f1cf-4554-a851-ae7533c59ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:58.745655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41587424-f1cf-4554-a851-ae7533c59ddc None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:58.746420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41587424-f1cf-4554-a851-ae7533c59ddc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:58.746730 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41587424-f1cf-4554-a851-ae7533c59ddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:58.748179 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41587424-f1cf-4554-a851-ae7533c59ddc None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:58.757320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 527/1045] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:41:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:58.762731 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41587424-f1cf-4554-a851-ae7533c59ddc None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:58.776712 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d14fe2-3c51-4464-87ee-3d9a7aeb1936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:58.777365 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d14fe2-3c51-4464-87ee-3d9a7aeb1936 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:58.777679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d14fe2-3c51-4464-87ee-3d9a7aeb1936 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:58.777922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d14fe2-3c51-4464-87ee-3d9a7aeb1936 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:58.778646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d14fe2-3c51-4464-87ee-3d9a7aeb1936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:58.778955 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d14fe2-3c51-4464-87ee-3d9a7aeb1936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:58.780339 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d14fe2-3c51-4464-87ee-3d9a7aeb1936 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:58.791900 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 519/1046] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:58.797235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d14fe2-3c51-4464-87ee-3d9a7aeb1936 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:58.806111 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:58.834615 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:58.877498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41587424-f1cf-4554-a851-ae7533c59ddc None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:58.898441 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d14fe2-3c51-4464-87ee-3d9a7aeb1936 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:58.913984 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb0343-5cdf-4cc4-8e0d-bf8118435450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:58.915325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb0343-5cdf-4cc4-8e0d-bf8118435450 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:58.915614 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb0343-5cdf-4cc4-8e0d-bf8118435450 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:58.915894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb0343-5cdf-4cc4-8e0d-bf8118435450 None admin] PATH_INFO: `/v3/users/414b3f660d8b4eff96927ca3a5febb02` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:58.930549 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb0343-5cdf-4cc4-8e0d-bf8118435450 None admin] RBAC: Authorizing `identity:get_user(user_id=414b3f660d8b4eff96927ca3a5febb02)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:58.931601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bbc28-4cf9-4c8d-b26b-4389d02bb70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:58.931999 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb0343-5cdf-4cc4-8e0d-bf8118435450 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:58.932420 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bbc28-4cf9-4c8d-b26b-4389d02bb70b None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:58.932699 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bbc28-4cf9-4c8d-b26b-4389d02bb70b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:58.932973 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bbc28-4cf9-4c8d-b26b-4389d02bb70b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:58.938425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 528/1047] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:41:58 2022] GET /identity/v3/users/414b3f660d8b4eff96927ca3a5febb02 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:58.939177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb0343-5cdf-4cc4-8e0d-bf8118435450 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:58.945565 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bbc28-4cf9-4c8d-b26b-4389d02bb70b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:58.947429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241bbc28-4cf9-4c8d-b26b-4389d02bb70b None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:58.962859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-241bbc28-4cf9-4c8d-b26b-4389d02bb70b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:58.962859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:58.962859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:58.962859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:58.962859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:58.962859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:58.962859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:58.962859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:58.962859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:58.962859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:58.962859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:58.962859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:58.962859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:41:58.962859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:41:58.962859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:41:58.963807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:41:58.963807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:58.963807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:58.963807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:58.963807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:58.963807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:58.963807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:58.963807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:58.963807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:58.963807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:58.963807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:58.963807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:58.963807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:58.963807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:58.963807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:58.963807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:58.963807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:58.964786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:41:58.964786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:41:58.964786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:41:58.964786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:41:58.964786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:41:58.964786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:41:58.964786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:41:58.964786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:58.964786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 520/1048] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:41:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:58.969646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bbc28-4cf9-4c8d-b26b-4389d02bb70b None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:59.042551 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:59.058474 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb0343-5cdf-4cc4-8e0d-bf8118435450 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:59.078429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241bbc28-4cf9-4c8d-b26b-4389d02bb70b None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:59.080347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:59.094006 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a9ff2-f182-43a9-bc96-3922d0843471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:59.094656 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a9ff2-f182-43a9-bc96-3922d0843471 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:59.094941 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a9ff2-f182-43a9-bc96-3922d0843471 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:59.095219 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a9ff2-f182-43a9-bc96-3922d0843471 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:59.117064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e59dc-5388-4ccd-a332-de993dd9c52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:59.117844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e59dc-5388-4ccd-a332-de993dd9c52a None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:59.118129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e59dc-5388-4ccd-a332-de993dd9c52a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:59.118406 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e59dc-5388-4ccd-a332-de993dd9c52a None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:59.119202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e59dc-5388-4ccd-a332-de993dd9c52a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:59.119512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e59dc-5388-4ccd-a332-de993dd9c52a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:59.121174 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e59dc-5388-4ccd-a332-de993dd9c52a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:59.139714 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 521/1049] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:41:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:59.140524 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e59dc-5388-4ccd-a332-de993dd9c52a None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:59.168365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a9ff2-f182-43a9-bc96-3922d0843471 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:59.169809 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a9ff2-f182-43a9-bc96-3922d0843471 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:59.246249 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e59dc-5388-4ccd-a332-de993dd9c52a None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:59.269577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 529/1050] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:41:58 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 16:41:59.271272 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58c416-c0dc-4f8f-8e52-10329a85e724 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:59.271778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58c416-c0dc-4f8f-8e52-10329a85e724 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:59.272320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58c416-c0dc-4f8f-8e52-10329a85e724 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:59.274127 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 530/1051] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:41:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:41:59.278631 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58c416-c0dc-4f8f-8e52-10329a85e724 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:59.278802 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:59.287297 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1cb71c-38ee-4aab-b441-0ee35d3a6c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:59.287944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cb71c-38ee-4aab-b441-0ee35d3a6c36 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:59.288400 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cb71c-38ee-4aab-b441-0ee35d3a6c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:59.288677 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cb71c-38ee-4aab-b441-0ee35d3a6c36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:59.289525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1cb71c-38ee-4aab-b441-0ee35d3a6c36 None admin] RBAC: Adding query filter params (role.id=4887dd0c588d4929bb553ce097a3b236, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=78e7bdfffdc84465a570d135d1d86380) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:59.289832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1cb71c-38ee-4aab-b441-0ee35d3a6c36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:59.291327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1cb71c-38ee-4aab-b441-0ee35d3a6c36 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:59.297296 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 522/1052] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:41:59 2022] GET /identity/v3/role_assignments?user.id=78e7bdfffdc84465a570d135d1d86380&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=4887dd0c588d4929bb553ce097a3b236 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:59.298499 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0b023-cfa7-4d73-9a07-d5961e3f4b8e None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:59.298869 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0b023-cfa7-4d73-9a07-d5961e3f4b8e None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:59.299148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0b023-cfa7-4d73-9a07-d5961e3f4b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:59.303316 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:59.325292 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-06f0b023-cfa7-4d73-9a07-d5961e3f4b8e None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:41:59.326791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-06f0b023-cfa7-4d73-9a07-d5961e3f4b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:41:59.397225 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58c416-c0dc-4f8f-8e52-10329a85e724 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:59.401513 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 523/1053] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:41:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:41:59.425470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0b023-cfa7-4d73-9a07-d5961e3f4b8e None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:59.443548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c8118-2012-44e0-b153-1295fb2630fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:59.444858 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c8118-2012-44e0-b153-1295fb2630fb None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:59.445437 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c8118-2012-44e0-b153-1295fb2630fb None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:59.446197 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c8118-2012-44e0-b153-1295fb2630fb None admin] PATH_INFO: `/v3/projects/eb5d2e37c00b497b94c62c44f49836ad` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:59.447481 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c8118-2012-44e0-b153-1295fb2630fb None admin] RBAC: Authorizing `identity:get_project(project_id=eb5d2e37c00b497b94c62c44f49836ad)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:59.449455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c8118-2012-44e0-b153-1295fb2630fb None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:59.451537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 531/1054] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:41:59 2022] GET /identity/v3/projects/eb5d2e37c00b497b94c62c44f49836ad => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:59.457456 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c8118-2012-44e0-b153-1295fb2630fb None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:59.533489 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0b023-cfa7-4d73-9a07-d5961e3f4b8e None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:59.552335 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:59.555423 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:41:59.564884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c8118-2012-44e0-b153-1295fb2630fb None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:59.569234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eff0ca-c2b9-4a9e-a9ec-92a261ffb73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:59.570021 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eff0ca-c2b9-4a9e-a9ec-92a261ffb73a None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:59.570305 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eff0ca-c2b9-4a9e-a9ec-92a261ffb73a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:59.570631 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eff0ca-c2b9-4a9e-a9ec-92a261ffb73a None admin] PATH_INFO: `/v3/services/image` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:59.571289 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eff0ca-c2b9-4a9e-a9ec-92a261ffb73a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:59.572696 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eff0ca-c2b9-4a9e-a9ec-92a261ffb73a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:59.584284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-33eff0ca-c2b9-4a9e-a9ec-92a261ffb73a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 16:41:59.584284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:59.584284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:41:59.584284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:41:59.584284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:41:59.584284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:41:59.584284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:41:59.584284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:59.584284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 16:41:59.584284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:59.584284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:41:59.584284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:59.584284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:41:59.584284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:41:59.584284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:41:59.584284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:41:59.584284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:41:59.587896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:41:59.587896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:41:59.587896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:41:59.587896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:41:59.587896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:41:59.587896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:41:59.587896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:41:59.587896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:41:59.587896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:41:59.587896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:41:59.587896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:41:59.587896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:41:59.587896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:41:59.587896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:41:59.587896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:41:59.587896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:41:59.589145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:41:59.589145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:41:59.589145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:41:59.589145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:41:59.589145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:41:59.589145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:41:59.589145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:41:59.589145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:41:59.589145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:41:59.589145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:41:59.589145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:41:59.589145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:41:59.589145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 22 16:41:59.589145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:41:59.589145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 524/1055] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Jun 22 16:41:59 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:41:59.591860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eff0ca-c2b9-4a9e-a9ec-92a261ffb73a None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:59.606616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9d768-62a7-4c3c-b34c-6c7263e7203d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:59.610617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9d768-62a7-4c3c-b34c-6c7263e7203d None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:59.610617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9d768-62a7-4c3c-b34c-6c7263e7203d None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:59.610617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9d768-62a7-4c3c-b34c-6c7263e7203d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:59.610617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9d768-62a7-4c3c-b34c-6c7263e7203d None admin] RBAC: Adding query filter params (role.id=459b0e5c21c94fb1b81f76c65780fdb5, scope.project.id=eb5d2e37c00b497b94c62c44f49836ad, user.id=414b3f660d8b4eff96927ca3a5febb02) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:59.610617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9d768-62a7-4c3c-b34c-6c7263e7203d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:59.610617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9d768-62a7-4c3c-b34c-6c7263e7203d None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:59.617260 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 532/1056] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:41:59 2022] GET /identity/v3/role_assignments?user.id=414b3f660d8b4eff96927ca3a5febb02&scope.project.id=eb5d2e37c00b497b94c62c44f49836ad&role.id=459b0e5c21c94fb1b81f76c65780fdb5 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:59.710899 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eff0ca-c2b9-4a9e-a9ec-92a261ffb73a None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:59.748320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01295ada-38a3-4c59-8c59-2a461318ed2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:59.748998 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01295ada-38a3-4c59-8c59-2a461318ed2a None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:59.749285 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01295ada-38a3-4c59-8c59-2a461318ed2a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:59.749564 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01295ada-38a3-4c59-8c59-2a461318ed2a None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:59.750290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01295ada-38a3-4c59-8c59-2a461318ed2a None admin] RBAC: Adding query filter params (name=image) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:59.750602 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01295ada-38a3-4c59-8c59-2a461318ed2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:59.751997 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01295ada-38a3-4c59-8c59-2a461318ed2a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:59.758490 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 525/1057] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:41:59.763714 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9d768-62a7-4c3c-b34c-6c7263e7203d None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:59.868512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9d768-62a7-4c3c-b34c-6c7263e7203d None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:41:59.902898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87951d-f67c-45bf-a791-3ab0ed701e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:41:59.903566 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87951d-f67c-45bf-a791-3ab0ed701e1d None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:41:59.903852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87951d-f67c-45bf-a791-3ab0ed701e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:41:59.904158 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87951d-f67c-45bf-a791-3ab0ed701e1d None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:41:59.904875 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87951d-f67c-45bf-a791-3ab0ed701e1d None admin] RBAC: Adding query filter params (type=image) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:41:59.905186 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87951d-f67c-45bf-a791-3ab0ed701e1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:41:59.906559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87951d-f67c-45bf-a791-3ab0ed701e1d None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:41:59.916845 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 533/1058] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:41:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:41:59.918287 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01295ada-38a3-4c59-8c59-2a461318ed2a None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:41:59.969147 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:00.026762 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01295ada-38a3-4c59-8c59-2a461318ed2a None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:00.063568 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbc19a-5ea5-46ac-9aca-c1802fe5dfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:00.063568 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbc19a-5ea5-46ac-9aca-c1802fe5dfcf None admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:00.063568 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbc19a-5ea5-46ac-9aca-c1802fe5dfcf None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:00.063568 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbc19a-5ea5-46ac-9aca-c1802fe5dfcf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:00.063976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bbc19a-5ea5-46ac-9aca-c1802fe5dfcf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:00.065432 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bbc19a-5ea5-46ac-9aca-c1802fe5dfcf None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:00.156142 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 526/1059] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jun 22 16:41:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 16:42:01.348317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4d6d8-9af0-439a-8df8-746841036953 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:01.349300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4d6d8-9af0-439a-8df8-746841036953 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:01.349564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4d6d8-9af0-439a-8df8-746841036953 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:01.350843 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 534/1060] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:42:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:42:01.356064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0f863-8d2c-4367-9a13-74f7f4036244 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:01.356461 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0f863-8d2c-4367-9a13-74f7f4036244 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:01.356674 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0f863-8d2c-4367-9a13-74f7f4036244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:01.373527 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-61b0f863-8d2c-4367-9a13-74f7f4036244 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:42:01.374716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-61b0f863-8d2c-4367-9a13-74f7f4036244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:42:01.448341 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 527/1061] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:42:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:42:01.471245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4d6d8-9af0-439a-8df8-746841036953 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:01.490821 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:01.572999 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4d6d8-9af0-439a-8df8-746841036953 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:01.607914 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69779952-3df5-4361-b56e-18e1663237ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:01.608677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69779952-3df5-4361-b56e-18e1663237ab None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:01.608969 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69779952-3df5-4361-b56e-18e1663237ab None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:01.609252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69779952-3df5-4361-b56e-18e1663237ab None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:01.619629 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69779952-3df5-4361-b56e-18e1663237ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:42:01.625179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92508f-6f94-4e39-9887-eb344eebb9cc None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:01.625474 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92508f-6f94-4e39-9887-eb344eebb9cc None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:01.625754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92508f-6f94-4e39-9887-eb344eebb9cc None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:01.627298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 528/1062] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:42:01.627918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-69779952-3df5-4361-b56e-18e1663237ab None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 16:42:01.627918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:42:01.627918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:42:01.627918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:42:01.627918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:42:01.627918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:42:01.627918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:42:01.627918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:42:01.627918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:42:01.627918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:42:01.627918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:42:01.627918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:42:01.627918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:42:01.627918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:42:01.627918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:42:01.627918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:42:01.629114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:42:01.629114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:42:01.629114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:42:01.629114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:42:01.629114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:42:01.629114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:42:01.629114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:42:01.629114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:42:01.629114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:42:01.629114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:42:01.629114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:42:01.629114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:42:01.629114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:42:01.629114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:42:01.629114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:42:01.629114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:42:01.635339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:42:01.635339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:42:01.635339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:42:01.635339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:42:01.635339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:42:01.635339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:42:01.635339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:42:01.635339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:42:01.635339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:42:01.635339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:42:01.635339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 16:42:01.635339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:42:01.635339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 535/1063] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jun 22 16:42:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:42:01.636240 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65665a-e831-4fff-90c4-8fe19e516081 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:01.636240 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65665a-e831-4fff-90c4-8fe19e516081 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:01.636240 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65665a-e831-4fff-90c4-8fe19e516081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:01.637932 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69779952-3df5-4361-b56e-18e1663237ab None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:01.652969 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-0b65665a-e831-4fff-90c4-8fe19e516081 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:42:01.654306 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0b65665a-e831-4fff-90c4-8fe19e516081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:42:01.678319 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:01.720902 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:01.724640 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 529/1064] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:42:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:42:01.743870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69779952-3df5-4361-b56e-18e1663237ab None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:01.747728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65665a-e831-4fff-90c4-8fe19e516081 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:01.787459 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2b25e-c509-4174-97ed-8d65ad38b71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:01.788534 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2b25e-c509-4174-97ed-8d65ad38b71a None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:01.789032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2b25e-c509-4174-97ed-8d65ad38b71a None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:01.789512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2b25e-c509-4174-97ed-8d65ad38b71a None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:01.790498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2b25e-c509-4174-97ed-8d65ad38b71a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:01.791013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2b25e-c509-4174-97ed-8d65ad38b71a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:01.792751 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2b25e-c509-4174-97ed-8d65ad38b71a None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:01.801273 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 536/1065] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jun 22 16:42:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:42:01.806723 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2b25e-c509-4174-97ed-8d65ad38b71a None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:01.858065 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65665a-e831-4fff-90c4-8fe19e516081 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:01.898569 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938f72c-745c-4304-85a6-190b8387efc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:01.899609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938f72c-745c-4304-85a6-190b8387efc8 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:01.899895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938f72c-745c-4304-85a6-190b8387efc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:01.900202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938f72c-745c-4304-85a6-190b8387efc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:01.910373 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938f72c-745c-4304-85a6-190b8387efc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:42:01.918046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-5938f72c-745c-4304-85a6-190b8387efc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:42:01.918046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:42:01.918046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:42:01.918046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:42:01.918046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:42:01.918046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:42:01.918046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:42:01.918046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:42:01.918046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:42:01.918046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:42:01.918046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:42:01.918046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:42:01.918046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:42:01.918046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:42:01.918046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:42:01.918046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:42:01.919077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:42:01.919077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:42:01.919077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:42:01.919077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:42:01.919077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:42:01.919077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:42:01.919077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:42:01.919077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:42:01.919077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:42:01.919077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:42:01.919077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:42:01.919077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:42:01.919077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:42:01.919077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:42:01.919077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:42:01.919077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:42:01.920632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:42:01.920632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:42:01.920632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:42:01.920632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:42:01.920632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:42:01.920632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:42:01.920632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:42:01.920632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:42:01.920632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:42:01.920632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:42:01.920632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:42:01.920632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:42:01.921307 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2b25e-c509-4174-97ed-8d65ad38b71a None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:01.921385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 530/1066] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:42:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:42:01.925202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938f72c-745c-4304-85a6-190b8387efc8 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:01.957015 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:01.962072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b21833-1ad6-47bf-ae74-c1746de04c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:01.962926 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b21833-1ad6-47bf-ae74-c1746de04c82 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:01.963236 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b21833-1ad6-47bf-ae74-c1746de04c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:01.969823 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b21833-1ad6-47bf-ae74-c1746de04c82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:01.971199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:01.974934 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b21833-1ad6-47bf-ae74-c1746de04c82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:01.976455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b21833-1ad6-47bf-ae74-c1746de04c82 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:01.993611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-86b21833-1ad6-47bf-ae74-c1746de04c82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:42:01.993611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:42:01.993611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:42:01.993611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:42:01.993611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:42:01.993611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:42:01.993611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:42:01.993611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:42:01.993611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:42:01.993611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:42:01.993611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:42:01.993611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:42:01.993611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:42:01.993611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:42:01.993611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:42:01.994884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:42:01.994884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:42:01.994884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:42:01.994884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:42:01.994884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:42:01.994884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:42:01.994884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:42:01.994884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:42:01.994884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:42:01.994884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:42:01.994884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:42:01.994884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:42:01.994884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:42:01.994884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:42:01.994884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:42:01.994884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:42:01.994884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:42:01.995954 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:42:01.995954 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:42:01.995954 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:42:01.995954 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:42:02.000030 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 537/1067] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:42:02.000885 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b21833-1ad6-47bf-ae74-c1746de04c82 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:02.045147 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938f72c-745c-4304-85a6-190b8387efc8 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:02.081890 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978bbb6-f50b-40fc-9689-371ff63973e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:02.082560 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978bbb6-f50b-40fc-9689-371ff63973e5 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:02.083381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978bbb6-f50b-40fc-9689-371ff63973e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:02.083662 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978bbb6-f50b-40fc-9689-371ff63973e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:02.084452 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978bbb6-f50b-40fc-9689-371ff63973e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:02.084762 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978bbb6-f50b-40fc-9689-371ff63973e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:02.086132 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978bbb6-f50b-40fc-9689-371ff63973e5 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:02.094944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 531/1068] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:42:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:42:02.101328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978bbb6-f50b-40fc-9689-371ff63973e5 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:02.129003 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b21833-1ad6-47bf-ae74-c1746de04c82 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:02.166128 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7b1be-6aa1-43b1-a81c-c162e4b8f296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:02.167071 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7b1be-6aa1-43b1-a81c-c162e4b8f296 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:02.167506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7b1be-6aa1-43b1-a81c-c162e4b8f296 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:02.167944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7b1be-6aa1-43b1-a81c-c162e4b8f296 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:02.168709 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7b1be-6aa1-43b1-a81c-c162e4b8f296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:02.169025 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7b1be-6aa1-43b1-a81c-c162e4b8f296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:02.170650 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7b1be-6aa1-43b1-a81c-c162e4b8f296 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:02.182307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:02.182774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 538/1069] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:02.184068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452beae-e83e-48ab-83d0-86c322cbf32a None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:02.184387 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452beae-e83e-48ab-83d0-86c322cbf32a None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:02.184669 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452beae-e83e-48ab-83d0-86c322cbf32a None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:02.185912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 539/1070] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:42:02.188924 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452beae-e83e-48ab-83d0-86c322cbf32a None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:02.203734 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978bbb6-f50b-40fc-9689-371ff63973e5 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:02.237583 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097faf2-9f8b-4853-8ad8-81ce13a2415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:02.238449 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097faf2-9f8b-4853-8ad8-81ce13a2415f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:02.238729 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097faf2-9f8b-4853-8ad8-81ce13a2415f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:02.239046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097faf2-9f8b-4853-8ad8-81ce13a2415f None admin] PATH_INFO: `/v3/users/414b3f660d8b4eff96927ca3a5febb02` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:02.240285 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097faf2-9f8b-4853-8ad8-81ce13a2415f None admin] RBAC: Authorizing `identity:get_user(user_id=414b3f660d8b4eff96927ca3a5febb02)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:02.240583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:02.241730 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097faf2-9f8b-4853-8ad8-81ce13a2415f None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:02.243366 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 532/1071] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:42:02 2022] GET /identity/v3/users/414b3f660d8b4eff96927ca3a5febb02 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:42:02.244602 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70738621-9bfd-4a3c-9dce-8b79c6bd09dc None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:02.244909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70738621-9bfd-4a3c-9dce-8b79c6bd09dc None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:02.245179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70738621-9bfd-4a3c-9dce-8b79c6bd09dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:02.261522 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-70738621-9bfd-4a3c-9dce-8b79c6bd09dc None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:42:02.263155 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-70738621-9bfd-4a3c-9dce-8b79c6bd09dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:42:02.291298 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452beae-e83e-48ab-83d0-86c322cbf32a None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:02.324278 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac11e9-c030-46fe-b3d1-c68b0d20f1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:02.325061 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac11e9-c030-46fe-b3d1-c68b0d20f1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:02.325357 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac11e9-c030-46fe-b3d1-c68b0d20f1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:02.325637 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac11e9-c030-46fe-b3d1-c68b0d20f1a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:02.328957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 533/1072] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:42:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:42:02.329768 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70738621-9bfd-4a3c-9dce-8b79c6bd09dc None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:02.333273 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac11e9-c030-46fe-b3d1-c68b0d20f1a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:02.334719 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac11e9-c030-46fe-b3d1-c68b0d20f1a6 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:02.349653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-05ac11e9-c030-46fe-b3d1-c68b0d20f1a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 16:42:02.349653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:42:02.349653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:42:02.349653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:42:02.349653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:42:02.349653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:42:02.349653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:42:02.349653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:42:02.349653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:42:02.349653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:42:02.349653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:42:02.349653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:42:02.349653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:42:02.349653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:42:02.349653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:42:02.349653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:42:02.351185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:42:02.351185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:42:02.351185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:42:02.351185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:42:02.351185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:42:02.351185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:42:02.351185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:42:02.351185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:42:02.351185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:42:02.351185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:42:02.351185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:42:02.351185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:42:02.351185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:42:02.351185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:42:02.351185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:42:02.351185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:42:02.351185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:42:02.351185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:42:02.352530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:42:02.352530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:42:02.352530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:42:02.352530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:42:02.352530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:42:02.352530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:42:02.352530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:42:02.352530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:42:02.352530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 16:42:02.352530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:42:02.352530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 540/1073] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jun 22 16:42:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:42:02.356155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac11e9-c030-46fe-b3d1-c68b0d20f1a6 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:02.409912 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:02.428498 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70738621-9bfd-4a3c-9dce-8b79c6bd09dc None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:02.455378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac11e9-c030-46fe-b3d1-c68b0d20f1a6 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:02.462813 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769015b2-133b-4fc5-b0cd-2d15d0b95b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:02.463666 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769015b2-133b-4fc5-b0cd-2d15d0b95b2a None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:02.463947 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769015b2-133b-4fc5-b0cd-2d15d0b95b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:02.464257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769015b2-133b-4fc5-b0cd-2d15d0b95b2a None admin] PATH_INFO: `/v3/projects/eb5d2e37c00b497b94c62c44f49836ad` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:02.465430 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769015b2-133b-4fc5-b0cd-2d15d0b95b2a None admin] RBAC: Authorizing `identity:get_project(project_id=eb5d2e37c00b497b94c62c44f49836ad)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:02.466862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769015b2-133b-4fc5-b0cd-2d15d0b95b2a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:02.466996 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:02.468619 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 534/1074] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:42:02 2022] GET /identity/v3/projects/eb5d2e37c00b497b94c62c44f49836ad => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:02.469379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769015b2-133b-4fc5-b0cd-2d15d0b95b2a None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:02.489748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb104b7-03e3-4c78-adf3-26f5cc521bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:02.490398 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb104b7-03e3-4c78-adf3-26f5cc521bef None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:02.490687 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb104b7-03e3-4c78-adf3-26f5cc521bef None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:02.491066 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb104b7-03e3-4c78-adf3-26f5cc521bef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:02.557306 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb104b7-03e3-4c78-adf3-26f5cc521bef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:02.558768 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb104b7-03e3-4c78-adf3-26f5cc521bef None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:02.571386 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769015b2-133b-4fc5-b0cd-2d15d0b95b2a None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:02.605195 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6621d42-f727-4e73-bf27-db5bd1f89e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:02.605859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6621d42-f727-4e73-bf27-db5bd1f89e6e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:02.606146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6621d42-f727-4e73-bf27-db5bd1f89e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:02.606423 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6621d42-f727-4e73-bf27-db5bd1f89e6e None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:02.607264 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6621d42-f727-4e73-bf27-db5bd1f89e6e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:02.607573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6621d42-f727-4e73-bf27-db5bd1f89e6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:02.609026 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6621d42-f727-4e73-bf27-db5bd1f89e6e None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:02.625991 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 535/1075] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jun 22 16:42:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:02.627848 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6621d42-f727-4e73-bf27-db5bd1f89e6e None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:02.636440 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:02.656155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 541/1076] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:42:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 16:42:02.656984 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb104b7-03e3-4c78-adf3-26f5cc521bef None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:02.669448 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:02.724854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6621d42-f727-4e73-bf27-db5bd1f89e6e None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:02.755542 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb104b7-03e3-4c78-adf3-26f5cc521bef None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:02.759085 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c867e1-7cad-47af-b084-ee31eb755d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:02.759965 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c867e1-7cad-47af-b084-ee31eb755d6a None admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:02.760287 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c867e1-7cad-47af-b084-ee31eb755d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:02.760568 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c867e1-7cad-47af-b084-ee31eb755d6a None admin] PATH_INFO: `/v3/projects/eb5d2e37c00b497b94c62c44f49836ad/users/414b3f660d8b4eff96927ca3a5febb02/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:02.762799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c867e1-7cad-47af-b084-ee31eb755d6a None admin] RBAC: Authorizing `identity:create_grant(project_id=eb5d2e37c00b497b94c62c44f49836ad, user_id=414b3f660d8b4eff96927ca3a5febb02, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:02.764252 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c867e1-7cad-47af-b084-ee31eb755d6a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:02.787955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeadf30-77fd-465c-bff2-7498d7d3596d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:02.788757 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeadf30-77fd-465c-bff2-7498d7d3596d None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:02.789040 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeadf30-77fd-465c-bff2-7498d7d3596d None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:02.789321 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeadf30-77fd-465c-bff2-7498d7d3596d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:02.803274 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeadf30-77fd-465c-bff2-7498d7d3596d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:02.804792 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeadf30-77fd-465c-bff2-7498d7d3596d None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:02.822067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-2eeadf30-77fd-465c-bff2-7498d7d3596d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:42:02.822067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:42:02.822067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:42:02.822067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:42:02.822067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:42:02.822067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:42:02.822067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:42:02.822067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:42:02.822067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:42:02.822067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:42:02.822067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:42:02.822067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:42:02.822067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:42:02.822067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:42:02.822067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:42:02.823144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:42:02.823144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:42:02.823144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:42:02.823144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:42:02.823144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:42:02.823144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:42:02.823144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:42:02.823144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:42:02.823144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:42:02.823144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:42:02.823144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:42:02.823144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:42:02.823144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:42:02.823144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:42:02.823144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:42:02.823144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:42:02.823144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:42:02.824095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:42:02.824095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:42:02.824095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:42:02.824095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:42:02.824095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 542/1077] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:42:02.824095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeadf30-77fd-465c-bff2-7498d7d3596d None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:02.840018 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 536/1078] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:42:02 2022] PUT /identity/v3/projects/eb5d2e37c00b497b94c62c44f49836ad/users/414b3f660d8b4eff96927ca3a5febb02/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:42:02.840986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c867e1-7cad-47af-b084-ee31eb755d6a None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:02.898628 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:02.912995 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:02.943929 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeadf30-77fd-465c-bff2-7498d7d3596d None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:02.950783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c867e1-7cad-47af-b084-ee31eb755d6a None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:02.983166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e0fa2-2a2e-40ec-bc84-007d74d955c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:02.983956 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e0fa2-2a2e-40ec-bc84-007d74d955c0 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:02.984268 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e0fa2-2a2e-40ec-bc84-007d74d955c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:02.984544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e0fa2-2a2e-40ec-bc84-007d74d955c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:02.988034 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e10641-240e-456f-8a4d-3ba4a921f257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:02.989396 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e10641-240e-456f-8a4d-3ba4a921f257 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:02.989396 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e10641-240e-456f-8a4d-3ba4a921f257 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:02.989584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e10641-240e-456f-8a4d-3ba4a921f257 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:02.990306 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e10641-240e-456f-8a4d-3ba4a921f257 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:02.991024 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e10641-240e-456f-8a4d-3ba4a921f257 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:02.992644 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e10641-240e-456f-8a4d-3ba4a921f257 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:03.000993 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e0fa2-2a2e-40ec-bc84-007d74d955c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:03.002554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e0fa2-2a2e-40ec-bc84-007d74d955c0 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:03.011197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 537/1079] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:03.017152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e10641-240e-456f-8a4d-3ba4a921f257 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:03.022754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-cd6e0fa2-2a2e-40ec-bc84-007d74d955c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:42:03.022754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:42:03.022754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:42:03.022754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:42:03.022754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:42:03.022754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:42:03.022754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:42:03.022754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:42:03.022754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:42:03.022754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:42:03.022754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:42:03.022754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:42:03.022754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:42:03.022754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:42:03.022754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:42:03.023684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:42:03.023684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:42:03.023684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:42:03.023684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:42:03.023684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:42:03.023684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:42:03.023684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:42:03.023684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:42:03.023684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:42:03.023684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:42:03.023684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:42:03.023684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:42:03.023684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:42:03.023684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:42:03.023684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:42:03.023684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:42:03.023684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:42:03.025261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:42:03.025261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:42:03.025261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:42:03.025261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:42:03.025261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 543/1080] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:42:03.029602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e0fa2-2a2e-40ec-bc84-007d74d955c0 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:03.127394 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e10641-240e-456f-8a4d-3ba4a921f257 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:03.136046 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e0fa2-2a2e-40ec-bc84-007d74d955c0 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:03.151065 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:03.160497 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:03.170277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ea46c-1d91-4f3f-b64d-1355c9ee7d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:03.171272 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ea46c-1d91-4f3f-b64d-1355c9ee7d74 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:03.171701 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ea46c-1d91-4f3f-b64d-1355c9ee7d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:03.171816 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bae82-b120-4893-a567-69b49a5b6d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:03.172260 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ea46c-1d91-4f3f-b64d-1355c9ee7d74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:03.172432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bae82-b120-4893-a567-69b49a5b6d84 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:03.172718 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bae82-b120-4893-a567-69b49a5b6d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:03.172996 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bae82-b120-4893-a567-69b49a5b6d84 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:03.173761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bae82-b120-4893-a567-69b49a5b6d84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:03.174068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bae82-b120-4893-a567-69b49a5b6d84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:03.175426 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bae82-b120-4893-a567-69b49a5b6d84 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:03.181020 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ea46c-1d91-4f3f-b64d-1355c9ee7d74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:03.182636 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ea46c-1d91-4f3f-b64d-1355c9ee7d74 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:03.188360 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 544/1081] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:42:03.197627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-934ea46c-1d91-4f3f-b64d-1355c9ee7d74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:42:03.197627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:42:03.197627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:42:03.197627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:42:03.197627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:42:03.197627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:42:03.197627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:42:03.197627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:42:03.197627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:42:03.197627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:42:03.197627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:42:03.197627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:42:03.197627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:42:03.197627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:42:03.197627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:42:03.198668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:42:03.198668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:42:03.198668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:42:03.198668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:42:03.198668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:42:03.198668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:42:03.198668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:42:03.198668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:42:03.198668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:42:03.198668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:42:03.198668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:42:03.198668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:42:03.198668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:42:03.198668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:42:03.198668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:42:03.198668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:42:03.198668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:42:03.199585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:42:03.199585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:42:03.199585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:42:03.199585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:42:03.199585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:42:03.199585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:42:03.199585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:42:03.199585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:42:03.200345 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 538/1082] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:42:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:42:03.205605 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bae82-b120-4893-a567-69b49a5b6d84 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:03.323369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bae82-b120-4893-a567-69b49a5b6d84 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:03.369923 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3af16c-3d82-4680-aeb7-af0aab48900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:03.370573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3af16c-3d82-4680-aeb7-af0aab48900b None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:03.370860 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3af16c-3d82-4680-aeb7-af0aab48900b None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:03.371146 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3af16c-3d82-4680-aeb7-af0aab48900b None admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:03.371942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3af16c-3d82-4680-aeb7-af0aab48900b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:03.372294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3af16c-3d82-4680-aeb7-af0aab48900b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:03.373746 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3af16c-3d82-4680-aeb7-af0aab48900b None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:03.388444 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 545/1083] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:42:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:03.394524 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ea46c-1d91-4f3f-b64d-1355c9ee7d74 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:03.501352 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ea46c-1d91-4f3f-b64d-1355c9ee7d74 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:03.535422 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74390f6-a895-4923-9af3-fea63c562800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:03.536346 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74390f6-a895-4923-9af3-fea63c562800 None admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:03.536624 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74390f6-a895-4923-9af3-fea63c562800 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:03.536895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74390f6-a895-4923-9af3-fea63c562800 None admin] PATH_INFO: `/v3/projects/59d78923fdef459abaf240bd0975494a/users/78e7bdfffdc84465a570d135d1d86380/roles/4887dd0c588d4929bb553ce097a3b236` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:03.539041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74390f6-a895-4923-9af3-fea63c562800 None admin] RBAC: Authorizing `identity:create_grant(project_id=59d78923fdef459abaf240bd0975494a, user_id=78e7bdfffdc84465a570d135d1d86380, role_id=4887dd0c588d4929bb553ce097a3b236)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:03.540489 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74390f6-a895-4923-9af3-fea63c562800 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:03.605953 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 539/1084] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:42:03 2022] PUT /identity/v3/projects/59d78923fdef459abaf240bd0975494a/users/78e7bdfffdc84465a570d135d1d86380/roles/4887dd0c588d4929bb553ce097a3b236 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:42:04.884869 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ecf61-eb0b-4a4d-b762-2248124c9936 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:04.885428 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ecf61-eb0b-4a4d-b762-2248124c9936 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:04.885428 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ecf61-eb0b-4a4d-b762-2248124c9936 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:04.886800 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 546/1085] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:42:04.892398 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039d329-0af7-4924-99dd-b995e4aa5711 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:04.892792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039d329-0af7-4924-99dd-b995e4aa5711 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:04.892964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039d329-0af7-4924-99dd-b995e4aa5711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:04.910453 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-a039d329-0af7-4924-99dd-b995e4aa5711 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:42:04.911651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-a039d329-0af7-4924-99dd-b995e4aa5711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:42:04.951967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:04.975870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 540/1086] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:42:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:42:04.999555 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ecf61-eb0b-4a4d-b762-2248124c9936 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:05.037239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:05.101086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ecf61-eb0b-4a4d-b762-2248124c9936 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:05.142542 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bbf1d-b660-4d48-92a6-5220115fe1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:05.142542 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bbf1d-b660-4d48-92a6-5220115fe1dc None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:05.142542 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bbf1d-b660-4d48-92a6-5220115fe1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:05.142542 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bbf1d-b660-4d48-92a6-5220115fe1dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:05.147064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bbf1d-b660-4d48-92a6-5220115fe1dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:42:05.154654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-d94bbf1d-b660-4d48-92a6-5220115fe1dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:42:05.154654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:42:05.154654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:42:05.154654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:42:05.154654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:42:05.154654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:42:05.154654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:42:05.154654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:42:05.154654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:42:05.154654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:42:05.154654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:42:05.154654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:42:05.154654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:42:05.154654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:42:05.154654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:42:05.154654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:42:05.155791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:42:05.155791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:42:05.155791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:42:05.155791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:42:05.155791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:42:05.155791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:42:05.155791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:42:05.155791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:42:05.155791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:42:05.155791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:42:05.155791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:42:05.155791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:42:05.155791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:42:05.155791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:42:05.155791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:42:05.155791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:42:05.156958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:42:05.156958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:42:05.156958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:42:05.156958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:42:05.156958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:42:05.156958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:42:05.156958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:42:05.156958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:42:05.156958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:42:05.156958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:42:05.156958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:42:05.156958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:42:05.160265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 547/1087] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:42:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:42:05.161769 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039d329-0af7-4924-99dd-b995e4aa5711 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:05.258219 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039d329-0af7-4924-99dd-b995e4aa5711 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:05.290412 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40683016-b9a4-4167-8fd7-17eb6fdddf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:05.291068 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40683016-b9a4-4167-8fd7-17eb6fdddf1b None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:05.291348 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40683016-b9a4-4167-8fd7-17eb6fdddf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:05.291618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40683016-b9a4-4167-8fd7-17eb6fdddf1b None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:05.292390 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40683016-b9a4-4167-8fd7-17eb6fdddf1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:05.292695 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40683016-b9a4-4167-8fd7-17eb6fdddf1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:05.294048 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40683016-b9a4-4167-8fd7-17eb6fdddf1b None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:05.302738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 541/1088] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:42:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:05.308242 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bbf1d-b660-4d48-92a6-5220115fe1dc None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:05.401245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:05.407701 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bbf1d-b660-4d48-92a6-5220115fe1dc None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:05.440292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb630289-b32c-48bd-86ad-cfe20d4311ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:05.441519 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb630289-b32c-48bd-86ad-cfe20d4311ad None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:05.441803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb630289-b32c-48bd-86ad-cfe20d4311ad None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:05.442142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb630289-b32c-48bd-86ad-cfe20d4311ad None admin] PATH_INFO: `/v3/users/414b3f660d8b4eff96927ca3a5febb02` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:05.443318 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb630289-b32c-48bd-86ad-cfe20d4311ad None admin] RBAC: Authorizing `identity:get_user(user_id=414b3f660d8b4eff96927ca3a5febb02)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:05.444780 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb630289-b32c-48bd-86ad-cfe20d4311ad None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:05.446390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 548/1089] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:42:05 2022] GET /identity/v3/users/414b3f660d8b4eff96927ca3a5febb02 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:05.452062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40683016-b9a4-4167-8fd7-17eb6fdddf1b None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:05.491161 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:05.549653 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40683016-b9a4-4167-8fd7-17eb6fdddf1b None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:05.582235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e8965-c5e8-4c4a-9df7-7ac40753b75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:05.582902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e8965-c5e8-4c4a-9df7-7ac40753b75a None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:05.583187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e8965-c5e8-4c4a-9df7-7ac40753b75a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:05.583465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e8965-c5e8-4c4a-9df7-7ac40753b75a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:05.617720 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a9a28-35a8-44b9-a81f-35a3e384c165 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:05.618004 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a9a28-35a8-44b9-a81f-35a3e384c165 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:05.618282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a9a28-35a8-44b9-a81f-35a3e384c165 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:05.619652 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 549/1090] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:42:05.624576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f37f71-79d4-4f2b-93be-fd4117a895bf None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:05.625263 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f37f71-79d4-4f2b-93be-fd4117a895bf None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:05.625643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f37f71-79d4-4f2b-93be-fd4117a895bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:05.642400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-c8f37f71-79d4-4f2b-93be-fd4117a895bf None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:42:05.643587 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c8f37f71-79d4-4f2b-93be-fd4117a895bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:42:05.650584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e8965-c5e8-4c4a-9df7-7ac40753b75a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:05.652065 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e8965-c5e8-4c4a-9df7-7ac40753b75a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:05.690335 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:05.708674 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 550/1091] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:42:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 16:42:05.732721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f37f71-79d4-4f2b-93be-fd4117a895bf None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:05.754802 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 542/1092] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:42:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 22 16:42:05.755817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e8965-c5e8-4c4a-9df7-7ac40753b75a None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:05.819769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:05.828332 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f37f71-79d4-4f2b-93be-fd4117a895bf None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:05.852057 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e8965-c5e8-4c4a-9df7-7ac40753b75a None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:05.861761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27489f6b-134f-41eb-9488-37646f7717ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:05.863064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27489f6b-134f-41eb-9488-37646f7717ba None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:05.863366 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27489f6b-134f-41eb-9488-37646f7717ba None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:05.863868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27489f6b-134f-41eb-9488-37646f7717ba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:05.874403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27489f6b-134f-41eb-9488-37646f7717ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:42:05.882616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-27489f6b-134f-41eb-9488-37646f7717ba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 16:42:05.882616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:42:05.882616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:42:05.882616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:42:05.882616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:42:05.882616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:42:05.882616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:42:05.882616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:42:05.882616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:42:05.882616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:42:05.882616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:42:05.882616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:42:05.882616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:42:05.882616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:42:05.882616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:42:05.882616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:42:05.883602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:42:05.883602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:42:05.883602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:42:05.883602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:42:05.883602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:42:05.883602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:42:05.883602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:42:05.883602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:42:05.883602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:42:05.883602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:42:05.883602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:42:05.883602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:42:05.883602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:42:05.883602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:42:05.883602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:42:05.883602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:42:05.884502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:42:05.884502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:42:05.884502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:42:05.884502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:42:05.884502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:42:05.884502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:42:05.884502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:42:05.884502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:42:05.884502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:42:05.884502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:42:05.884502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 22 16:42:05.884502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:42:05.884502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 551/1093] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jun 22 16:42:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:42:05.890359 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987cff8-96a1-4f5b-b2c7-26e23abc371b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:05.890787 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27489f6b-134f-41eb-9488-37646f7717ba None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:05.891220 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987cff8-96a1-4f5b-b2c7-26e23abc371b None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:05.891507 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987cff8-96a1-4f5b-b2c7-26e23abc371b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:05.891783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987cff8-96a1-4f5b-b2c7-26e23abc371b None admin] PATH_INFO: `/v3/projects/eb5d2e37c00b497b94c62c44f49836ad` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:05.892999 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987cff8-96a1-4f5b-b2c7-26e23abc371b None admin] RBAC: Authorizing `identity:get_project(project_id=eb5d2e37c00b497b94c62c44f49836ad)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:05.894437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987cff8-96a1-4f5b-b2c7-26e23abc371b None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:05.896705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 543/1094] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:42:05 2022] GET /identity/v3/projects/eb5d2e37c00b497b94c62c44f49836ad => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:05.902467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987cff8-96a1-4f5b-b2c7-26e23abc371b None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:05.911704 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:05.992441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27489f6b-134f-41eb-9488-37646f7717ba None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:06.001024 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987cff8-96a1-4f5b-b2c7-26e23abc371b None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:06.026481 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e15388-276c-416e-85b9-d7ac71a7df72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:06.027155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e15388-276c-416e-85b9-d7ac71a7df72 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:06.027448 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e15388-276c-416e-85b9-d7ac71a7df72 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:06.027730 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e15388-276c-416e-85b9-d7ac71a7df72 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:06.028527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e15388-276c-416e-85b9-d7ac71a7df72 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:06.028835 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e15388-276c-416e-85b9-d7ac71a7df72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:06.030218 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e15388-276c-416e-85b9-d7ac71a7df72 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:06.037159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89feae87-7031-4f04-92e0-613cd96c9982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:06.037805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89feae87-7031-4f04-92e0-613cd96c9982 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:06.038087 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89feae87-7031-4f04-92e0-613cd96c9982 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:06.038360 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89feae87-7031-4f04-92e0-613cd96c9982 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:06.038689 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 552/1095] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jun 22 16:42:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:42:06.039194 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89feae87-7031-4f04-92e0-613cd96c9982 None admin] RBAC: Adding query filter params (role.id=459b0e5c21c94fb1b81f76c65780fdb5, scope.project.id=eb5d2e37c00b497b94c62c44f49836ad, user.id=414b3f660d8b4eff96927ca3a5febb02) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:06.039507 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89feae87-7031-4f04-92e0-613cd96c9982 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:06.040964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89feae87-7031-4f04-92e0-613cd96c9982 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:06.044074 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e15388-276c-416e-85b9-d7ac71a7df72 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:06.047062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 544/1096] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:42:05 2022] GET /identity/v3/role_assignments?user.id=414b3f660d8b4eff96927ca3a5febb02&scope.project.id=eb5d2e37c00b497b94c62c44f49836ad&role.id=459b0e5c21c94fb1b81f76c65780fdb5 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:42:06.063095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:06.152021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e15388-276c-416e-85b9-d7ac71a7df72 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:06.186756 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7639cf3-57ac-452a-86ed-e17444cad3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:06.188122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7639cf3-57ac-452a-86ed-e17444cad3fa None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:06.188409 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7639cf3-57ac-452a-86ed-e17444cad3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:06.188684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7639cf3-57ac-452a-86ed-e17444cad3fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:06.200573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7639cf3-57ac-452a-86ed-e17444cad3fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:06.201351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7639cf3-57ac-452a-86ed-e17444cad3fa None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:06.218548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-b7639cf3-57ac-452a-86ed-e17444cad3fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:42:06.218548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:42:06.218548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:42:06.218548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:42:06.218548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:42:06.218548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:42:06.218548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:42:06.218548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:42:06.218548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:42:06.218548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:42:06.218548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:42:06.218548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:42:06.218548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:42:06.218548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:42:06.218548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:42:06.219659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:42:06.219659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:42:06.219659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:42:06.219659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:42:06.219659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:42:06.219659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:42:06.219659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:42:06.219659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:42:06.219659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:42:06.219659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:42:06.219659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:42:06.219659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:42:06.219659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:42:06.219659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:42:06.219659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:42:06.219659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:42:06.219659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:42:06.220709 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:42:06.220709 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:42:06.220709 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:42:06.220709 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:42:06.220709 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 553/1097] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:42:06.225556 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89feae87-7031-4f04-92e0-613cd96c9982 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:06.293789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:06.322836 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89feae87-7031-4f04-92e0-613cd96c9982 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:06.356748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93b43d-610e-4dcb-8df2-2fbc7a7ddedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:06.357402 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93b43d-610e-4dcb-8df2-2fbc7a7ddedc None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:06.357688 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93b43d-610e-4dcb-8df2-2fbc7a7ddedc None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:06.357965 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93b43d-610e-4dcb-8df2-2fbc7a7ddedc None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:06.358686 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93b43d-610e-4dcb-8df2-2fbc7a7ddedc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:06.358994 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93b43d-610e-4dcb-8df2-2fbc7a7ddedc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:06.360380 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93b43d-610e-4dcb-8df2-2fbc7a7ddedc None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:06.371334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 545/1098] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:06.376877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7639cf3-57ac-452a-86ed-e17444cad3fa None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:06.441357 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:06.476492 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7639cf3-57ac-452a-86ed-e17444cad3fa None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:06.509525 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b08f4-971a-40c5-a24c-f4d2d1f63355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:06.510309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b08f4-971a-40c5-a24c-f4d2d1f63355 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:06.510599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b08f4-971a-40c5-a24c-f4d2d1f63355 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:06.510881 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b08f4-971a-40c5-a24c-f4d2d1f63355 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:06.518592 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b08f4-971a-40c5-a24c-f4d2d1f63355 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:06.520656 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b08f4-971a-40c5-a24c-f4d2d1f63355 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:06.534443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-125b08f4-971a-40c5-a24c-f4d2d1f63355 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 22 16:42:06.534443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:42:06.534443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:42:06.534443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:42:06.534443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:42:06.534443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:42:06.534443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:42:06.534443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:42:06.534443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:42:06.534443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:42:06.534443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:42:06.534443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:42:06.534443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:42:06.534443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:42:06.534443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:42:06.534443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:42:06.535577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:42:06.535577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:42:06.535577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:42:06.535577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:42:06.535577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:42:06.535577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:42:06.535577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:42:06.535577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:42:06.535577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:42:06.535577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:42:06.535577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:42:06.535577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:42:06.535577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:42:06.535577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:42:06.535577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:42:06.535577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:42:06.535577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:42:06.535577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:42:06.536655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:42:06.536655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:42:06.536655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:42:06.536655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:42:06.536655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:42:06.536655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:42:06.536655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:42:06.536655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:42:06.536655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 22 16:42:06.536655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:42:06.536655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 554/1099] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jun 22 16:42:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:42:06.541413 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93b43d-610e-4dcb-8df2-2fbc7a7ddedc None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:06.641161 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93b43d-610e-4dcb-8df2-2fbc7a7ddedc None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:06.668160 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:06.674095 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0368d94-10c0-4e5a-8d15-38cf74ed806e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:06.674758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0368d94-10c0-4e5a-8d15-38cf74ed806e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:06.675040 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0368d94-10c0-4e5a-8d15-38cf74ed806e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:06.675314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0368d94-10c0-4e5a-8d15-38cf74ed806e None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:06.676883 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0368d94-10c0-4e5a-8d15-38cf74ed806e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:06.677201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0368d94-10c0-4e5a-8d15-38cf74ed806e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:06.679206 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0368d94-10c0-4e5a-8d15-38cf74ed806e None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:06.696072 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 546/1100] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jun 22 16:42:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:42:06.701443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b08f4-971a-40c5-a24c-f4d2d1f63355 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:06.797395 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b08f4-971a-40c5-a24c-f4d2d1f63355 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:06.822436 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:06.830980 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca544f-bc61-4e5c-9e2c-00265efecf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:06.831631 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca544f-bc61-4e5c-9e2c-00265efecf4b None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:06.831919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca544f-bc61-4e5c-9e2c-00265efecf4b None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:06.832232 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca544f-bc61-4e5c-9e2c-00265efecf4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:06.897129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca544f-bc61-4e5c-9e2c-00265efecf4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:06.898562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca544f-bc61-4e5c-9e2c-00265efecf4b None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:06.992524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 555/1101] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:42:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 16:42:06.998122 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0368d94-10c0-4e5a-8d15-38cf74ed806e None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:07.099488 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0368d94-10c0-4e5a-8d15-38cf74ed806e None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:07.132690 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f90008-8f2c-4715-91c2-be5b2f2d4346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:07.133470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f90008-8f2c-4715-91c2-be5b2f2d4346 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:07.133755 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f90008-8f2c-4715-91c2-be5b2f2d4346 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:07.134040 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f90008-8f2c-4715-91c2-be5b2f2d4346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:07.144699 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f90008-8f2c-4715-91c2-be5b2f2d4346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:07.146168 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f90008-8f2c-4715-91c2-be5b2f2d4346 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:07.163758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-38f90008-8f2c-4715-91c2-be5b2f2d4346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:42:07.163758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:42:07.163758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:42:07.163758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:42:07.163758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:42:07.163758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:42:07.163758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:42:07.163758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:42:07.163758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:42:07.163758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:42:07.163758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:42:07.163758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:42:07.163758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:42:07.163758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:42:07.163758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:42:07.164834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:42:07.164834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:42:07.164834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:42:07.164834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:42:07.164834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:42:07.164834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:42:07.164834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:42:07.164834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:42:07.164834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:42:07.164834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:42:07.164834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:42:07.164834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:42:07.164834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:42:07.164834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:42:07.164834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:42:07.164834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:42:07.164834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:42:07.165744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:42:07.165744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:42:07.165744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:42:07.165744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:42:07.165744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 547/1102] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:42:07.171066 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca544f-bc61-4e5c-9e2c-00265efecf4b None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:07.197919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:07.267746 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca544f-bc61-4e5c-9e2c-00265efecf4b None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:07.300023 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3f71e-efd8-4e3b-9905-f6cbbec7d5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:07.300698 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3f71e-efd8-4e3b-9905-f6cbbec7d5ed None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:07.300981 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3f71e-efd8-4e3b-9905-f6cbbec7d5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:07.301280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3f71e-efd8-4e3b-9905-f6cbbec7d5ed None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:07.301994 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3f71e-efd8-4e3b-9905-f6cbbec7d5ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:07.302298 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3f71e-efd8-4e3b-9905-f6cbbec7d5ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:07.303649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3f71e-efd8-4e3b-9905-f6cbbec7d5ed None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:07.314256 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 556/1103] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:07.319933 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f90008-8f2c-4715-91c2-be5b2f2d4346 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:07.361333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:07.420702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f90008-8f2c-4715-91c2-be5b2f2d4346 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:07.453962 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503830e-13c3-424b-ad23-c36600483038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:07.454744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503830e-13c3-424b-ad23-c36600483038 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:07.455033 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503830e-13c3-424b-ad23-c36600483038 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:07.455313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503830e-13c3-424b-ad23-c36600483038 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:07.465033 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503830e-13c3-424b-ad23-c36600483038 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:07.466463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503830e-13c3-424b-ad23-c36600483038 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:07.479851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-7503830e-13c3-424b-ad23-c36600483038 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:42:07.479851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:42:07.479851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:42:07.479851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:42:07.479851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:42:07.479851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:42:07.479851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:42:07.479851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:42:07.479851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:42:07.479851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:42:07.479851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:42:07.479851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:42:07.479851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:42:07.479851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:42:07.479851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:42:07.480964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:42:07.480964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:42:07.480964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:42:07.480964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:42:07.480964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:42:07.480964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:42:07.480964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:42:07.480964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:42:07.480964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:42:07.480964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:42:07.480964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:42:07.480964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:42:07.480964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:42:07.480964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:42:07.480964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:42:07.480964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:42:07.480964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:42:07.482046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:42:07.482046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:42:07.482046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:42:07.482046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:42:07.482046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:42:07.482046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:42:07.482046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:42:07.482046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:42:07.482046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 548/1104] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:42:07.486783 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3f71e-efd8-4e3b-9905-f6cbbec7d5ed None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:07.569745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:07.584091 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3f71e-efd8-4e3b-9905-f6cbbec7d5ed None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:07.617771 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d90a1f-fdd2-4b1c-be35-9d0bca7e872c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:07.618423 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d90a1f-fdd2-4b1c-be35-9d0bca7e872c None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:07.618710 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d90a1f-fdd2-4b1c-be35-9d0bca7e872c None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:07.618987 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d90a1f-fdd2-4b1c-be35-9d0bca7e872c None admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:07.619773 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d90a1f-fdd2-4b1c-be35-9d0bca7e872c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:07.620084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d90a1f-fdd2-4b1c-be35-9d0bca7e872c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:07.621626 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d90a1f-fdd2-4b1c-be35-9d0bca7e872c None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:07.634179 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 557/1105] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:42:07.640568 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503830e-13c3-424b-ad23-c36600483038 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:07.735022 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:07.738084 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503830e-13c3-424b-ad23-c36600483038 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:07.772534 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280c44a-3f2c-40e2-81df-d6851f3a06a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:07.773181 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280c44a-3f2c-40e2-81df-d6851f3a06a9 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:07.773463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280c44a-3f2c-40e2-81df-d6851f3a06a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:07.773737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280c44a-3f2c-40e2-81df-d6851f3a06a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:07.774561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280c44a-3f2c-40e2-81df-d6851f3a06a9 None admin] RBAC: Adding query filter params (role.id=4887dd0c588d4929bb553ce097a3b236, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=78e7bdfffdc84465a570d135d1d86380) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:07.774867 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280c44a-3f2c-40e2-81df-d6851f3a06a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:07.776314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280c44a-3f2c-40e2-81df-d6851f3a06a9 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:07.782116 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 549/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:42:07 2022] GET /identity/v3/role_assignments?user.id=78e7bdfffdc84465a570d135d1d86380&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=4887dd0c588d4929bb553ce097a3b236 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:08.109623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c00aa-8910-4dd2-8a0e-96e8b4bd93d8 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:08.110157 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c00aa-8910-4dd2-8a0e-96e8b4bd93d8 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:08.110262 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c00aa-8910-4dd2-8a0e-96e8b4bd93d8 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:08.111567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 558/1107] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:42:08.116982 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746bdf3-8634-493c-bf77-2c519cb8c32c None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:08.117395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746bdf3-8634-493c-bf77-2c519cb8c32c None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:08.117598 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746bdf3-8634-493c-bf77-2c519cb8c32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:08.134434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-b746bdf3-8634-493c-bf77-2c519cb8c32c None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:42:08.135627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b746bdf3-8634-493c-bf77-2c519cb8c32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:42:08.204481 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 550/1108] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:42:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:42:08.230522 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c00aa-8910-4dd2-8a0e-96e8b4bd93d8 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:08.331866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c00aa-8910-4dd2-8a0e-96e8b4bd93d8 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:08.370418 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89552bb-f67f-4d4f-86ec-33fa9e1b9cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:08.371195 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89552bb-f67f-4d4f-86ec-33fa9e1b9cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:08.371478 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89552bb-f67f-4d4f-86ec-33fa9e1b9cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:08.371752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89552bb-f67f-4d4f-86ec-33fa9e1b9cb5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:08.372959 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89552bb-f67f-4d4f-86ec-33fa9e1b9cb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:08.374373 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89552bb-f67f-4d4f-86ec-33fa9e1b9cb5 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:08.375984 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 559/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:42:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:08.381877 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746bdf3-8634-493c-bf77-2c519cb8c32c None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:08.478191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:08.484938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746bdf3-8634-493c-bf77-2c519cb8c32c None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:08.519383 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044118b9-4868-44de-964e-6a6004912d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:08.520648 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044118b9-4868-44de-964e-6a6004912d00 None admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:08.520912 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044118b9-4868-44de-964e-6a6004912d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:08.521192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044118b9-4868-44de-964e-6a6004912d00 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:08.521924 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044118b9-4868-44de-964e-6a6004912d00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:08.523353 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044118b9-4868-44de-964e-6a6004912d00 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:08.600640 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 551/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 16:42:08 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:42:10.681505 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442d094-1917-4c3f-a8f8-7fcf17504eab None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:10.682025 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442d094-1917-4c3f-a8f8-7fcf17504eab None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:10.682145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442d094-1917-4c3f-a8f8-7fcf17504eab None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:10.683422 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 560/1111] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:42:10.688674 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc19c0-d92c-48f7-8cc8-8c854c920573 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:10.689047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc19c0-d92c-48f7-8cc8-8c854c920573 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:10.689248 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc19c0-d92c-48f7-8cc8-8c854c920573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:10.705467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-1bcc19c0-d92c-48f7-8cc8-8c854c920573 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:42:10.706669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-1bcc19c0-d92c-48f7-8cc8-8c854c920573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:42:10.770373 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 552/1112] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:42:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:42:10.793949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442d094-1917-4c3f-a8f8-7fcf17504eab None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:10.809522 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:10.890244 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442d094-1917-4c3f-a8f8-7fcf17504eab None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:10.921901 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a98c1c-3826-4f7c-ab43-9ca584f2bcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:10.922727 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a98c1c-3826-4f7c-ab43-9ca584f2bcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:10.923006 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a98c1c-3826-4f7c-ab43-9ca584f2bcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:10.923279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a98c1c-3826-4f7c-ab43-9ca584f2bcc5 None admin] PATH_INFO: `/v3/roles/885a05785a714822b2012deb56880a73` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:10.924753 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a98c1c-3826-4f7c-ab43-9ca584f2bcc5 None admin] RBAC: Authorizing `identity:get_role(role_id=885a05785a714822b2012deb56880a73)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:10.926683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a98c1c-3826-4f7c-ab43-9ca584f2bcc5 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:10.928027 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 561/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:42:10 2022] GET /identity/v3/roles/885a05785a714822b2012deb56880a73 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:10.933804 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc19c0-d92c-48f7-8cc8-8c854c920573 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:11.009888 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:11.028796 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc19c0-d92c-48f7-8cc8-8c854c920573 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:11.061797 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084266a8-79cd-46db-956c-990098e7f296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:11.062811 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084266a8-79cd-46db-956c-990098e7f296 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:11.063254 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084266a8-79cd-46db-956c-990098e7f296 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:11.063909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084266a8-79cd-46db-956c-990098e7f296 None admin] PATH_INFO: `/v3/users/e3542cb6ac7d4652b4f01758eb455095` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:11.076218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084266a8-79cd-46db-956c-990098e7f296 None admin] RBAC: Authorizing `identity:get_user(user_id=e3542cb6ac7d4652b4f01758eb455095)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:11.077639 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084266a8-79cd-46db-956c-990098e7f296 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:11.079269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 553/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:42:10 2022] GET /identity/v3/users/e3542cb6ac7d4652b4f01758eb455095 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:11.085551 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a98c1c-3826-4f7c-ab43-9ca584f2bcc5 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:11.162999 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:11.179853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a98c1c-3826-4f7c-ab43-9ca584f2bcc5 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:11.211976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f208f1-2ada-4f3f-a382-d6a4f5fd4a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:11.212586 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f208f1-2ada-4f3f-a382-d6a4f5fd4a64 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:11.212869 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f208f1-2ada-4f3f-a382-d6a4f5fd4a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:11.213146 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f208f1-2ada-4f3f-a382-d6a4f5fd4a64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:11.276201 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f208f1-2ada-4f3f-a382-d6a4f5fd4a64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:11.277632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f208f1-2ada-4f3f-a382-d6a4f5fd4a64 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:11.352639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:11.370165 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 562/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:42:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 16:42:11.376275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084266a8-79cd-46db-956c-990098e7f296 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:11.472524 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084266a8-79cd-46db-956c-990098e7f296 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:11.503758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2a410-0f56-477d-a48c-4c7ab9b0613f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:11.505167 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2a410-0f56-477d-a48c-4c7ab9b0613f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:11.505447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2a410-0f56-477d-a48c-4c7ab9b0613f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:11.505718 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2a410-0f56-477d-a48c-4c7ab9b0613f None admin] PATH_INFO: `/v3/projects/eb5d2e37c00b497b94c62c44f49836ad` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:11.506868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2a410-0f56-477d-a48c-4c7ab9b0613f None admin] RBAC: Authorizing `identity:get_project(project_id=eb5d2e37c00b497b94c62c44f49836ad)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:11.508306 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2a410-0f56-477d-a48c-4c7ab9b0613f None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:11.509960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 554/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:42:11 2022] GET /identity/v3/projects/eb5d2e37c00b497b94c62c44f49836ad => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:11.516368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f208f1-2ada-4f3f-a382-d6a4f5fd4a64 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:11.610468 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f208f1-2ada-4f3f-a382-d6a4f5fd4a64 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:11.643380 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3b1cf-76e9-4c33-9e81-133adc39bef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:11.644022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3b1cf-76e9-4c33-9e81-133adc39bef2 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:11.644337 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3b1cf-76e9-4c33-9e81-133adc39bef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:11.644617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3b1cf-76e9-4c33-9e81-133adc39bef2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:11.646072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3b1cf-76e9-4c33-9e81-133adc39bef2 None admin] RBAC: Adding query filter params (role.id=885a05785a714822b2012deb56880a73, scope.project.id=eb5d2e37c00b497b94c62c44f49836ad, user.id=e3542cb6ac7d4652b4f01758eb455095) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:11.646387 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3b1cf-76e9-4c33-9e81-133adc39bef2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:11.647807 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3b1cf-76e9-4c33-9e81-133adc39bef2 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:11.653141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 563/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:42:11 2022] GET /identity/v3/role_assignments?user.id=e3542cb6ac7d4652b4f01758eb455095&scope.project.id=eb5d2e37c00b497b94c62c44f49836ad&role.id=885a05785a714822b2012deb56880a73 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:13.616291 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f84a5-47e9-4465-a1a4-72f2d57d0b3d None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:13.616839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f84a5-47e9-4465-a1a4-72f2d57d0b3d None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:13.616839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f84a5-47e9-4465-a1a4-72f2d57d0b3d None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:13.618211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 555/1118] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:42:13.623283 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e61eb-1111-41e9-9f89-1da0e079d2b2 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:13.623641 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e61eb-1111-41e9-9f89-1da0e079d2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:13.623845 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e61eb-1111-41e9-9f89-1da0e079d2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:13.640352 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-351e61eb-1111-41e9-9f89-1da0e079d2b2 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:42:13.641527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-351e61eb-1111-41e9-9f89-1da0e079d2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:42:13.682191 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:13.705627 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 564/1119] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:42:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:42:13.728576 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f84a5-47e9-4465-a1a4-72f2d57d0b3d None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:13.737613 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:13.826800 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f84a5-47e9-4465-a1a4-72f2d57d0b3d None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:13.858640 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c463519-9b63-4960-b9a2-ec23c3b79f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:13.859469 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c463519-9b63-4960-b9a2-ec23c3b79f9c None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:13.859751 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c463519-9b63-4960-b9a2-ec23c3b79f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:13.860025 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c463519-9b63-4960-b9a2-ec23c3b79f9c None admin] PATH_INFO: `/v3/roles/885a05785a714822b2012deb56880a73` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:13.861515 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c463519-9b63-4960-b9a2-ec23c3b79f9c None admin] RBAC: Authorizing `identity:get_role(role_id=885a05785a714822b2012deb56880a73)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:13.862863 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c463519-9b63-4960-b9a2-ec23c3b79f9c None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:13.864258 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 556/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:42:13 2022] GET /identity/v3/roles/885a05785a714822b2012deb56880a73 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:13.870017 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e61eb-1111-41e9-9f89-1da0e079d2b2 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:13.965716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e61eb-1111-41e9-9f89-1da0e079d2b2 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:13.997800 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65740b3-fc96-4956-9a85-48b6982ebba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:13.998659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65740b3-fc96-4956-9a85-48b6982ebba2 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:13.998944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65740b3-fc96-4956-9a85-48b6982ebba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:13.999218 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65740b3-fc96-4956-9a85-48b6982ebba2 None admin] PATH_INFO: `/v3/users/e3542cb6ac7d4652b4f01758eb455095` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:14.000428 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65740b3-fc96-4956-9a85-48b6982ebba2 None admin] RBAC: Authorizing `identity:get_user(user_id=e3542cb6ac7d4652b4f01758eb455095)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:14.001852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65740b3-fc96-4956-9a85-48b6982ebba2 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:14.003461 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 565/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:42:13 2022] GET /identity/v3/users/e3542cb6ac7d4652b4f01758eb455095 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:14.009702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c463519-9b63-4960-b9a2-ec23c3b79f9c None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:14.082963 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:14.106740 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c463519-9b63-4960-b9a2-ec23c3b79f9c None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:14.140307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419e5b8-e68b-4455-a782-e35724c67a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:14.141099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419e5b8-e68b-4455-a782-e35724c67a4d None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:14.141384 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419e5b8-e68b-4455-a782-e35724c67a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:14.141661 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419e5b8-e68b-4455-a782-e35724c67a4d None admin] PATH_INFO: `/v3/projects/eb5d2e37c00b497b94c62c44f49836ad` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:14.142825 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419e5b8-e68b-4455-a782-e35724c67a4d None admin] RBAC: Authorizing `identity:get_project(project_id=eb5d2e37c00b497b94c62c44f49836ad)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:14.144276 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419e5b8-e68b-4455-a782-e35724c67a4d None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:14.146043 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 557/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:42:14 2022] GET /identity/v3/projects/eb5d2e37c00b497b94c62c44f49836ad => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:14.151774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65740b3-fc96-4956-9a85-48b6982ebba2 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:14.195737 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:14.246225 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65740b3-fc96-4956-9a85-48b6982ebba2 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:14.278381 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72212dae-7190-404e-885d-45a8de58481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:14.279238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72212dae-7190-404e-885d-45a8de58481b None admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:14.279520 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72212dae-7190-404e-885d-45a8de58481b None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:14.279795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72212dae-7190-404e-885d-45a8de58481b None admin] PATH_INFO: `/v3/projects/eb5d2e37c00b497b94c62c44f49836ad/users/e3542cb6ac7d4652b4f01758eb455095/roles/885a05785a714822b2012deb56880a73` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:14.281964 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72212dae-7190-404e-885d-45a8de58481b None admin] RBAC: Authorizing `identity:create_grant(project_id=eb5d2e37c00b497b94c62c44f49836ad, user_id=e3542cb6ac7d4652b4f01758eb455095, role_id=885a05785a714822b2012deb56880a73)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:14.283369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72212dae-7190-404e-885d-45a8de58481b None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:14.353736 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 566/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:42:14 2022] PUT /identity/v3/projects/eb5d2e37c00b497b94c62c44f49836ad/users/e3542cb6ac7d4652b4f01758eb455095/roles/885a05785a714822b2012deb56880a73 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:42:16.359067 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b085e-0bf2-4462-9fb1-5e7c22ad236d None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:16.359655 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b085e-0bf2-4462-9fb1-5e7c22ad236d None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:16.359655 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b085e-0bf2-4462-9fb1-5e7c22ad236d None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:16.361025 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 558/1124] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:42:16.366198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3986418-7728-48c2-93c5-6b02238372b9 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:16.366586 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3986418-7728-48c2-93c5-6b02238372b9 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:16.366761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3986418-7728-48c2-93c5-6b02238372b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:16.382921 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-d3986418-7728-48c2-93c5-6b02238372b9 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:42:16.384120 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d3986418-7728-48c2-93c5-6b02238372b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:42:16.448206 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 567/1125] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:42:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:42:16.477640 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b085e-0bf2-4462-9fb1-5e7c22ad236d None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:16.574473 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b085e-0bf2-4462-9fb1-5e7c22ad236d None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:16.607507 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8632af4-12a7-4ee7-b08d-fac858d87930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:16.608377 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8632af4-12a7-4ee7-b08d-fac858d87930 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:16.608663 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8632af4-12a7-4ee7-b08d-fac858d87930 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:16.608942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8632af4-12a7-4ee7-b08d-fac858d87930 None admin] PATH_INFO: `/v3/roles/885a05785a714822b2012deb56880a73` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:16.610477 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8632af4-12a7-4ee7-b08d-fac858d87930 None admin] RBAC: Authorizing `identity:get_role(role_id=885a05785a714822b2012deb56880a73)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:16.611794 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8632af4-12a7-4ee7-b08d-fac858d87930 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:16.613176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 559/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:42:16 2022] GET /identity/v3/roles/885a05785a714822b2012deb56880a73 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:16.618756 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3986418-7728-48c2-93c5-6b02238372b9 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:16.651618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:16.715274 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3986418-7728-48c2-93c5-6b02238372b9 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:16.748424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4034e25-f106-48f1-8a69-d208c2cb4fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:16.749283 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4034e25-f106-48f1-8a69-d208c2cb4fff None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:16.749593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4034e25-f106-48f1-8a69-d208c2cb4fff None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:16.749867 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4034e25-f106-48f1-8a69-d208c2cb4fff None admin] PATH_INFO: `/v3/users/e3542cb6ac7d4652b4f01758eb455095` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:16.751052 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4034e25-f106-48f1-8a69-d208c2cb4fff None admin] RBAC: Authorizing `identity:get_user(user_id=e3542cb6ac7d4652b4f01758eb455095)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:16.752678 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4034e25-f106-48f1-8a69-d208c2cb4fff None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:16.754338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 568/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:42:16 2022] GET /identity/v3/users/e3542cb6ac7d4652b4f01758eb455095 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:16.759950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8632af4-12a7-4ee7-b08d-fac858d87930 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:16.772505 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:16.855147 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8632af4-12a7-4ee7-b08d-fac858d87930 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:16.886873 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d40bc3-aa3a-4a47-8038-443b03e9e855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:16.887698 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d40bc3-aa3a-4a47-8038-443b03e9e855 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:16.887978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d40bc3-aa3a-4a47-8038-443b03e9e855 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:16.888279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d40bc3-aa3a-4a47-8038-443b03e9e855 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:16.951464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d40bc3-aa3a-4a47-8038-443b03e9e855 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:16.952903 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d40bc3-aa3a-4a47-8038-443b03e9e855 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:16.963165 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:17.047649 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 560/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:42:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 16:42:17.053365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4034e25-f106-48f1-8a69-d208c2cb4fff None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:17.149035 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4034e25-f106-48f1-8a69-d208c2cb4fff None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:17.150482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:17.182067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210e626-3b02-466b-9e99-5cf450aa1306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:17.182905 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210e626-3b02-466b-9e99-5cf450aa1306 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:17.183195 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210e626-3b02-466b-9e99-5cf450aa1306 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:17.183474 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210e626-3b02-466b-9e99-5cf450aa1306 None admin] PATH_INFO: `/v3/projects/eb5d2e37c00b497b94c62c44f49836ad` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:17.184810 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210e626-3b02-466b-9e99-5cf450aa1306 None admin] RBAC: Authorizing `identity:get_project(project_id=eb5d2e37c00b497b94c62c44f49836ad)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:17.186237 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210e626-3b02-466b-9e99-5cf450aa1306 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:17.187913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 569/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:42:17 2022] GET /identity/v3/projects/eb5d2e37c00b497b94c62c44f49836ad => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:17.194208 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d40bc3-aa3a-4a47-8038-443b03e9e855 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:17.289124 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d40bc3-aa3a-4a47-8038-443b03e9e855 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:17.299233 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:17.321550 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f0f9a-8782-4c13-aa24-0a7a430e55cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:17.322185 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f0f9a-8782-4c13-aa24-0a7a430e55cd None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:17.322468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f0f9a-8782-4c13-aa24-0a7a430e55cd None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:17.322743 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f0f9a-8782-4c13-aa24-0a7a430e55cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:17.323573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f0f9a-8782-4c13-aa24-0a7a430e55cd None admin] RBAC: Adding query filter params (role.id=885a05785a714822b2012deb56880a73, scope.project.id=eb5d2e37c00b497b94c62c44f49836ad, user.id=e3542cb6ac7d4652b4f01758eb455095) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:17.323892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f0f9a-8782-4c13-aa24-0a7a430e55cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:17.325337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f0f9a-8782-4c13-aa24-0a7a430e55cd None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:17.330984 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 561/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:42:17 2022] GET /identity/v3/role_assignments?user.id=e3542cb6ac7d4652b4f01758eb455095&scope.project.id=eb5d2e37c00b497b94c62c44f49836ad&role.id=885a05785a714822b2012deb56880a73 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:19.356424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f654a-ab9a-41b5-a703-c1c0417541ac None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:19.356961 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f654a-ab9a-41b5-a703-c1c0417541ac None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:19.356961 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f654a-ab9a-41b5-a703-c1c0417541ac None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:19.358363 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 570/1131] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:42:19.363617 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4333e6-f533-4c49-b357-446c2ee8fd9c None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:19.364022 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4333e6-f533-4c49-b357-446c2ee8fd9c None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:19.364227 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4333e6-f533-4c49-b357-446c2ee8fd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:19.384842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-4d4333e6-f533-4c49-b357-446c2ee8fd9c None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:42:19.386063 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-4d4333e6-f533-4c49-b357-446c2ee8fd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:42:19.458556 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 562/1132] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:42:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:42:19.482713 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f654a-ab9a-41b5-a703-c1c0417541ac None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:19.581498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f654a-ab9a-41b5-a703-c1c0417541ac None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:19.614521 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce70d6-0b04-4fb8-9356-efd1cad492be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:19.615217 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce70d6-0b04-4fb8-9356-efd1cad492be None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:19.615507 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce70d6-0b04-4fb8-9356-efd1cad492be None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:19.615789 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce70d6-0b04-4fb8-9356-efd1cad492be None admin] PATH_INFO: `/v3/domains/default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:19.616998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce70d6-0b04-4fb8-9356-efd1cad492be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:19.618427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce70d6-0b04-4fb8-9356-efd1cad492be None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:19.620030 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 571/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:42:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:19.625994 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4333e6-f533-4c49-b357-446c2ee8fd9c None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:19.721093 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4333e6-f533-4c49-b357-446c2ee8fd9c None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:19.723312 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:19.752713 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edfdfc-0605-4e32-8987-b29e06fe563c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:19.753644 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edfdfc-0605-4e32-8987-b29e06fe563c None admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:19.754680 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edfdfc-0605-4e32-8987-b29e06fe563c None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:19.755000 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edfdfc-0605-4e32-8987-b29e06fe563c None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:19.756028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edfdfc-0605-4e32-8987-b29e06fe563c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:19.757473 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edfdfc-0605-4e32-8987-b29e06fe563c None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:19.857126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 563/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 16:42:19 2022] POST /identity/v3/projects => generated 311 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:42:21.876078 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550c70a-d5d2-4a98-a95d-ff14fdffa0f1 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:21.876649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550c70a-d5d2-4a98-a95d-ff14fdffa0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:21.876649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550c70a-d5d2-4a98-a95d-ff14fdffa0f1 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:21.878042 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 572/1135] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:42:21.883717 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac0ff7-c70c-45cf-8715-9472669cbc53 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:21.884124 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac0ff7-c70c-45cf-8715-9472669cbc53 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:21.884347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac0ff7-c70c-45cf-8715-9472669cbc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:21.900820 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-40ac0ff7-c70c-45cf-8715-9472669cbc53 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:42:21.901977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-40ac0ff7-c70c-45cf-8715-9472669cbc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:42:21.964971 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 564/1136] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:42:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:42:21.990363 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550c70a-d5d2-4a98-a95d-ff14fdffa0f1 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:22.030726 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:22.088869 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550c70a-d5d2-4a98-a95d-ff14fdffa0f1 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:22.121447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4e696-2307-4225-bd52-20916cd2d91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:22.122220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4e696-2307-4225-bd52-20916cd2d91b None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:22.122506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4e696-2307-4225-bd52-20916cd2d91b None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:22.122786 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4e696-2307-4225-bd52-20916cd2d91b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:22.123949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4e696-2307-4225-bd52-20916cd2d91b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:22.125409 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4e696-2307-4225-bd52-20916cd2d91b None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:22.127052 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 573/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:42:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:22.132738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac0ff7-c70c-45cf-8715-9472669cbc53 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:22.211910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:22.226385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac0ff7-c70c-45cf-8715-9472669cbc53 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:22.258964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2be91-17d7-40c9-ab20-6d944885f814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:22.259615 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2be91-17d7-40c9-ab20-6d944885f814 None admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:22.259895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2be91-17d7-40c9-ab20-6d944885f814 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:22.260193 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2be91-17d7-40c9-ab20-6d944885f814 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:22.260903 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2be91-17d7-40c9-ab20-6d944885f814 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:22.262683 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2be91-17d7-40c9-ab20-6d944885f814 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:22.348437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 565/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 16:42:22 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:42:24.369711 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a704d-e84b-48fa-a454-4f2ba77dcb6e None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:24.370212 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a704d-e84b-48fa-a454-4f2ba77dcb6e None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:24.370322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a704d-e84b-48fa-a454-4f2ba77dcb6e None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:24.371631 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 574/1139] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:42:24.376669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa493e8-c31d-47bb-a663-a6db50b51c2b None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:24.377103 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa493e8-c31d-47bb-a663-a6db50b51c2b None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:24.377235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa493e8-c31d-47bb-a663-a6db50b51c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:24.394253 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-cfa493e8-c31d-47bb-a663-a6db50b51c2b None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:42:24.395996 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-cfa493e8-c31d-47bb-a663-a6db50b51c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:42:24.460058 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 566/1140] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:42:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:42:24.483491 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a704d-e84b-48fa-a454-4f2ba77dcb6e None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:24.581599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a704d-e84b-48fa-a454-4f2ba77dcb6e None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:24.588794 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:24.614029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28984a4a-fb4b-4b31-82d7-1336cfdbf139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:24.614795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28984a4a-fb4b-4b31-82d7-1336cfdbf139 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:24.615076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28984a4a-fb4b-4b31-82d7-1336cfdbf139 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:24.615392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28984a4a-fb4b-4b31-82d7-1336cfdbf139 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:24.625029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28984a4a-fb4b-4b31-82d7-1336cfdbf139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:42:24.633389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-28984a4a-fb4b-4b31-82d7-1336cfdbf139 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:42:24.633389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:42:24.633389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:42:24.633389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:42:24.633389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:42:24.633389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:42:24.633389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:42:24.633389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:42:24.633389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:42:24.633389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:42:24.633389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:42:24.633389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:42:24.633389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:42:24.633389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:42:24.633389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:42:24.633389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:42:24.634593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:42:24.634593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:42:24.634593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:42:24.634593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:42:24.634593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:42:24.634593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:42:24.634593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:42:24.634593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:42:24.634593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:42:24.634593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:42:24.634593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:42:24.634593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:42:24.634593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:42:24.634593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:42:24.634593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:42:24.634593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:42:24.635717 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:42:24.635717 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:42:24.635717 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:42:24.635717 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:42:24.635717 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:42:24.635717 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:42:24.635717 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:42:24.635717 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:42:24.635717 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:42:24.635717 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:42:24.635717 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:42:24.635717 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:42:24.636920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 575/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:42:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:42:24.640820 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa493e8-c31d-47bb-a663-a6db50b51c2b None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:24.707298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:24.735543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa493e8-c31d-47bb-a663-a6db50b51c2b None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:24.769669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4892d2-a1c1-403e-b858-c46826cd8c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:24.770319 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4892d2-a1c1-403e-b858-c46826cd8c62 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:24.770607 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4892d2-a1c1-403e-b858-c46826cd8c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:24.770885 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4892d2-a1c1-403e-b858-c46826cd8c62 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:24.771635 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4892d2-a1c1-403e-b858-c46826cd8c62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:24.771946 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4892d2-a1c1-403e-b858-c46826cd8c62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:24.773337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4892d2-a1c1-403e-b858-c46826cd8c62 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:24.781160 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 567/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:42:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:24.786805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28984a4a-fb4b-4b31-82d7-1336cfdbf139 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:24.884788 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28984a4a-fb4b-4b31-82d7-1336cfdbf139 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:24.916614 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45d243-6b84-4a3d-a102-1ecd62fd40db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:24.917473 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45d243-6b84-4a3d-a102-1ecd62fd40db None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:24.917754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45d243-6b84-4a3d-a102-1ecd62fd40db None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:24.918029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45d243-6b84-4a3d-a102-1ecd62fd40db None admin] PATH_INFO: `/v3/users/5dc66cc308144b13a798460f59cf5c77` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:24.931070 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45d243-6b84-4a3d-a102-1ecd62fd40db None admin] RBAC: Authorizing `identity:get_user(user_id=5dc66cc308144b13a798460f59cf5c77)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:24.932530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45d243-6b84-4a3d-a102-1ecd62fd40db None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:24.934183 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 576/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:42:24 2022] GET /identity/v3/users/5dc66cc308144b13a798460f59cf5c77 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:24.939855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4892d2-a1c1-403e-b858-c46826cd8c62 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:25.036385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4892d2-a1c1-403e-b858-c46826cd8c62 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:25.068435 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bc9b4-e020-4433-b81c-ee3c3142ee74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:25.069072 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bc9b4-e020-4433-b81c-ee3c3142ee74 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:25.069356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bc9b4-e020-4433-b81c-ee3c3142ee74 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:25.069658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bc9b4-e020-4433-b81c-ee3c3142ee74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:25.072211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:25.133724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1bc9b4-e020-4433-b81c-ee3c3142ee74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:25.135201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1bc9b4-e020-4433-b81c-ee3c3142ee74 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:25.228055 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 568/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:42:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 16:42:25.233803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45d243-6b84-4a3d-a102-1ecd62fd40db None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:25.258316 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:25.328662 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45d243-6b84-4a3d-a102-1ecd62fd40db None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:25.362063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eefa03-e4e0-47e1-89cd-070b29706fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:25.362892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eefa03-e4e0-47e1-89cd-070b29706fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:25.363199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eefa03-e4e0-47e1-89cd-070b29706fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:25.363474 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eefa03-e4e0-47e1-89cd-070b29706fc1 None admin] PATH_INFO: `/v3/projects/eba7104c2f234164bee3695159078dc7` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:25.364652 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eefa03-e4e0-47e1-89cd-070b29706fc1 None admin] RBAC: Authorizing `identity:get_project(project_id=eba7104c2f234164bee3695159078dc7)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:25.366058 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eefa03-e4e0-47e1-89cd-070b29706fc1 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:25.367723 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 577/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:42:25 2022] GET /identity/v3/projects/eba7104c2f234164bee3695159078dc7 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:25.373747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bc9b4-e020-4433-b81c-ee3c3142ee74 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:25.406157 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:25.478534 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bc9b4-e020-4433-b81c-ee3c3142ee74 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:25.510631 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e398e-fecb-40e5-8de7-9058bfa7aa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:25.511277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e398e-fecb-40e5-8de7-9058bfa7aa49 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:25.511566 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e398e-fecb-40e5-8de7-9058bfa7aa49 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:25.511844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e398e-fecb-40e5-8de7-9058bfa7aa49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:25.512977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e398e-fecb-40e5-8de7-9058bfa7aa49 None admin] RBAC: Adding query filter params (role.id=459b0e5c21c94fb1b81f76c65780fdb5, scope.project.id=eba7104c2f234164bee3695159078dc7, user.id=5dc66cc308144b13a798460f59cf5c77) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:25.513292 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e398e-fecb-40e5-8de7-9058bfa7aa49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:25.514714 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e398e-fecb-40e5-8de7-9058bfa7aa49 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:25.520564 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 569/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:42:25 2022] GET /identity/v3/role_assignments?user.id=5dc66cc308144b13a798460f59cf5c77&scope.project.id=eba7104c2f234164bee3695159078dc7&role.id=459b0e5c21c94fb1b81f76c65780fdb5 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:27.492258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbf273-1949-491f-b2ff-c92fc3b83443 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:27.492893 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbf273-1949-491f-b2ff-c92fc3b83443 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:27.492893 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbf273-1949-491f-b2ff-c92fc3b83443 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:27.494173 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 578/1147] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:42:27.499244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d8fcd-c9c5-48b9-8c07-4285a5fe4f72 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:27.499619 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d8fcd-c9c5-48b9-8c07-4285a5fe4f72 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:27.499800 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d8fcd-c9c5-48b9-8c07-4285a5fe4f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:27.516824 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-6b5d8fcd-c9c5-48b9-8c07-4285a5fe4f72 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:42:27.517995 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6b5d8fcd-c9c5-48b9-8c07-4285a5fe4f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:42:27.582068 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 570/1148] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:42:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:42:27.604068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbf273-1949-491f-b2ff-c92fc3b83443 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:27.690653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:27.700226 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbf273-1949-491f-b2ff-c92fc3b83443 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:27.731809 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192bbfc-ad60-4718-b66a-11048915b2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:27.732597 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192bbfc-ad60-4718-b66a-11048915b2ef None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:27.732880 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192bbfc-ad60-4718-b66a-11048915b2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:27.733155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192bbfc-ad60-4718-b66a-11048915b2ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:27.743368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192bbfc-ad60-4718-b66a-11048915b2ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:42:27.750752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-5192bbfc-ad60-4718-b66a-11048915b2ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:42:27.750752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:42:27.750752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:42:27.750752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:42:27.750752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:42:27.750752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:42:27.750752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:42:27.750752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:42:27.750752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:42:27.750752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:42:27.750752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:42:27.750752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:42:27.750752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:42:27.750752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:42:27.750752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:42:27.750752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:42:27.751864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:42:27.751864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:42:27.751864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:42:27.751864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:42:27.751864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:42:27.751864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:42:27.751864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:42:27.751864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:42:27.751864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:42:27.751864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:42:27.751864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:42:27.751864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:42:27.751864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:42:27.751864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:42:27.751864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:42:27.751864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:42:27.753100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:42:27.753100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:42:27.753100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:42:27.753100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:42:27.753100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:42:27.753100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:42:27.753100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:42:27.753100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:42:27.753100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:42:27.753100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:42:27.753100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:42:27.753100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:42:27.753100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 579/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:42:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:42:27.758452 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d8fcd-c9c5-48b9-8c07-4285a5fe4f72 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:27.784838 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:27.854695 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d8fcd-c9c5-48b9-8c07-4285a5fe4f72 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:27.887535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bede9-4199-4f48-b492-d79e68c5e997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:27.888223 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bede9-4199-4f48-b492-d79e68c5e997 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:27.888509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bede9-4199-4f48-b492-d79e68c5e997 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:27.888784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bede9-4199-4f48-b492-d79e68c5e997 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:27.889535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bede9-4199-4f48-b492-d79e68c5e997 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:27.889845 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bede9-4199-4f48-b492-d79e68c5e997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:27.891207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bede9-4199-4f48-b492-d79e68c5e997 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:27.899591 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 571/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:42:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:27.905319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192bbfc-ad60-4718-b66a-11048915b2ef None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:27.999913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192bbfc-ad60-4718-b66a-11048915b2ef None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:28.032744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6aa787-087b-475f-b248-52030c599fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:28.033599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6aa787-087b-475f-b248-52030c599fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:28.033880 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6aa787-087b-475f-b248-52030c599fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:28.034151 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6aa787-087b-475f-b248-52030c599fc3 None admin] PATH_INFO: `/v3/users/5dc66cc308144b13a798460f59cf5c77` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:28.035320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6aa787-087b-475f-b248-52030c599fc3 None admin] RBAC: Authorizing `identity:get_user(user_id=5dc66cc308144b13a798460f59cf5c77)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:28.036781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6aa787-087b-475f-b248-52030c599fc3 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:28.038383 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 580/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:42:27 2022] GET /identity/v3/users/5dc66cc308144b13a798460f59cf5c77 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:28.044017 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bede9-4199-4f48-b492-d79e68c5e997 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:28.131745 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:28.141195 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bede9-4199-4f48-b492-d79e68c5e997 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:28.178197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ff024-3f56-4383-8781-6b2388e1cfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:28.179049 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ff024-3f56-4383-8781-6b2388e1cfa2 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:28.179331 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ff024-3f56-4383-8781-6b2388e1cfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:28.179606 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ff024-3f56-4383-8781-6b2388e1cfa2 None admin] PATH_INFO: `/v3/projects/eba7104c2f234164bee3695159078dc7` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:28.180805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ff024-3f56-4383-8781-6b2388e1cfa2 None admin] RBAC: Authorizing `identity:get_project(project_id=eba7104c2f234164bee3695159078dc7)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:28.182233 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ff024-3f56-4383-8781-6b2388e1cfa2 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:28.183935 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 572/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:42:28 2022] GET /identity/v3/projects/eba7104c2f234164bee3695159078dc7 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:28.190963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6aa787-087b-475f-b248-52030c599fc3 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:28.213707 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:28.288568 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6aa787-087b-475f-b248-52030c599fc3 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:28.321215 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5bb79-9921-4976-9ff9-0d1aa5f37016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:28.322085 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5bb79-9921-4976-9ff9-0d1aa5f37016 None admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:28.322368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5bb79-9921-4976-9ff9-0d1aa5f37016 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:28.322645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5bb79-9921-4976-9ff9-0d1aa5f37016 None admin] PATH_INFO: `/v3/projects/eba7104c2f234164bee3695159078dc7/users/5dc66cc308144b13a798460f59cf5c77/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:28.324671 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5bb79-9921-4976-9ff9-0d1aa5f37016 None admin] RBAC: Authorizing `identity:create_grant(project_id=eba7104c2f234164bee3695159078dc7, user_id=5dc66cc308144b13a798460f59cf5c77, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:28.326092 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5bb79-9921-4976-9ff9-0d1aa5f37016 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:28.398555 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 581/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:42:28 2022] PUT /identity/v3/projects/eba7104c2f234164bee3695159078dc7/users/5dc66cc308144b13a798460f59cf5c77/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:42:30.404788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ad78a-a4d2-4377-bce0-073dc7c73562 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:30.405296 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ad78a-a4d2-4377-bce0-073dc7c73562 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:30.405386 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ad78a-a4d2-4377-bce0-073dc7c73562 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:30.406713 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 573/1154] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:42:30.412336 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76500b2d-cee6-41ab-a4f4-f69d39a9b174 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:30.412734 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76500b2d-cee6-41ab-a4f4-f69d39a9b174 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:30.412896 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76500b2d-cee6-41ab-a4f4-f69d39a9b174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:30.429742 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-76500b2d-cee6-41ab-a4f4-f69d39a9b174 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:42:30.430909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-76500b2d-cee6-41ab-a4f4-f69d39a9b174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:42:30.497347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 582/1155] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:42:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:42:30.521255 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ad78a-a4d2-4377-bce0-073dc7c73562 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:30.619185 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ad78a-a4d2-4377-bce0-073dc7c73562 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:30.651719 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89515943-3c3d-48ea-bfe0-56ef3ee6cb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:30.652516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89515943-3c3d-48ea-bfe0-56ef3ee6cb8e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:30.652800 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89515943-3c3d-48ea-bfe0-56ef3ee6cb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:30.653073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89515943-3c3d-48ea-bfe0-56ef3ee6cb8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:30.663822 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89515943-3c3d-48ea-bfe0-56ef3ee6cb8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:42:30.671293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-89515943-3c3d-48ea-bfe0-56ef3ee6cb8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:42:30.671293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:42:30.671293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:42:30.671293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:42:30.671293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:42:30.671293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:42:30.671293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:42:30.671293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:42:30.671293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:42:30.671293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:42:30.671293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:42:30.671293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:42:30.671293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:42:30.671293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:42:30.671293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:42:30.671293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:42:30.672295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:42:30.672295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:42:30.672295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:42:30.672295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:42:30.672295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:42:30.672295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:42:30.672295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:42:30.672295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:42:30.672295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:42:30.672295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:42:30.672295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:42:30.672295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:42:30.672295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:42:30.672295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:42:30.672295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:42:30.672295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:42:30.673203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:42:30.673203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:42:30.673203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:42:30.673203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:42:30.673203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:42:30.673203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:42:30.673203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:42:30.673203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:42:30.673203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:42:30.673203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:42:30.673203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:42:30.673203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:42:30.673203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 574/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:42:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:42:30.678648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76500b2d-cee6-41ab-a4f4-f69d39a9b174 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:30.690175 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:30.773498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76500b2d-cee6-41ab-a4f4-f69d39a9b174 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:30.805470 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f34db-738a-4224-a58f-5fccbb68514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:30.806113 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f34db-738a-4224-a58f-5fccbb68514a None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:30.806399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f34db-738a-4224-a58f-5fccbb68514a None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:30.806675 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f34db-738a-4224-a58f-5fccbb68514a None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:30.807416 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f34db-738a-4224-a58f-5fccbb68514a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:30.807721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f34db-738a-4224-a58f-5fccbb68514a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:30.809107 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f34db-738a-4224-a58f-5fccbb68514a None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:30.816802 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 583/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:42:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:30.822503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89515943-3c3d-48ea-bfe0-56ef3ee6cb8e None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:30.841248 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:30.919302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89515943-3c3d-48ea-bfe0-56ef3ee6cb8e None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:30.952670 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3e8e5-e5ef-47f2-b15c-a26613916617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:30.953520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3e8e5-e5ef-47f2-b15c-a26613916617 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:30.953808 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3e8e5-e5ef-47f2-b15c-a26613916617 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:30.954080 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3e8e5-e5ef-47f2-b15c-a26613916617 None admin] PATH_INFO: `/v3/users/5dc66cc308144b13a798460f59cf5c77` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:30.955259 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3e8e5-e5ef-47f2-b15c-a26613916617 None admin] RBAC: Authorizing `identity:get_user(user_id=5dc66cc308144b13a798460f59cf5c77)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:30.957309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3e8e5-e5ef-47f2-b15c-a26613916617 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:30.958923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 575/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:42:30 2022] GET /identity/v3/users/5dc66cc308144b13a798460f59cf5c77 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:30.964754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f34db-738a-4224-a58f-5fccbb68514a None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:31.034338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:31.062666 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f34db-738a-4224-a58f-5fccbb68514a None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:31.095671 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896de74c-b030-4e06-9ade-ac581299a613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:31.096339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896de74c-b030-4e06-9ade-ac581299a613 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:31.096626 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896de74c-b030-4e06-9ade-ac581299a613 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:31.096903 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896de74c-b030-4e06-9ade-ac581299a613 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:31.160392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896de74c-b030-4e06-9ade-ac581299a613 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:31.161830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896de74c-b030-4e06-9ade-ac581299a613 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:31.225686 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:31.254348 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 584/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:42:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 16:42:31.260335 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3e8e5-e5ef-47f2-b15c-a26613916617 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:31.341557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:31.355413 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3e8e5-e5ef-47f2-b15c-a26613916617 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:31.388652 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12099809-f9ca-466a-abb6-c24a7ccfced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:31.389485 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12099809-f9ca-466a-abb6-c24a7ccfced9 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:31.389772 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12099809-f9ca-466a-abb6-c24a7ccfced9 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:31.390050 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12099809-f9ca-466a-abb6-c24a7ccfced9 None admin] PATH_INFO: `/v3/projects/eba7104c2f234164bee3695159078dc7` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:31.391214 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12099809-f9ca-466a-abb6-c24a7ccfced9 None admin] RBAC: Authorizing `identity:get_project(project_id=eba7104c2f234164bee3695159078dc7)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:31.392669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12099809-f9ca-466a-abb6-c24a7ccfced9 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:31.394365 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 576/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:42:31 2022] GET /identity/v3/projects/eba7104c2f234164bee3695159078dc7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:31.400294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896de74c-b030-4e06-9ade-ac581299a613 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:31.498165 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896de74c-b030-4e06-9ade-ac581299a613 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:31.534670 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c02ace-b8ce-441d-88a6-59843e404586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:31.535341 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c02ace-b8ce-441d-88a6-59843e404586 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:31.535629 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c02ace-b8ce-441d-88a6-59843e404586 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:31.535909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c02ace-b8ce-441d-88a6-59843e404586 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:31.536776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c02ace-b8ce-441d-88a6-59843e404586 None admin] RBAC: Adding query filter params (role.id=459b0e5c21c94fb1b81f76c65780fdb5, scope.project.id=eba7104c2f234164bee3695159078dc7, user.id=5dc66cc308144b13a798460f59cf5c77) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:31.537093 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c02ace-b8ce-441d-88a6-59843e404586 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:31.538521 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c02ace-b8ce-441d-88a6-59843e404586 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:31.544221 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 585/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:42:31 2022] GET /identity/v3/role_assignments?user.id=5dc66cc308144b13a798460f59cf5c77&scope.project.id=eba7104c2f234164bee3695159078dc7&role.id=459b0e5c21c94fb1b81f76c65780fdb5 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:33.540462 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b886cc-68bc-4223-9040-fae1af7be400 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:33.541012 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b886cc-68bc-4223-9040-fae1af7be400 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:33.541012 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b886cc-68bc-4223-9040-fae1af7be400 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:33.542373 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 577/1162] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:42:33.547658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49c77b-3f57-4452-a434-f29fc3d038ac None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:33.548025 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49c77b-3f57-4452-a434-f29fc3d038ac None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:33.548257 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49c77b-3f57-4452-a434-f29fc3d038ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:33.565062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-4a49c77b-3f57-4452-a434-f29fc3d038ac None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:42:33.566843 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-4a49c77b-3f57-4452-a434-f29fc3d038ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:42:33.594234 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:33.630891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 586/1163] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:42:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:42:33.653876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b886cc-68bc-4223-9040-fae1af7be400 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:33.750191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b886cc-68bc-4223-9040-fae1af7be400 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:33.782494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76e8d8-a6e4-4f78-b8f2-7ada1702166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:33.783118 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76e8d8-a6e4-4f78-b8f2-7ada1702166e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:33.783400 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76e8d8-a6e4-4f78-b8f2-7ada1702166e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:33.783677 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76e8d8-a6e4-4f78-b8f2-7ada1702166e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:33.806357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:33.847584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76e8d8-a6e4-4f78-b8f2-7ada1702166e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:33.849033 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76e8d8-a6e4-4f78-b8f2-7ada1702166e None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:33.949536 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 578/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:42:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 16:42:33.955516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49c77b-3f57-4452-a434-f29fc3d038ac None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:34.050001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49c77b-3f57-4452-a434-f29fc3d038ac None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:34.081983 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db75a52-3a63-4578-b91e-4317991a8460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:34.082705 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db75a52-3a63-4578-b91e-4317991a8460 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:34.082986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db75a52-3a63-4578-b91e-4317991a8460 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:34.083262 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db75a52-3a63-4578-b91e-4317991a8460 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:34.089659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db75a52-3a63-4578-b91e-4317991a8460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:34.091080 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db75a52-3a63-4578-b91e-4317991a8460 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:34.105103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-1db75a52-3a63-4578-b91e-4317991a8460 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 22 16:42:34.105103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:42:34.105103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 22 16:42:34.105103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 22 16:42:34.105103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:42:34.105103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:42:34.105103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:42:34.105103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:42:34.105103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 22 16:42:34.105103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:42:34.105103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:42:34.105103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:42:34.105103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:42:34.105103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:42:34.105103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:42:34.105103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:42:34.105103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:42:34.106305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:42:34.106305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:42:34.106305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:42:34.106305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:42:34.106305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:42:34.106305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:42:34.106305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:42:34.106305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:42:34.106305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:42:34.106305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:42:34.106305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:42:34.106305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:42:34.106305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:42:34.106305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:42:34.106305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:42:34.106305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:42:34.107198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:42:34.107198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:42:34.107198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:42:34.107198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:42:34.107198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:42:34.107198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:42:34.107198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:42:34.107198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:42:34.107198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:42:34.107198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:42:34.107198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 22 16:42:34.107198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:42:34.107198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 22 16:42:34.107198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:42:34.107198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 587/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jun 22 16:42:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:42:34.112478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76e8d8-a6e4-4f78-b8f2-7ada1702166e None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:34.165057 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:34.207070 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76e8d8-a6e4-4f78-b8f2-7ada1702166e None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:34.239533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ba65e-dc18-4545-89ae-6704afc3470c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:34.240202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ba65e-dc18-4545-89ae-6704afc3470c None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:34.240485 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ba65e-dc18-4545-89ae-6704afc3470c None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:34.240758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ba65e-dc18-4545-89ae-6704afc3470c None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:34.241473 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ba65e-dc18-4545-89ae-6704afc3470c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:34.241774 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ba65e-dc18-4545-89ae-6704afc3470c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:34.243125 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ba65e-dc18-4545-89ae-6704afc3470c None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:34.250460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 579/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jun 22 16:42:34 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:36.226153 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fec78c-6fbc-49ae-bf16-45de1c8575d2 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:36.226666 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fec78c-6fbc-49ae-bf16-45de1c8575d2 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:36.226777 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fec78c-6fbc-49ae-bf16-45de1c8575d2 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:36.228119 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 588/1167] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:42:36.233134 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a30406-57e8-4fbf-8cb7-d560808094ee None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:36.233548 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a30406-57e8-4fbf-8cb7-d560808094ee None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:36.233699 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a30406-57e8-4fbf-8cb7-d560808094ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:36.249953 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-c4a30406-57e8-4fbf-8cb7-d560808094ee None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:42:36.251135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-c4a30406-57e8-4fbf-8cb7-d560808094ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:42:36.315475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 580/1168] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:42:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:42:36.339181 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fec78c-6fbc-49ae-bf16-45de1c8575d2 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:36.365974 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:36.436692 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fec78c-6fbc-49ae-bf16-45de1c8575d2 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:36.468840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc2a87-7cf5-4292-a2d1-36c3791f019b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:36.469475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc2a87-7cf5-4292-a2d1-36c3791f019b None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:36.469762 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc2a87-7cf5-4292-a2d1-36c3791f019b None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:36.470043 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc2a87-7cf5-4292-a2d1-36c3791f019b None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:36.470786 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc2a87-7cf5-4292-a2d1-36c3791f019b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:36.472194 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc2a87-7cf5-4292-a2d1-36c3791f019b None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:36.541820 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 589/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Wed Jun 22 16:42:36 2022] POST /identity/v3/domains => generated 267 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:42:38.581577 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db8d0e-02d0-4ad3-b9d6-d6da632324cf None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:38.582129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db8d0e-02d0-4ad3-b9d6-d6da632324cf None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:38.582129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db8d0e-02d0-4ad3-b9d6-d6da632324cf None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:38.583535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 581/1170] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:42:38.588681 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587f5cf-2cff-48d5-bc21-05cc19ed6253 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:38.589111 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587f5cf-2cff-48d5-bc21-05cc19ed6253 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:38.589246 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587f5cf-2cff-48d5-bc21-05cc19ed6253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:38.607234 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-f587f5cf-2cff-48d5-bc21-05cc19ed6253 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:42:38.608466 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f587f5cf-2cff-48d5-bc21-05cc19ed6253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:42:38.672733 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 590/1171] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:42:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:42:38.697508 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db8d0e-02d0-4ad3-b9d6-d6da632324cf None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:38.746586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:38.796794 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db8d0e-02d0-4ad3-b9d6-d6da632324cf None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:38.828654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1c732-90b3-4fbd-bf69-ede9cd3eade6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:38.829494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1c732-90b3-4fbd-bf69-ede9cd3eade6 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:38.829776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1c732-90b3-4fbd-bf69-ede9cd3eade6 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:38.830048 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1c732-90b3-4fbd-bf69-ede9cd3eade6 None admin] PATH_INFO: `/v3/domains/0d061d5ff5374b848522685b2d044255` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:38.840682 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1c732-90b3-4fbd-bf69-ede9cd3eade6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0d061d5ff5374b848522685b2d044255)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:38.842108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1c732-90b3-4fbd-bf69-ede9cd3eade6 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:38.843707 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 582/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Jun 22 16:42:38 2022] GET /identity/v3/domains/0d061d5ff5374b848522685b2d044255 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:38.850013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587f5cf-2cff-48d5-bc21-05cc19ed6253 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:38.866483 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:38.948383 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587f5cf-2cff-48d5-bc21-05cc19ed6253 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:38.981243 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b52709-f0f9-44c2-bd2b-04cfd11d2bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:38.981892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b52709-f0f9-44c2-bd2b-04cfd11d2bd5 None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:38.982181 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b52709-f0f9-44c2-bd2b-04cfd11d2bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:38.982459 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b52709-f0f9-44c2-bd2b-04cfd11d2bd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:38.983164 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b52709-f0f9-44c2-bd2b-04cfd11d2bd5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:38.984633 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b52709-f0f9-44c2-bd2b-04cfd11d2bd5 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:39.058035 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 591/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 16:42:38 2022] POST /identity/v3/projects => generated 361 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:42:41.102763 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd8f14-5076-4724-a35a-625865571d6a None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:41.103282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd8f14-5076-4724-a35a-625865571d6a None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:41.103377 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd8f14-5076-4724-a35a-625865571d6a None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:41.104731 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 583/1174] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:42:41.109938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae845ca-ca04-4228-a93f-ed919a98e80c None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:41.110326 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae845ca-ca04-4228-a93f-ed919a98e80c None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:41.110499 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae845ca-ca04-4228-a93f-ed919a98e80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:41.127260 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-9ae845ca-ca04-4228-a93f-ed919a98e80c None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:42:41.129074 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-9ae845ca-ca04-4228-a93f-ed919a98e80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:42:41.186582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:41.192326 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 592/1175] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:42:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:42:41.216344 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd8f14-5076-4724-a35a-625865571d6a None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:41.313937 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd8f14-5076-4724-a35a-625865571d6a None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:41.322812 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:41.345948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261a006-85fc-40a1-8fc8-68ada95d2c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:41.346785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261a006-85fc-40a1-8fc8-68ada95d2c32 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:41.347092 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261a006-85fc-40a1-8fc8-68ada95d2c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:41.347365 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261a006-85fc-40a1-8fc8-68ada95d2c32 None admin] PATH_INFO: `/v3/domains/0d061d5ff5374b848522685b2d044255` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:41.348567 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261a006-85fc-40a1-8fc8-68ada95d2c32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0d061d5ff5374b848522685b2d044255)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:41.349990 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261a006-85fc-40a1-8fc8-68ada95d2c32 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:41.351578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 584/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Jun 22 16:42:41 2022] GET /identity/v3/domains/0d061d5ff5374b848522685b2d044255 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:41.357103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae845ca-ca04-4228-a93f-ed919a98e80c None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:41.451803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae845ca-ca04-4228-a93f-ed919a98e80c None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:41.484028 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0273c-0a83-4425-829d-c4fed48ef36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:41.484702 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0273c-0a83-4425-829d-c4fed48ef36c None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:41.484983 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0273c-0a83-4425-829d-c4fed48ef36c None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:41.485257 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0273c-0a83-4425-829d-c4fed48ef36c None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:41.485962 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0273c-0a83-4425-829d-c4fed48ef36c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:41.487376 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0273c-0a83-4425-829d-c4fed48ef36c None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:41.593519 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 593/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 16:42:41 2022] POST /identity/v3/users => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:42:43.648440 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f079add-a3d1-4324-a7d2-15c1b587bc94 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:43.648994 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f079add-a3d1-4324-a7d2-15c1b587bc94 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:43.648994 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f079add-a3d1-4324-a7d2-15c1b587bc94 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:43.650365 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 585/1178] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:42:43.655560 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab6557-0265-45d2-a82e-3923508d65c7 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:43.655931 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab6557-0265-45d2-a82e-3923508d65c7 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:43.656157 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab6557-0265-45d2-a82e-3923508d65c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:43.672926 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-7cab6557-0265-45d2-a82e-3923508d65c7 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:42:43.674110 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-7cab6557-0265-45d2-a82e-3923508d65c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:42:43.721308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:43.737558 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 594/1179] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:42:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:42:43.761655 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f079add-a3d1-4324-a7d2-15c1b587bc94 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:43.864427 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f079add-a3d1-4324-a7d2-15c1b587bc94 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:43.897492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ac9e7-e61f-47d0-8d3e-d25e95349ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:43.898262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ac9e7-e61f-47d0-8d3e-d25e95349ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:43.898594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ac9e7-e61f-47d0-8d3e-d25e95349ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:43.898819 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ac9e7-e61f-47d0-8d3e-d25e95349ef7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:43.908883 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ac9e7-e61f-47d0-8d3e-d25e95349ef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:42:43.916320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-979ac9e7-e61f-47d0-8d3e-d25e95349ef7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:42:43.916320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:42:43.916320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:42:43.916320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:42:43.916320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:42:43.916320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:42:43.916320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:42:43.916320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:42:43.916320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:42:43.916320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:42:43.916320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:42:43.916320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:42:43.916320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:42:43.916320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:42:43.916320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:42:43.916320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:42:43.917414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:42:43.917414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:42:43.917414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:42:43.917414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:42:43.917414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:42:43.917414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:42:43.917414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:42:43.917414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:42:43.917414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:42:43.917414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:42:43.917414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:42:43.917414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:42:43.917414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:42:43.917414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:42:43.917414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:42:43.917414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:42:43.918630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:42:43.918630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:42:43.918630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:42:43.918630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:42:43.918630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:42:43.918630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:42:43.918630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:42:43.918630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:42:43.918630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:42:43.918630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:42:43.918630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:42:43.918630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:42:43.918630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 586/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:42:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:42:43.923559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab6557-0265-45d2-a82e-3923508d65c7 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:44.020587 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab6557-0265-45d2-a82e-3923508d65c7 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:44.053188 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08ab6d-aff2-45e9-9f0b-e6191c3fbb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:44.053843 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08ab6d-aff2-45e9-9f0b-e6191c3fbb77 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:44.054128 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08ab6d-aff2-45e9-9f0b-e6191c3fbb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:44.054404 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08ab6d-aff2-45e9-9f0b-e6191c3fbb77 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:44.055163 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08ab6d-aff2-45e9-9f0b-e6191c3fbb77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:44.055472 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08ab6d-aff2-45e9-9f0b-e6191c3fbb77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:44.056872 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08ab6d-aff2-45e9-9f0b-e6191c3fbb77 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:44.064560 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 595/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:42:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:44.070739 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ac9e7-e61f-47d0-8d3e-d25e95349ef7 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:44.104015 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:44.167650 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ac9e7-e61f-47d0-8d3e-d25e95349ef7 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:44.211900 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ee114-c605-439f-a7e4-355dc13e7de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:44.212784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ee114-c605-439f-a7e4-355dc13e7de0 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:44.213064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ee114-c605-439f-a7e4-355dc13e7de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:44.213336 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ee114-c605-439f-a7e4-355dc13e7de0 None admin] PATH_INFO: `/v3/users/c573102b5d98418d961070b9b01dec78` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:44.225845 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ee114-c605-439f-a7e4-355dc13e7de0 None admin] RBAC: Authorizing `identity:get_user(user_id=c573102b5d98418d961070b9b01dec78)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:44.227262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ee114-c605-439f-a7e4-355dc13e7de0 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:44.228927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 587/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:42:44 2022] GET /identity/v3/users/c573102b5d98418d961070b9b01dec78 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:44.234659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08ab6d-aff2-45e9-9f0b-e6191c3fbb77 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:44.280520 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:44.330887 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08ab6d-aff2-45e9-9f0b-e6191c3fbb77 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:44.361862 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb0389-9ede-425e-a1e6-636592dbb6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:44.363005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb0389-9ede-425e-a1e6-636592dbb6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:44.363287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb0389-9ede-425e-a1e6-636592dbb6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:44.363558 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb0389-9ede-425e-a1e6-636592dbb6a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:44.426961 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb0389-9ede-425e-a1e6-636592dbb6a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:44.428359 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb0389-9ede-425e-a1e6-636592dbb6a9 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:44.469318 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:44.520526 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 596/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:42:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 16:42:44.526253 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ee114-c605-439f-a7e4-355dc13e7de0 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:44.615489 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:44.621669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ee114-c605-439f-a7e4-355dc13e7de0 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:44.653272 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f031bc-d990-4846-a534-af41afd9c62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:44.654110 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f031bc-d990-4846-a534-af41afd9c62c None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:44.654392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f031bc-d990-4846-a534-af41afd9c62c None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:44.654668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f031bc-d990-4846-a534-af41afd9c62c None admin] PATH_INFO: `/v3/projects/154f1e4e10634603955757dbedc225b9` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:44.655973 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f031bc-d990-4846-a534-af41afd9c62c None admin] RBAC: Authorizing `identity:get_project(project_id=154f1e4e10634603955757dbedc225b9)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:44.657925 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f031bc-d990-4846-a534-af41afd9c62c None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:44.660151 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 588/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:42:44 2022] GET /identity/v3/projects/154f1e4e10634603955757dbedc225b9 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:44.665995 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb0389-9ede-425e-a1e6-636592dbb6a9 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:44.758755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb0389-9ede-425e-a1e6-636592dbb6a9 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:44.791359 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18816a5-efeb-4050-b2eb-fe31af540f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:44.791996 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18816a5-efeb-4050-b2eb-fe31af540f92 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:44.792319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18816a5-efeb-4050-b2eb-fe31af540f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:44.792603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18816a5-efeb-4050-b2eb-fe31af540f92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:44.793435 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18816a5-efeb-4050-b2eb-fe31af540f92 None admin] RBAC: Adding query filter params (role.id=459b0e5c21c94fb1b81f76c65780fdb5, scope.project.id=154f1e4e10634603955757dbedc225b9, user.id=c573102b5d98418d961070b9b01dec78) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:44.793752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18816a5-efeb-4050-b2eb-fe31af540f92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:44.795175 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18816a5-efeb-4050-b2eb-fe31af540f92 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:44.800627 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 597/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:42:44 2022] GET /identity/v3/role_assignments?user.id=c573102b5d98418d961070b9b01dec78&scope.project.id=154f1e4e10634603955757dbedc225b9&role.id=459b0e5c21c94fb1b81f76c65780fdb5 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:46.777912 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d450880-0966-471d-be9d-7a1766e90972 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:46.778541 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d450880-0966-471d-be9d-7a1766e90972 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:46.778541 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d450880-0966-471d-be9d-7a1766e90972 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:46.779872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 589/1186] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:42:46.785450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6a176-0aeb-42d9-8a49-a5ce0d4ecdd6 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:46.785885 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6a176-0aeb-42d9-8a49-a5ce0d4ecdd6 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:46.785988 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6a176-0aeb-42d9-8a49-a5ce0d4ecdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:46.802744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-09b6a176-0aeb-42d9-8a49-a5ce0d4ecdd6 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:42:46.803905 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-09b6a176-0aeb-42d9-8a49-a5ce0d4ecdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:42:46.806549 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:46.867327 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 598/1187] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:42:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:42:46.890214 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d450880-0966-471d-be9d-7a1766e90972 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:46.991490 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d450880-0966-471d-be9d-7a1766e90972 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:47.026820 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785cc7da-47c7-4499-b9ad-8fb364e3a5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:47.027603 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cc7da-47c7-4499-b9ad-8fb364e3a5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:47.027885 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cc7da-47c7-4499-b9ad-8fb364e3a5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:47.028236 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cc7da-47c7-4499-b9ad-8fb364e3a5c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:47.038561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785cc7da-47c7-4499-b9ad-8fb364e3a5c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:42:47.046135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-785cc7da-47c7-4499-b9ad-8fb364e3a5c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:42:47.046135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:42:47.046135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:42:47.046135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:42:47.046135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:42:47.046135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:42:47.046135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:42:47.046135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:42:47.046135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:42:47.046135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:42:47.046135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:42:47.046135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:42:47.046135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:42:47.046135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:42:47.046135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:42:47.046135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:42:47.047326 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:42:47.047326 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:42:47.047326 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:42:47.047326 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:42:47.047326 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:42:47.047326 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:42:47.047326 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:42:47.047326 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:42:47.047326 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:42:47.047326 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:42:47.047326 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:42:47.047326 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:42:47.047326 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:42:47.047326 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:42:47.047326 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:42:47.047326 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:42:47.048517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:42:47.048517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:42:47.048517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:42:47.048517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:42:47.048517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:42:47.048517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:42:47.048517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:42:47.048517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:42:47.048517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:42:47.048517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:42:47.048517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:42:47.048517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:42:47.048517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 590/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:42:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:42:47.053363 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6a176-0aeb-42d9-8a49-a5ce0d4ecdd6 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:47.146770 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6a176-0aeb-42d9-8a49-a5ce0d4ecdd6 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:47.179171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a088a-d5b7-4999-8293-8f25d92b221a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:47.179821 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a088a-d5b7-4999-8293-8f25d92b221a None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:47.180135 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a088a-d5b7-4999-8293-8f25d92b221a None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:47.180404 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a088a-d5b7-4999-8293-8f25d92b221a None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:47.181150 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a088a-d5b7-4999-8293-8f25d92b221a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:47.181457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a088a-d5b7-4999-8293-8f25d92b221a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:47.182825 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a088a-d5b7-4999-8293-8f25d92b221a None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:47.190791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 599/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:42:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:47.196468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785cc7da-47c7-4499-b9ad-8fb364e3a5c3 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:47.220786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:47.295257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785cc7da-47c7-4499-b9ad-8fb364e3a5c3 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:47.326514 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7eafc-b43a-46d2-bea9-25da26af5c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:47.327356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7eafc-b43a-46d2-bea9-25da26af5c61 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:47.327634 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7eafc-b43a-46d2-bea9-25da26af5c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:47.327908 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7eafc-b43a-46d2-bea9-25da26af5c61 None admin] PATH_INFO: `/v3/users/c573102b5d98418d961070b9b01dec78` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:47.329109 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7eafc-b43a-46d2-bea9-25da26af5c61 None admin] RBAC: Authorizing `identity:get_user(user_id=c573102b5d98418d961070b9b01dec78)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:47.330519 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7eafc-b43a-46d2-bea9-25da26af5c61 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:47.332740 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 591/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:42:47 2022] GET /identity/v3/users/c573102b5d98418d961070b9b01dec78 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:47.338465 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a088a-d5b7-4999-8293-8f25d92b221a None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:47.341304 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:47.435057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a088a-d5b7-4999-8293-8f25d92b221a None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:47.467278 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a36a3-a6d7-4b16-bb94-16ae4302482b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:47.468129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a36a3-a6d7-4b16-bb94-16ae4302482b None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:47.468420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a36a3-a6d7-4b16-bb94-16ae4302482b None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:47.468699 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a36a3-a6d7-4b16-bb94-16ae4302482b None admin] PATH_INFO: `/v3/projects/154f1e4e10634603955757dbedc225b9` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:47.469860 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a36a3-a6d7-4b16-bb94-16ae4302482b None admin] RBAC: Authorizing `identity:get_project(project_id=154f1e4e10634603955757dbedc225b9)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:47.471279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a36a3-a6d7-4b16-bb94-16ae4302482b None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:47.473016 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 600/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:42:47 2022] GET /identity/v3/projects/154f1e4e10634603955757dbedc225b9 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:47.478711 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7eafc-b43a-46d2-bea9-25da26af5c61 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:47.572672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:47.581841 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7eafc-b43a-46d2-bea9-25da26af5c61 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:47.615188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6dfe7-797f-4a59-9c2a-63a1e51c9257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:47.616055 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6dfe7-797f-4a59-9c2a-63a1e51c9257 None admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:47.616367 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6dfe7-797f-4a59-9c2a-63a1e51c9257 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:47.616657 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6dfe7-797f-4a59-9c2a-63a1e51c9257 None admin] PATH_INFO: `/v3/projects/154f1e4e10634603955757dbedc225b9/users/c573102b5d98418d961070b9b01dec78/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:47.618574 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6dfe7-797f-4a59-9c2a-63a1e51c9257 None admin] RBAC: Authorizing `identity:create_grant(project_id=154f1e4e10634603955757dbedc225b9, user_id=c573102b5d98418d961070b9b01dec78, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:47.620026 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6dfe7-797f-4a59-9c2a-63a1e51c9257 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:47.672634 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 592/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:42:47 2022] PUT /identity/v3/projects/154f1e4e10634603955757dbedc225b9/users/c573102b5d98418d961070b9b01dec78/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:42:49.649253 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8bf54-bfb0-4681-9cb4-c5f6a6242669 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:49.649805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8bf54-bfb0-4681-9cb4-c5f6a6242669 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:49.649805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8bf54-bfb0-4681-9cb4-c5f6a6242669 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:49.651184 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 601/1193] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:42:49.656269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c971ea-3530-46a4-b1dc-3a03a4b7868d None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:49.656649 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c971ea-3530-46a4-b1dc-3a03a4b7868d None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:49.656828 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c971ea-3530-46a4-b1dc-3a03a4b7868d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:49.673695 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-86c971ea-3530-46a4-b1dc-3a03a4b7868d None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:42:49.674896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-86c971ea-3530-46a4-b1dc-3a03a4b7868d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:42:49.741009 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 593/1194] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:42:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:42:49.764758 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8bf54-bfb0-4681-9cb4-c5f6a6242669 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:49.832083 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:49.861010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8bf54-bfb0-4681-9cb4-c5f6a6242669 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:49.892861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf600b-1667-4816-91e2-5715387df1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:49.894222 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf600b-1667-4816-91e2-5715387df1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:49.894507 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf600b-1667-4816-91e2-5715387df1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:49.894781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf600b-1667-4816-91e2-5715387df1e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:49.904398 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf600b-1667-4816-91e2-5715387df1e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:42:49.912000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-0cdf600b-1667-4816-91e2-5715387df1e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:42:49.912000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:42:49.912000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:42:49.912000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:42:49.912000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:42:49.912000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:42:49.912000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:42:49.912000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:42:49.912000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:42:49.912000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:42:49.912000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:42:49.912000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:42:49.912000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:42:49.912000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:42:49.912000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:42:49.912000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:42:49.913287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:42:49.913287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:42:49.913287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:42:49.913287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:42:49.913287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:42:49.913287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:42:49.913287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:42:49.913287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:42:49.913287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:42:49.913287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:42:49.913287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:42:49.913287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:42:49.913287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:42:49.913287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:42:49.913287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:42:49.913287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:42:49.914533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:42:49.914533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:42:49.914533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:42:49.914533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:42:49.914533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:42:49.914533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:42:49.914533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:42:49.914533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:42:49.914533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:42:49.914533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:42:49.914533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:42:49.914533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:42:49.914533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 602/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:42:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:42:49.918941 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c971ea-3530-46a4-b1dc-3a03a4b7868d None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:49.994537 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:50.013210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c971ea-3530-46a4-b1dc-3a03a4b7868d None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:50.045872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5a893-c54d-449c-bc4b-49e5f4b67e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:50.046526 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5a893-c54d-449c-bc4b-49e5f4b67e44 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:50.046807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5a893-c54d-449c-bc4b-49e5f4b67e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:50.047080 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5a893-c54d-449c-bc4b-49e5f4b67e44 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:50.047821 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5a893-c54d-449c-bc4b-49e5f4b67e44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:50.048150 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5a893-c54d-449c-bc4b-49e5f4b67e44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:50.049502 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5a893-c54d-449c-bc4b-49e5f4b67e44 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:50.058350 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 594/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:42:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:50.063965 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf600b-1667-4816-91e2-5715387df1e7 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:50.159180 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf600b-1667-4816-91e2-5715387df1e7 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:50.185706 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:50.191740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501ff3b-42be-4526-a5fa-74c6d827c83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:50.192620 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501ff3b-42be-4526-a5fa-74c6d827c83e None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:50.192906 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501ff3b-42be-4526-a5fa-74c6d827c83e None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:50.198798 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501ff3b-42be-4526-a5fa-74c6d827c83e None admin] PATH_INFO: `/v3/users/c573102b5d98418d961070b9b01dec78` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:50.198798 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501ff3b-42be-4526-a5fa-74c6d827c83e None admin] RBAC: Authorizing `identity:get_user(user_id=c573102b5d98418d961070b9b01dec78)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:50.198798 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501ff3b-42be-4526-a5fa-74c6d827c83e None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:50.198798 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 603/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jun 22 16:42:50 2022] GET /identity/v3/users/c573102b5d98418d961070b9b01dec78 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:50.202775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5a893-c54d-449c-bc4b-49e5f4b67e44 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:50.299171 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5a893-c54d-449c-bc4b-49e5f4b67e44 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:50.331656 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a4109-9fe9-451e-9dc1-9dd1a75d6826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:50.332314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a4109-9fe9-451e-9dc1-9dd1a75d6826 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:50.332603 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a4109-9fe9-451e-9dc1-9dd1a75d6826 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:50.332881 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a4109-9fe9-451e-9dc1-9dd1a75d6826 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:50.344117 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:50.397958 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a4109-9fe9-451e-9dc1-9dd1a75d6826 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:50.399392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a4109-9fe9-451e-9dc1-9dd1a75d6826 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:50.493372 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 595/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:42:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 16:42:50.499071 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501ff3b-42be-4526-a5fa-74c6d827c83e None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:50.593813 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501ff3b-42be-4526-a5fa-74c6d827c83e None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:50.626396 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788ab59-b635-481e-8f62-56a65a025ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:50.627232 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788ab59-b635-481e-8f62-56a65a025ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:50.627518 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788ab59-b635-481e-8f62-56a65a025ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:50.627796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788ab59-b635-481e-8f62-56a65a025ce1 None admin] PATH_INFO: `/v3/projects/154f1e4e10634603955757dbedc225b9` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:50.629016 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788ab59-b635-481e-8f62-56a65a025ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=154f1e4e10634603955757dbedc225b9)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:50.630435 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788ab59-b635-481e-8f62-56a65a025ce1 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:50.632115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 604/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jun 22 16:42:50 2022] GET /identity/v3/projects/154f1e4e10634603955757dbedc225b9 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:42:50.638258 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a4109-9fe9-451e-9dc1-9dd1a75d6826 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:42:50.679765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:42:50.738958 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a4109-9fe9-451e-9dc1-9dd1a75d6826 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:42:50.772472 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381da3d-4a65-4e55-b5ed-0be0d4ca005c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:42:50.773050 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381da3d-4a65-4e55-b5ed-0be0d4ca005c None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:42:50.773333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381da3d-4a65-4e55-b5ed-0be0d4ca005c None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:42:50.773609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381da3d-4a65-4e55-b5ed-0be0d4ca005c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:42:50.774431 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381da3d-4a65-4e55-b5ed-0be0d4ca005c None admin] RBAC: Adding query filter params (role.id=459b0e5c21c94fb1b81f76c65780fdb5, scope.project.id=154f1e4e10634603955757dbedc225b9, user.id=c573102b5d98418d961070b9b01dec78) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:42:50.774743 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381da3d-4a65-4e55-b5ed-0be0d4ca005c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:42:50.776165 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381da3d-4a65-4e55-b5ed-0be0d4ca005c None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:42:50.781826 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 596/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:42:50 2022] GET /identity/v3/role_assignments?user.id=c573102b5d98418d961070b9b01dec78&scope.project.id=154f1e4e10634603955757dbedc225b9&role.id=459b0e5c21c94fb1b81f76c65780fdb5 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:43:00.622394 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=67 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:43:00.779195 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=47 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:02.282671 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1844d1b-8eb3-40df-868c-b21cfe45e46b None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:02.283218 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1844d1b-8eb3-40df-868c-b21cfe45e46b None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:02.283218 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1844d1b-8eb3-40df-868c-b21cfe45e46b None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:02.284575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 605/1201] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:44:02.289698 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea4cd1-a297-467b-84c1-5c6ae8a5e455 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:02.290133 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea4cd1-a297-467b-84c1-5c6ae8a5e455 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:02.290258 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea4cd1-a297-467b-84c1-5c6ae8a5e455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:02.306768 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-9fea4cd1-a297-467b-84c1-5c6ae8a5e455 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:44:02.307939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-9fea4cd1-a297-467b-84c1-5c6ae8a5e455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:44:02.373663 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 597/1202] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:44:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:44:02.398822 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1844d1b-8eb3-40df-868c-b21cfe45e46b None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:02.498160 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1844d1b-8eb3-40df-868c-b21cfe45e46b None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:02.531098 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732ffdb-353b-47b6-b931-7ec9e909ade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:02.531868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732ffdb-353b-47b6-b931-7ec9e909ade2 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:02.532178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732ffdb-353b-47b6-b931-7ec9e909ade2 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:02.532456 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732ffdb-353b-47b6-b931-7ec9e909ade2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:02.543569 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732ffdb-353b-47b6-b931-7ec9e909ade2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:02.544983 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732ffdb-353b-47b6-b931-7ec9e909ade2 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:02.562245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-7732ffdb-353b-47b6-b931-7ec9e909ade2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:02.562245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:02.562245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:02.562245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:02.562245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:02.562245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:02.562245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:02.562245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:02.562245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:02.562245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:02.562245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:02.562245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:02.562245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:44:02.562245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:44:02.562245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:44:02.563210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:44:02.563210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:02.563210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:02.563210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:02.563210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:02.563210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:02.563210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:02.563210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:02.563210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:02.563210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:02.563210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:02.563210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:02.563210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:02.563210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:02.563210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:02.563210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:02.563210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:02.564331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:44:02.564331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:44:02.564331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:02.564331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:44:02.564331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 606/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:02.569412 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea4cd1-a297-467b-84c1-5c6ae8a5e455 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:02.669350 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea4cd1-a297-467b-84c1-5c6ae8a5e455 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:02.697580 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:02.702969 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c68ae-ac42-49e7-91d9-762fcff82cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:02.703621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c68ae-ac42-49e7-91d9-762fcff82cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:02.703903 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c68ae-ac42-49e7-91d9-762fcff82cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:02.704207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c68ae-ac42-49e7-91d9-762fcff82cc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:02.704923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c68ae-ac42-49e7-91d9-762fcff82cc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:02.705228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c68ae-ac42-49e7-91d9-762fcff82cc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:02.706580 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c68ae-ac42-49e7-91d9-762fcff82cc7 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:02.717832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 598/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:02.723501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732ffdb-353b-47b6-b931-7ec9e909ade2 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:02.781557 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:02.827426 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732ffdb-353b-47b6-b931-7ec9e909ade2 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:02.859485 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440b1df-96a3-4cc0-9ea8-9c84549ff3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:02.860406 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440b1df-96a3-4cc0-9ea8-9c84549ff3bb None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:02.860735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440b1df-96a3-4cc0-9ea8-9c84549ff3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:02.861237 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440b1df-96a3-4cc0-9ea8-9c84549ff3bb None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:02.862006 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440b1df-96a3-4cc0-9ea8-9c84549ff3bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:02.863990 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440b1df-96a3-4cc0-9ea8-9c84549ff3bb None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:02.957242 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 607/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jun 22 16:44:02 2022] POST /identity/v3/users => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:44:04.995568 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb0c95-6740-482b-90f4-f8deffbe7098 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:04.996269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb0c95-6740-482b-90f4-f8deffbe7098 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:04.996269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb0c95-6740-482b-90f4-f8deffbe7098 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:04.997556 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 599/1206] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:44:05.002611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef9140-bae8-4c5d-8a7f-e716cf4dfc6f None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:05.003044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef9140-bae8-4c5d-8a7f-e716cf4dfc6f None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:05.003178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef9140-bae8-4c5d-8a7f-e716cf4dfc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:05.020735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-adef9140-bae8-4c5d-8a7f-e716cf4dfc6f None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:44:05.021925 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-adef9140-bae8-4c5d-8a7f-e716cf4dfc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:44:05.086327 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 608/1207] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:44:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:44:05.110148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb0c95-6740-482b-90f4-f8deffbe7098 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:05.207477 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb0c95-6740-482b-90f4-f8deffbe7098 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:05.239416 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3a37d-8585-404f-a1c3-6461545fb26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:05.240216 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3a37d-8585-404f-a1c3-6461545fb26b None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:05.240499 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3a37d-8585-404f-a1c3-6461545fb26b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:05.240768 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3a37d-8585-404f-a1c3-6461545fb26b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:05.252156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3a37d-8585-404f-a1c3-6461545fb26b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:44:05.259703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-9fa3a37d-8585-404f-a1c3-6461545fb26b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:44:05.259703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:05.259703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:05.259703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:05.259703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:05.259703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:05.259703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:05.259703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:05.259703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:05.259703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:05.259703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:05.259703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:05.259703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:44:05.259703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:44:05.259703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:44:05.259703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:44:05.260923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:44:05.260923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:44:05.260923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:44:05.260923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:44:05.260923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:05.260923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:05.260923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:05.260923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:05.260923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:05.260923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:05.260923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:05.260923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:05.260923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:05.260923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:05.260923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:05.260923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:05.261859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:05.261859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:05.261859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:05.261859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:05.261859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:44:05.261859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:44:05.261859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:44:05.261859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:44:05.261859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:44:05.261859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:44:05.261859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:44:05.261859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:05.261859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 600/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:44:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:05.267195 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef9140-bae8-4c5d-8a7f-e716cf4dfc6f None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:05.305508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:05.362425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef9140-bae8-4c5d-8a7f-e716cf4dfc6f None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:05.396034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cdfc6-9782-42b8-ac29-96ad99425993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:05.396758 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cdfc6-9782-42b8-ac29-96ad99425993 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:05.397045 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cdfc6-9782-42b8-ac29-96ad99425993 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:05.397322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cdfc6-9782-42b8-ac29-96ad99425993 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:05.398584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cdfc6-9782-42b8-ac29-96ad99425993 None admin] RBAC: Adding query filter params (name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:05.398895 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cdfc6-9782-42b8-ac29-96ad99425993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:05.400299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cdfc6-9782-42b8-ac29-96ad99425993 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:05.408158 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 609/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 16:44:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:05.414552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3a37d-8585-404f-a1c3-6461545fb26b None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:05.463314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:05.512791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3a37d-8585-404f-a1c3-6461545fb26b None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:05.546038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482a804-0ff2-40ed-89ad-b63979a004c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:05.546807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482a804-0ff2-40ed-89ad-b63979a004c4 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:05.547085 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482a804-0ff2-40ed-89ad-b63979a004c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:05.547356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482a804-0ff2-40ed-89ad-b63979a004c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:05.557823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482a804-0ff2-40ed-89ad-b63979a004c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:05.561783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482a804-0ff2-40ed-89ad-b63979a004c4 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:05.576191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-1482a804-0ff2-40ed-89ad-b63979a004c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:05.576191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:05.576191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:05.576191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:05.576191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:05.576191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:05.576191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:05.576191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:05.576191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:05.576191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:05.576191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:05.576191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:05.576191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:44:05.576191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:44:05.576191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:44:05.577237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:44:05.577237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:05.577237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:05.577237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:05.577237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:05.577237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:05.577237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:05.577237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:05.577237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:05.577237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:05.577237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:05.577237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:05.577237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:05.577237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:05.577237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:05.577237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:05.577237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:05.583212 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:44:05.583212 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:44:05.583212 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:05.583212 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:05.583212 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 601/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:05.583571 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cdfc6-9782-42b8-ac29-96ad99425993 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:05.677384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:05.680372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cdfc6-9782-42b8-ac29-96ad99425993 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:05.712115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90a5de-f0a3-4a15-8a31-50fda8d61500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:05.712782 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90a5de-f0a3-4a15-8a31-50fda8d61500 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:05.713073 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90a5de-f0a3-4a15-8a31-50fda8d61500 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:05.713350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90a5de-f0a3-4a15-8a31-50fda8d61500 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:05.714061 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90a5de-f0a3-4a15-8a31-50fda8d61500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:05.714367 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90a5de-f0a3-4a15-8a31-50fda8d61500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:05.715715 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90a5de-f0a3-4a15-8a31-50fda8d61500 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:05.727373 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 610/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:05.732989 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482a804-0ff2-40ed-89ad-b63979a004c4 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:05.831679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482a804-0ff2-40ed-89ad-b63979a004c4 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:05.833160 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:05.864279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a68c2c-7efe-4d5b-a8e6-82bb0f6cf863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:05.865063 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a68c2c-7efe-4d5b-a8e6-82bb0f6cf863 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:05.865343 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a68c2c-7efe-4d5b-a8e6-82bb0f6cf863 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:05.865616 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a68c2c-7efe-4d5b-a8e6-82bb0f6cf863 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:05.872773 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a68c2c-7efe-4d5b-a8e6-82bb0f6cf863 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:05.874192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a68c2c-7efe-4d5b-a8e6-82bb0f6cf863 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:05.888523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-83a68c2c-7efe-4d5b-a8e6-82bb0f6cf863 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 16:44:05.888523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:05.888523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:05.888523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:05.888523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:05.888523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:05.888523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:05.888523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:05.888523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:05.888523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:05.888523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:05.888523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:05.888523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:44:05.888523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:44:05.888523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:44:05.888523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:44:05.889702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:05.889702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:05.889702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:44:05.889702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:44:05.889702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:44:05.889702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:44:05.889702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:05.889702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:05.889702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:05.889702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:05.889702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:05.889702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:05.889702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:05.889702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:05.889702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:05.889702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:05.889702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:05.889702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:05.890976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:05.890976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:05.890976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:44:05.890976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:44:05.890976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:44:05.890976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:44:05.890976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:44:05.890976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:44:05.890976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 16:44:05.890976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:05.890976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 602/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:44:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:05.895786 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90a5de-f0a3-4a15-8a31-50fda8d61500 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:05.993609 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90a5de-f0a3-4a15-8a31-50fda8d61500 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:06.029182 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3dfe03-ad19-4cc6-ab53-17ee38bd6cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:06.029854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dfe03-ad19-4cc6-ab53-17ee38bd6cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:06.030137 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dfe03-ad19-4cc6-ab53-17ee38bd6cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:06.030409 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dfe03-ad19-4cc6-ab53-17ee38bd6cd7 None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:06.031243 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3dfe03-ad19-4cc6-ab53-17ee38bd6cd7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:06.031548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3dfe03-ad19-4cc6-ab53-17ee38bd6cd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:06.033040 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3dfe03-ad19-4cc6-ab53-17ee38bd6cd7 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:06.049589 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 611/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jun 22 16:44:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:06.055997 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a68c2c-7efe-4d5b-a8e6-82bb0f6cf863 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:06.166262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a68c2c-7efe-4d5b-a8e6-82bb0f6cf863 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:06.199075 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b384c-686f-49d6-8f25-c8566c087afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:06.199707 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b384c-686f-49d6-8f25-c8566c087afc None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:06.199985 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b384c-686f-49d6-8f25-c8566c087afc None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:06.200289 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b384c-686f-49d6-8f25-c8566c087afc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:06.228587 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:06.267003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b384c-686f-49d6-8f25-c8566c087afc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:06.268472 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b384c-686f-49d6-8f25-c8566c087afc None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:06.365022 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 603/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:44:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 16:44:06.371434 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3dfe03-ad19-4cc6-ab53-17ee38bd6cd7 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:06.390716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:06.469097 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3dfe03-ad19-4cc6-ab53-17ee38bd6cd7 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:06.502602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1532b5-af87-4235-9fbc-49ec7c805aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:06.503552 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1532b5-af87-4235-9fbc-49ec7c805aad None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:06.503830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1532b5-af87-4235-9fbc-49ec7c805aad None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:06.504136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1532b5-af87-4235-9fbc-49ec7c805aad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:06.513808 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1532b5-af87-4235-9fbc-49ec7c805aad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:06.515506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1532b5-af87-4235-9fbc-49ec7c805aad None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:06.533295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-ee1532b5-af87-4235-9fbc-49ec7c805aad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:06.533295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:06.533295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:06.533295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:06.533295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:06.533295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:06.533295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:06.533295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:06.533295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:06.533295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:06.533295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:06.533295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:06.533295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:44:06.533295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:44:06.533295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:44:06.534199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:44:06.534199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:06.534199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:06.534199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:06.534199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:06.534199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:06.534199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:06.534199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:06.534199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:06.534199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:06.534199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:06.534199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:06.534199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:06.534199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:06.534199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:06.534199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:06.534199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:06.535159 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:44:06.535159 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:44:06.535159 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:06.535159 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:44:06.535159 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 612/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:06.540895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b384c-686f-49d6-8f25-c8566c087afc None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:06.598870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:06.636402 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b384c-686f-49d6-8f25-c8566c087afc None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:06.670793 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc938fc-7c9f-431a-b3b9-ccb058322a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:06.671479 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc938fc-7c9f-431a-b3b9-ccb058322a05 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:06.671764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc938fc-7c9f-431a-b3b9-ccb058322a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:06.672043 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc938fc-7c9f-431a-b3b9-ccb058322a05 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:06.672805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc938fc-7c9f-431a-b3b9-ccb058322a05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:06.673114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc938fc-7c9f-431a-b3b9-ccb058322a05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:06.674471 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc938fc-7c9f-431a-b3b9-ccb058322a05 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:06.686154 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 604/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:06.691660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1532b5-af87-4235-9fbc-49ec7c805aad None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:06.758948 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:06.787674 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1532b5-af87-4235-9fbc-49ec7c805aad None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:06.824309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df901a-d190-4346-a5cb-5d7386b2a45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:06.825085 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df901a-d190-4346-a5cb-5d7386b2a45d None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:06.825371 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df901a-d190-4346-a5cb-5d7386b2a45d None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:06.825652 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df901a-d190-4346-a5cb-5d7386b2a45d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:06.832014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df901a-d190-4346-a5cb-5d7386b2a45d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:06.833473 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df901a-d190-4346-a5cb-5d7386b2a45d None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:06.847320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-23df901a-d190-4346-a5cb-5d7386b2a45d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:44:06.847320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:06.847320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:06.847320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:06.847320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:06.847320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:06.847320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:06.847320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:06.847320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:06.847320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:06.847320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:06.847320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:06.847320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:44:06.847320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:44:06.847320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:44:06.853145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:44:06.853145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:06.853145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:06.853145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:06.853145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:06.853145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:06.853145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:06.853145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:06.853145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:06.853145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:06.853145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:06.853145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:06.853145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:06.853145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:06.853145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:06.853145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:06.853145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:06.854308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:44:06.854308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:44:06.854308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:44:06.854308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:44:06.854308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:44:06.854308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:44:06.854308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:44:06.854308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:44:06.854308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 613/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:44:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:06.855077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc938fc-7c9f-431a-b3b9-ccb058322a05 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:06.952988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc938fc-7c9f-431a-b3b9-ccb058322a05 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:06.974660 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:06.986465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b20df0-3ea6-4953-af41-ecbe36893401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:06.987108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b20df0-3ea6-4953-af41-ecbe36893401 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:06.987391 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b20df0-3ea6-4953-af41-ecbe36893401 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:06.987666 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b20df0-3ea6-4953-af41-ecbe36893401 None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:06.988486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b20df0-3ea6-4953-af41-ecbe36893401 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:06.988798 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b20df0-3ea6-4953-af41-ecbe36893401 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:06.990313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b20df0-3ea6-4953-af41-ecbe36893401 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:07.002323 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 605/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:44:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:07.008522 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df901a-d190-4346-a5cb-5d7386b2a45d None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:07.106876 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df901a-d190-4346-a5cb-5d7386b2a45d None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:07.133359 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:07.138915 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe34a8e-6aa6-461c-b22a-a95fb9410c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:07.139558 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe34a8e-6aa6-461c-b22a-a95fb9410c41 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:07.140213 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe34a8e-6aa6-461c-b22a-a95fb9410c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:07.140492 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe34a8e-6aa6-461c-b22a-a95fb9410c41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:07.141322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe34a8e-6aa6-461c-b22a-a95fb9410c41 None admin] RBAC: Adding query filter params (role.id=acb8e1bf2db94178bdd6fc69b191d6b0, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=5a79a71fa89446c3abbb4fdbf2c93aac) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:07.141635 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe34a8e-6aa6-461c-b22a-a95fb9410c41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:07.143061 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe34a8e-6aa6-461c-b22a-a95fb9410c41 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:07.148888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 614/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:44:07 2022] GET /identity/v3/role_assignments?user.id=5a79a71fa89446c3abbb4fdbf2c93aac&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=acb8e1bf2db94178bdd6fc69b191d6b0 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:09.125452 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b8a98-eaef-4894-9128-3f92c2c61d70 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:09.126027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b8a98-eaef-4894-9128-3f92c2c61d70 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:09.126129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b8a98-eaef-4894-9128-3f92c2c61d70 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:09.127474 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 606/1220] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:44:09.132759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ecfd5-88bc-40b9-b15c-bd9f830ab4a3 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:09.133181 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ecfd5-88bc-40b9-b15c-bd9f830ab4a3 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:09.133317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ecfd5-88bc-40b9-b15c-bd9f830ab4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:09.150456 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-351ecfd5-88bc-40b9-b15c-bd9f830ab4a3 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:44:09.151623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-351ecfd5-88bc-40b9-b15c-bd9f830ab4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:44:09.215398 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 615/1221] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:44:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:44:09.238502 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b8a98-eaef-4894-9128-3f92c2c61d70 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:09.339248 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b8a98-eaef-4894-9128-3f92c2c61d70 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:09.372677 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb95e9-0e87-42e5-9205-1ef69584af3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:09.373449 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb95e9-0e87-42e5-9205-1ef69584af3f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:09.373733 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb95e9-0e87-42e5-9205-1ef69584af3f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:09.374008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb95e9-0e87-42e5-9205-1ef69584af3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:09.383822 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb95e9-0e87-42e5-9205-1ef69584af3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:44:09.391977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-6ecb95e9-0e87-42e5-9205-1ef69584af3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:44:09.391977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:09.391977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:09.391977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:09.391977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:09.391977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:09.391977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:09.391977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:09.391977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:09.391977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:09.391977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:09.391977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:09.391977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:44:09.391977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:44:09.391977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:44:09.391977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:44:09.393209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:44:09.393209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:44:09.393209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:44:09.393209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:44:09.393209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:09.393209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:09.393209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:09.393209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:09.393209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:09.393209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:09.393209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:09.393209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:09.393209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:09.393209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:09.393209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:09.393209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:09.394298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:09.394298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:09.394298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:09.394298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:09.394298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:44:09.394298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:44:09.394298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:44:09.394298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:44:09.394298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:44:09.394298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:44:09.394298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:44:09.394298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:09.394298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 607/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:44:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:09.399825 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ecfd5-88bc-40b9-b15c-bd9f830ab4a3 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:09.495675 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ecfd5-88bc-40b9-b15c-bd9f830ab4a3 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:09.518403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:09.529151 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb57f2f-c2cd-4d2a-b753-2f44c87b50e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:09.529813 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb57f2f-c2cd-4d2a-b753-2f44c87b50e1 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:09.530102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb57f2f-c2cd-4d2a-b753-2f44c87b50e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:09.530387 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb57f2f-c2cd-4d2a-b753-2f44c87b50e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:09.531140 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb57f2f-c2cd-4d2a-b753-2f44c87b50e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:09.531450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb57f2f-c2cd-4d2a-b753-2f44c87b50e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:09.532863 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb57f2f-c2cd-4d2a-b753-2f44c87b50e1 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:09.540490 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 616/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 16:44:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:09.546237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb95e9-0e87-42e5-9205-1ef69584af3f None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:09.589361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:09.644773 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb95e9-0e87-42e5-9205-1ef69584af3f None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:09.678167 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3765239-680a-43da-b099-9ae1eadada3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:09.678959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3765239-680a-43da-b099-9ae1eadada3d None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:09.679225 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3765239-680a-43da-b099-9ae1eadada3d None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:09.679502 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3765239-680a-43da-b099-9ae1eadada3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:09.689774 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3765239-680a-43da-b099-9ae1eadada3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:09.691222 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3765239-680a-43da-b099-9ae1eadada3d None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:09.708316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-d3765239-680a-43da-b099-9ae1eadada3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:09.708316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:09.708316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:09.708316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:09.708316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:09.708316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:09.708316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:09.708316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:09.708316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:09.708316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:09.708316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:09.708316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:09.708316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:44:09.708316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:44:09.708316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:44:09.709209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:44:09.709209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:09.709209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:09.709209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:09.709209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:09.709209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:09.709209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:09.709209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:09.709209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:09.709209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:09.709209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:09.709209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:09.709209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:09.709209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:09.709209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:09.709209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:09.709209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:09.710207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:44:09.710207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:44:09.710207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:09.710207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:09.710207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 608/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:44:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:09.715831 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb57f2f-c2cd-4d2a-b753-2f44c87b50e1 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:09.813140 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb57f2f-c2cd-4d2a-b753-2f44c87b50e1 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:09.846313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3494b-99dc-41b5-a846-f9cc761542c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:09.846960 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3494b-99dc-41b5-a846-f9cc761542c1 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:09.847264 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3494b-99dc-41b5-a846-f9cc761542c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:09.847612 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3494b-99dc-41b5-a846-f9cc761542c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:09.848373 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3494b-99dc-41b5-a846-f9cc761542c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:09.848685 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3494b-99dc-41b5-a846-f9cc761542c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:09.850042 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3494b-99dc-41b5-a846-f9cc761542c1 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:09.861571 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 617/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:09.867785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3765239-680a-43da-b099-9ae1eadada3d None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:09.961493 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:09.968120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3765239-680a-43da-b099-9ae1eadada3d None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:10.000176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6043e-7923-45fe-8423-0d2e32ff38fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:10.000962 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6043e-7923-45fe-8423-0d2e32ff38fd None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:10.001243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6043e-7923-45fe-8423-0d2e32ff38fd None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:10.001514 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6043e-7923-45fe-8423-0d2e32ff38fd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:10.009636 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6043e-7923-45fe-8423-0d2e32ff38fd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:10.011179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6043e-7923-45fe-8423-0d2e32ff38fd None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:10.025724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-ffa6043e-7923-45fe-8423-0d2e32ff38fd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 16:44:10.025724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:10.025724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:10.025724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:10.025724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:10.025724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:10.025724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:10.025724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:10.025724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:10.025724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:10.025724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:10.025724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:10.025724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:44:10.025724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:44:10.025724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:44:10.025724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:44:10.026876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:10.026876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:10.026876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:44:10.026876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:44:10.026876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:44:10.026876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:44:10.026876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:10.026876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:10.026876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:10.026876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:10.026876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:10.026876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:10.026876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:10.026876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:10.026876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:10.026876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:10.026876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:10.026876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:10.028089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:10.028089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:10.028089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:44:10.028089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:44:10.028089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:44:10.028089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:44:10.028089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:44:10.028089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:44:10.028089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 16:44:10.028089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:10.028089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 609/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:44:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:10.032730 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3494b-99dc-41b5-a846-f9cc761542c1 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:10.079630 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:10.136696 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3494b-99dc-41b5-a846-f9cc761542c1 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:10.169413 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6bc91-f363-4b15-a4d3-e046aa5eda78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:10.170196 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6bc91-f363-4b15-a4d3-e046aa5eda78 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:10.170498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6bc91-f363-4b15-a4d3-e046aa5eda78 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:10.170777 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6bc91-f363-4b15-a4d3-e046aa5eda78 None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:10.171626 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6bc91-f363-4b15-a4d3-e046aa5eda78 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:10.172034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6bc91-f363-4b15-a4d3-e046aa5eda78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:10.173499 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6bc91-f363-4b15-a4d3-e046aa5eda78 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:10.191133 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 618/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jun 22 16:44:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:10.197438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6043e-7923-45fe-8423-0d2e32ff38fd None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:10.294577 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6043e-7923-45fe-8423-0d2e32ff38fd None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:10.327577 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f9dfb-dd35-476f-b277-bd93fc194779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:10.328389 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f9dfb-dd35-476f-b277-bd93fc194779 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:10.328674 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f9dfb-dd35-476f-b277-bd93fc194779 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:10.328951 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f9dfb-dd35-476f-b277-bd93fc194779 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:10.339242 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f9dfb-dd35-476f-b277-bd93fc194779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:10.340718 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f9dfb-dd35-476f-b277-bd93fc194779 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:10.357775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-847f9dfb-dd35-476f-b277-bd93fc194779 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:10.357775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:10.357775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:10.357775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:10.357775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:10.357775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:10.357775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:10.357775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:10.357775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:10.357775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:10.357775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:10.357775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:10.357775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:44:10.357775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:44:10.357775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:44:10.358875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:44:10.358875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:10.358875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:10.358875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:10.358875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:10.358875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:10.358875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:10.358875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:10.358875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:10.358875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:10.358875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:10.358875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:10.358875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:10.358875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:10.358875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:10.358875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:10.358875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:10.360013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:44:10.360013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:44:10.360013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:10.360013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:10.360013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 610/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:10.364780 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6bc91-f363-4b15-a4d3-e046aa5eda78 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:10.462184 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6bc91-f363-4b15-a4d3-e046aa5eda78 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:10.464862 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:10.496332 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03705d-5afe-4b3e-8620-8b3ecba12fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:10.496988 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03705d-5afe-4b3e-8620-8b3ecba12fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:10.497275 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03705d-5afe-4b3e-8620-8b3ecba12fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:10.497561 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03705d-5afe-4b3e-8620-8b3ecba12fa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:10.498342 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03705d-5afe-4b3e-8620-8b3ecba12fa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:10.498651 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03705d-5afe-4b3e-8620-8b3ecba12fa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:10.500017 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03705d-5afe-4b3e-8620-8b3ecba12fa1 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:10.510784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 619/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:10.516799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f9dfb-dd35-476f-b277-bd93fc194779 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:10.525971 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:10.612681 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f9dfb-dd35-476f-b277-bd93fc194779 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:10.644734 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597aab07-e496-4912-916b-e3534d12ce6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:10.645509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597aab07-e496-4912-916b-e3534d12ce6f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:10.645790 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597aab07-e496-4912-916b-e3534d12ce6f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:10.646062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597aab07-e496-4912-916b-e3534d12ce6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:10.652993 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597aab07-e496-4912-916b-e3534d12ce6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:10.654430 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597aab07-e496-4912-916b-e3534d12ce6f None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:10.668894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-597aab07-e496-4912-916b-e3534d12ce6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:44:10.668894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:10.668894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:10.668894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:10.668894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:10.668894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:10.668894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:10.668894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:10.668894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:10.668894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:10.668894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:10.668894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:10.668894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:44:10.668894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:44:10.668894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:44:10.670060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:44:10.670060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:10.670060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:10.670060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:10.670060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:10.670060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:10.670060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:10.670060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:10.670060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:10.670060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:10.670060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:10.670060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:10.670060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:10.670060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:10.670060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:10.670060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:10.670060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:10.671217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:44:10.671217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:44:10.671217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:44:10.671217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:44:10.671217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:44:10.671217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:44:10.671217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:44:10.671217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:10.671217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 611/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:44:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:10.675775 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03705d-5afe-4b3e-8620-8b3ecba12fa1 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:10.773308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03705d-5afe-4b3e-8620-8b3ecba12fa1 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:10.805827 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702e95c-e829-47f6-9f6c-cab7068b2c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:10.806480 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e95c-e829-47f6-9f6c-cab7068b2c7c None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:10.806766 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e95c-e829-47f6-9f6c-cab7068b2c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:10.807045 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e95c-e829-47f6-9f6c-cab7068b2c7c None admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:10.807836 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702e95c-e829-47f6-9f6c-cab7068b2c7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:10.808177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702e95c-e829-47f6-9f6c-cab7068b2c7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:10.812549 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702e95c-e829-47f6-9f6c-cab7068b2c7c None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:10.821148 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 620/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:44:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:10.827155 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597aab07-e496-4912-916b-e3534d12ce6f None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:10.892074 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:10.925817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597aab07-e496-4912-916b-e3534d12ce6f None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:10.958609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87752457-00e7-4c8b-9339-6c361eb29dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:10.959475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87752457-00e7-4c8b-9339-6c361eb29dd7 None admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:10.959758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87752457-00e7-4c8b-9339-6c361eb29dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:10.960036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87752457-00e7-4c8b-9339-6c361eb29dd7 None admin] PATH_INFO: `/v3/projects/59d78923fdef459abaf240bd0975494a/users/5a79a71fa89446c3abbb4fdbf2c93aac/roles/acb8e1bf2db94178bdd6fc69b191d6b0` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:10.975427 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87752457-00e7-4c8b-9339-6c361eb29dd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=59d78923fdef459abaf240bd0975494a, user_id=5a79a71fa89446c3abbb4fdbf2c93aac, role_id=acb8e1bf2db94178bdd6fc69b191d6b0)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:10.977554 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87752457-00e7-4c8b-9339-6c361eb29dd7 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:11.060538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 612/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:44:10 2022] PUT /identity/v3/projects/59d78923fdef459abaf240bd0975494a/users/5a79a71fa89446c3abbb4fdbf2c93aac/roles/acb8e1bf2db94178bdd6fc69b191d6b0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:44:13.067620 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8724e-27a7-465d-b0fe-a3b049808df2 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:13.068090 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8724e-27a7-465d-b0fe-a3b049808df2 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:13.068234 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8724e-27a7-465d-b0fe-a3b049808df2 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:13.070361 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 621/1233] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:44:13.075350 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cc126-a895-4862-98e9-fbb57e5a9664 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:13.075755 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cc126-a895-4862-98e9-fbb57e5a9664 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:13.075914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cc126-a895-4862-98e9-fbb57e5a9664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:13.091790 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-fd5cc126-a895-4862-98e9-fbb57e5a9664 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:44:13.093023 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-fd5cc126-a895-4862-98e9-fbb57e5a9664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:44:13.158843 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 613/1234] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:44:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:44:13.182947 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8724e-27a7-465d-b0fe-a3b049808df2 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:13.208321 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:13.282870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8724e-27a7-465d-b0fe-a3b049808df2 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:13.315882 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f78d1a-7411-47e5-b3ed-d0eb2262d96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:13.316748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f78d1a-7411-47e5-b3ed-d0eb2262d96c None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:13.317038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f78d1a-7411-47e5-b3ed-d0eb2262d96c None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:13.317317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f78d1a-7411-47e5-b3ed-d0eb2262d96c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:13.327205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f78d1a-7411-47e5-b3ed-d0eb2262d96c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:44:13.334879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-f3f78d1a-7411-47e5-b3ed-d0eb2262d96c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:44:13.334879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:13.334879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:13.334879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:13.334879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:13.334879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:13.334879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:13.334879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:13.334879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:13.334879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:13.334879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:13.334879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:13.334879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:44:13.334879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:44:13.334879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:44:13.334879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:44:13.336056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:44:13.336056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:44:13.336056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:44:13.336056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:44:13.336056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:13.336056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:13.336056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:13.336056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:13.336056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:13.336056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:13.336056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:13.336056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:13.336056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:13.336056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:13.336056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:13.336056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:13.337055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:13.337055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:13.337055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:13.337055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:13.337055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:44:13.337055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:44:13.337055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:44:13.337055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:44:13.337055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:44:13.337055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:44:13.337055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 22 16:44:13.337055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:44:13.337055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 622/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jun 22 16:44:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:13.342214 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cc126-a895-4862-98e9-fbb57e5a9664 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:13.387576 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:13.439519 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cc126-a895-4862-98e9-fbb57e5a9664 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:13.471643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49239a-2686-4655-bf7e-e40e24ed4541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:13.472332 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49239a-2686-4655-bf7e-e40e24ed4541 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:13.472652 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49239a-2686-4655-bf7e-e40e24ed4541 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:13.472928 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49239a-2686-4655-bf7e-e40e24ed4541 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:13.473671 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc49239a-2686-4655-bf7e-e40e24ed4541 None admin] RBAC: Adding query filter params (name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:13.473974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc49239a-2686-4655-bf7e-e40e24ed4541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:13.475324 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc49239a-2686-4655-bf7e-e40e24ed4541 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:13.484127 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 614/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jun 22 16:44:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:13.490036 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f78d1a-7411-47e5-b3ed-d0eb2262d96c None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:13.573051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:13.589127 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f78d1a-7411-47e5-b3ed-d0eb2262d96c None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:13.621578 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878e03b-f0a5-4f57-9ce8-7be499104fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:13.622350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878e03b-f0a5-4f57-9ce8-7be499104fab None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:13.622638 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878e03b-f0a5-4f57-9ce8-7be499104fab None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:13.622918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6878e03b-f0a5-4f57-9ce8-7be499104fab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:13.634256 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878e03b-f0a5-4f57-9ce8-7be499104fab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:13.636079 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6878e03b-f0a5-4f57-9ce8-7be499104fab None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:13.653517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-6878e03b-f0a5-4f57-9ce8-7be499104fab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:13.653517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:13.653517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:13.653517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:13.653517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:13.653517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:13.653517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:13.653517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:13.653517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:13.653517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:13.653517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:13.653517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:13.653517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:44:13.653517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:44:13.653517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:44:13.654634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:44:13.654634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:13.654634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:13.654634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:13.654634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:13.654634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:13.654634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:13.654634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:13.654634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:13.654634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:13.654634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:13.654634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:13.654634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:13.654634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:13.654634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:13.654634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:13.654634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:13.655932 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:44:13.655932 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:44:13.655932 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:13.655932 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:44:13.655932 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 623/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:13.660416 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49239a-2686-4655-bf7e-e40e24ed4541 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:13.758779 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49239a-2686-4655-bf7e-e40e24ed4541 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:13.767955 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:13.793888 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406067f-ac2a-4367-af8c-c0c57fbbb797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:13.794537 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406067f-ac2a-4367-af8c-c0c57fbbb797 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:13.794818 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406067f-ac2a-4367-af8c-c0c57fbbb797 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:13.795089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406067f-ac2a-4367-af8c-c0c57fbbb797 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:13.795931 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406067f-ac2a-4367-af8c-c0c57fbbb797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:13.796244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406067f-ac2a-4367-af8c-c0c57fbbb797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:13.797631 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406067f-ac2a-4367-af8c-c0c57fbbb797 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:13.808690 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 615/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:13.814518 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878e03b-f0a5-4f57-9ce8-7be499104fab None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:13.912040 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6878e03b-f0a5-4f57-9ce8-7be499104fab None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:13.944282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c1165-fd37-4306-985e-68cdf8927f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:13.945158 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c1165-fd37-4306-985e-68cdf8927f70 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:13.945441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c1165-fd37-4306-985e-68cdf8927f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:13.945718 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c1165-fd37-4306-985e-68cdf8927f70 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:13.948420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:13.953368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c1165-fd37-4306-985e-68cdf8927f70 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:13.954798 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c1165-fd37-4306-985e-68cdf8927f70 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:13.969131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-281c1165-fd37-4306-985e-68cdf8927f70 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 16:44:13.969131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:13.969131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:13.969131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:13.969131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:13.969131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:13.969131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:13.969131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:13.969131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:13.969131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:13.969131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:13.969131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:13.969131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:44:13.969131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:44:13.969131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:44:13.969131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:44:13.970238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:13.970238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:13.970238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:44:13.970238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:44:13.970238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:44:13.970238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:44:13.970238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:13.970238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:13.970238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:13.970238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:13.970238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:13.970238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:13.970238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:13.970238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:13.970238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:13.970238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:13.970238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:13.970238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:13.971476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:13.971476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:13.971476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:44:13.971476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:44:13.971476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:44:13.971476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:44:13.971476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:44:13.971476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:44:13.971476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 16:44:13.971476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:44:13.971476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 624/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:44:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:13.976859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406067f-ac2a-4367-af8c-c0c57fbbb797 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:14.078856 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406067f-ac2a-4367-af8c-c0c57fbbb797 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:14.118964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad9bce-3033-4b93-a0e8-9b65508b7ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:14.119662 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad9bce-3033-4b93-a0e8-9b65508b7ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:14.119942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad9bce-3033-4b93-a0e8-9b65508b7ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:14.120247 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad9bce-3033-4b93-a0e8-9b65508b7ad1 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:14.121080 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad9bce-3033-4b93-a0e8-9b65508b7ad1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:14.121427 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad9bce-3033-4b93-a0e8-9b65508b7ad1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:14.122843 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad9bce-3033-4b93-a0e8-9b65508b7ad1 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:14.146732 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 616/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jun 22 16:44:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:14.148985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c1165-fd37-4306-985e-68cdf8927f70 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:14.245732 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c1165-fd37-4306-985e-68cdf8927f70 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:14.279677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fba68d-2173-4e8c-bb98-d49175a17245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:14.280352 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fba68d-2173-4e8c-bb98-d49175a17245 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:14.280644 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fba68d-2173-4e8c-bb98-d49175a17245 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:14.280919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fba68d-2173-4e8c-bb98-d49175a17245 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:14.339755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:14.346031 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fba68d-2173-4e8c-bb98-d49175a17245 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:14.347682 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fba68d-2173-4e8c-bb98-d49175a17245 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:14.441160 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 625/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:44:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 16:44:14.447640 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad9bce-3033-4b93-a0e8-9b65508b7ad1 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:14.474197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:14.543530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad9bce-3033-4b93-a0e8-9b65508b7ad1 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:14.579071 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938f86e-a4c4-45dc-aadb-7829bb8c9a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:14.581166 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938f86e-a4c4-45dc-aadb-7829bb8c9a15 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:14.581166 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938f86e-a4c4-45dc-aadb-7829bb8c9a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:14.581166 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938f86e-a4c4-45dc-aadb-7829bb8c9a15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:14.590816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938f86e-a4c4-45dc-aadb-7829bb8c9a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:14.592299 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938f86e-a4c4-45dc-aadb-7829bb8c9a15 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:14.609114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-5938f86e-a4c4-45dc-aadb-7829bb8c9a15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:14.609114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:14.609114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:14.609114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:14.609114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:14.609114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:14.609114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:14.609114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:14.609114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:14.609114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:14.609114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:14.609114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:14.609114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:44:14.609114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:44:14.609114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:44:14.610209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:44:14.610209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:14.610209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:14.610209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:14.610209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:14.610209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:14.610209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:14.610209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:14.610209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:14.610209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:14.610209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:14.610209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:14.610209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:14.610209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:14.610209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:14.610209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:14.610209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:14.611370 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:44:14.611370 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:44:14.611370 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:14.611370 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:14.611370 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 617/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:14.616082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fba68d-2173-4e8c-bb98-d49175a17245 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:14.707505 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:14.713169 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fba68d-2173-4e8c-bb98-d49175a17245 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:14.746165 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8f99d-728d-4620-8bd3-6e5f9bf3be85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:14.746840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8f99d-728d-4620-8bd3-6e5f9bf3be85 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:14.747124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8f99d-728d-4620-8bd3-6e5f9bf3be85 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:14.747400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8f99d-728d-4620-8bd3-6e5f9bf3be85 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:14.748184 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8f99d-728d-4620-8bd3-6e5f9bf3be85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:14.752368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8f99d-728d-4620-8bd3-6e5f9bf3be85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:14.752368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8f99d-728d-4620-8bd3-6e5f9bf3be85 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:14.760765 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 626/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:14.766740 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938f86e-a4c4-45dc-aadb-7829bb8c9a15 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:14.844278 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:14.865203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938f86e-a4c4-45dc-aadb-7829bb8c9a15 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:14.898139 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e9255-0a54-40ec-9911-f049c2fdc0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:14.909181 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e9255-0a54-40ec-9911-f049c2fdc0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:14.909181 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e9255-0a54-40ec-9911-f049c2fdc0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:14.909181 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e9255-0a54-40ec-9911-f049c2fdc0b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:14.909181 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e9255-0a54-40ec-9911-f049c2fdc0b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:14.909181 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e9255-0a54-40ec-9911-f049c2fdc0b0 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:14.922546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-e26e9255-0a54-40ec-9911-f049c2fdc0b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:44:14.922546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:14.922546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:14.922546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:14.922546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:14.922546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:14.922546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:14.922546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:14.922546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:14.922546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:14.922546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:14.922546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:14.922546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:44:14.922546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:44:14.922546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:44:14.923625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:44:14.923625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:14.923625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:14.923625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:14.923625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:14.923625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:14.923625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:14.923625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:14.923625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:14.923625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:14.923625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:14.923625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:14.923625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:14.923625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:14.923625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:14.923625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:14.923625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:14.924852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:44:14.924852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:44:14.924852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:44:14.924852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:44:14.924852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:44:14.924852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:44:14.924852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:44:14.924852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:14.924852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 618/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:44:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:14.930167 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8f99d-728d-4620-8bd3-6e5f9bf3be85 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:15.028238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8f99d-728d-4620-8bd3-6e5f9bf3be85 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:15.061719 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8b1d7-3594-4f82-8802-50920f1e5437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:15.062374 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8b1d7-3594-4f82-8802-50920f1e5437 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:15.062664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8b1d7-3594-4f82-8802-50920f1e5437 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:15.062944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8b1d7-3594-4f82-8802-50920f1e5437 None admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:15.063730 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8b1d7-3594-4f82-8802-50920f1e5437 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:15.066397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8b1d7-3594-4f82-8802-50920f1e5437 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:15.066397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8b1d7-3594-4f82-8802-50920f1e5437 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:15.077317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 627/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:44:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:15.083427 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e9255-0a54-40ec-9911-f049c2fdc0b0 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:15.184488 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e9255-0a54-40ec-9911-f049c2fdc0b0 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:15.217369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d39376-b847-45ee-bf82-ae8aec788cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:15.218030 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d39376-b847-45ee-bf82-ae8aec788cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:15.218351 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d39376-b847-45ee-bf82-ae8aec788cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:15.218663 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d39376-b847-45ee-bf82-ae8aec788cb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:15.219528 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d39376-b847-45ee-bf82-ae8aec788cb4 None admin] RBAC: Adding query filter params (role.id=acb8e1bf2db94178bdd6fc69b191d6b0, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=5a79a71fa89446c3abbb4fdbf2c93aac) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:15.219858 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d39376-b847-45ee-bf82-ae8aec788cb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:15.221602 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d39376-b847-45ee-bf82-ae8aec788cb4 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:15.228230 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 619/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:44:15 2022] GET /identity/v3/role_assignments?user.id=5a79a71fa89446c3abbb4fdbf2c93aac&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=acb8e1bf2db94178bdd6fc69b191d6b0 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:17.321822 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd855eec-bdb9-4f55-b19b-6d5d6390913d None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:17.322317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd855eec-bdb9-4f55-b19b-6d5d6390913d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:17.322317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd855eec-bdb9-4f55-b19b-6d5d6390913d None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:17.323679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 628/1247] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:44:17.328939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ef334-9e3b-4cf0-8f87-6956492885a0 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:17.329363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ef334-9e3b-4cf0-8f87-6956492885a0 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:17.329585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ef334-9e3b-4cf0-8f87-6956492885a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:17.334560 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:17.346833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-5f7ef334-9e3b-4cf0-8f87-6956492885a0 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:44:17.348010 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-5f7ef334-9e3b-4cf0-8f87-6956492885a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:44:17.413391 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 620/1248] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:44:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 22 16:44:17.437502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd855eec-bdb9-4f55-b19b-6d5d6390913d None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:17.455709 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:17.537357 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd855eec-bdb9-4f55-b19b-6d5d6390913d None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:17.570944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5736b-0da2-404c-8c53-f5ce43f0350c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:17.572164 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5736b-0da2-404c-8c53-f5ce43f0350c None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:17.572511 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5736b-0da2-404c-8c53-f5ce43f0350c None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:17.572815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5736b-0da2-404c-8c53-f5ce43f0350c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:17.582691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5736b-0da2-404c-8c53-f5ce43f0350c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:44:17.590447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-28a5736b-0da2-404c-8c53-f5ce43f0350c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:44:17.590447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:17.590447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:17.590447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:17.590447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:17.590447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:17.590447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:17.590447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:17.590447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:17.590447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:17.590447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:17.590447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:17.590447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:44:17.590447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:44:17.590447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:44:17.590447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:44:17.594577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:44:17.594577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:44:17.594577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:44:17.594577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:44:17.594577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:17.594577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:17.594577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:17.594577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:17.594577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:17.594577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:17.594577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:17.594577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:17.594577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:17.594577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:17.594577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:17.594577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:17.595677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:17.595677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:17.595677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:17.595677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:17.595677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:44:17.595677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:44:17.595677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:44:17.595677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:44:17.595677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:44:17.595677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:44:17.595677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:44:17.595677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:44:17.595677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 629/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:44:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:17.597887 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ef334-9e3b-4cf0-8f87-6956492885a0 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:17.695766 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ef334-9e3b-4cf0-8f87-6956492885a0 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:17.724265 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:17.729587 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759a356-85ac-4391-b3e7-d2848dc32d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:17.730266 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a356-85ac-4391-b3e7-d2848dc32d52 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:17.730590 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a356-85ac-4391-b3e7-d2848dc32d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:17.730904 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759a356-85ac-4391-b3e7-d2848dc32d52 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:17.731692 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759a356-85ac-4391-b3e7-d2848dc32d52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:17.732026 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759a356-85ac-4391-b3e7-d2848dc32d52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:17.733422 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759a356-85ac-4391-b3e7-d2848dc32d52 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:17.742108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 621/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:44:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:17.747643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5736b-0da2-404c-8c53-f5ce43f0350c None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:17.823834 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:17.846244 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5736b-0da2-404c-8c53-f5ce43f0350c None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:17.877799 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28024b-8b15-4c73-9a28-cb77b6813269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:17.878580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28024b-8b15-4c73-9a28-cb77b6813269 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:17.878868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28024b-8b15-4c73-9a28-cb77b6813269 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:17.879147 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28024b-8b15-4c73-9a28-cb77b6813269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:17.889877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28024b-8b15-4c73-9a28-cb77b6813269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:17.891651 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28024b-8b15-4c73-9a28-cb77b6813269 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:17.908677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-3a28024b-8b15-4c73-9a28-cb77b6813269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:17.908677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:17.908677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:17.908677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:17.908677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:17.908677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:17.908677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:17.908677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:17.908677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:17.908677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:17.908677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:17.908677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:17.908677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:44:17.908677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:44:17.908677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:44:17.909683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:44:17.909683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:17.909683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:17.909683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:17.909683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:17.909683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:17.909683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:17.909683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:17.909683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:17.909683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:17.909683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:17.909683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:17.909683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:17.909683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:17.909683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:17.909683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:17.909683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:17.910854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:44:17.910854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:44:17.910854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:17.910854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:44:17.910854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 630/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:44:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:17.915839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759a356-85ac-4391-b3e7-d2848dc32d52 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:18.014942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759a356-85ac-4391-b3e7-d2848dc32d52 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:18.048696 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52b2b0-0aa5-4007-97e5-d24335a4bf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:18.049363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52b2b0-0aa5-4007-97e5-d24335a4bf7c None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:18.049644 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52b2b0-0aa5-4007-97e5-d24335a4bf7c None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:18.052595 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52b2b0-0aa5-4007-97e5-d24335a4bf7c None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:18.052595 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52b2b0-0aa5-4007-97e5-d24335a4bf7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:18.052595 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52b2b0-0aa5-4007-97e5-d24335a4bf7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:18.052595 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52b2b0-0aa5-4007-97e5-d24335a4bf7c None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:18.064416 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 622/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:18.070590 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28024b-8b15-4c73-9a28-cb77b6813269 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:18.176288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28024b-8b15-4c73-9a28-cb77b6813269 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:18.210615 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:18.218421 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67543bb-3e38-45b4-8bdb-93f57fbdf1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:18.219258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67543bb-3e38-45b4-8bdb-93f57fbdf1db None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:18.219545 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67543bb-3e38-45b4-8bdb-93f57fbdf1db None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:18.219824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67543bb-3e38-45b4-8bdb-93f57fbdf1db None admin] PATH_INFO: `/v3/users/placement` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:18.227161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67543bb-3e38-45b4-8bdb-93f57fbdf1db None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:18.228646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67543bb-3e38-45b4-8bdb-93f57fbdf1db None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:18.243029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-b67543bb-3e38-45b4-8bdb-93f57fbdf1db None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 16:44:18.243029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:18.243029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:18.243029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:18.243029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:18.243029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:18.243029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:18.243029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:18.243029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:18.243029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:18.243029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:18.243029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:18.243029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:44:18.243029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:44:18.243029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:44:18.243029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:44:18.244187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:18.244187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:18.244187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:44:18.244187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:44:18.244187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:44:18.244187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:44:18.244187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:18.244187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:18.244187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:18.244187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:18.244187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:18.244187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:18.244187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:18.244187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:18.244187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:18.244187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:18.244187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:18.244187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:18.245370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:18.245370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:18.245370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:44:18.245370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:44:18.245370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:44:18.245370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:44:18.245370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:44:18.245370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:44:18.245370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 16:44:18.245370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:44:18.245370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 631/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:44:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:18.252568 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52b2b0-0aa5-4007-97e5-d24335a4bf7c None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:18.307472 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:18.351834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52b2b0-0aa5-4007-97e5-d24335a4bf7c None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:18.386933 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849aeeca-c96b-4123-8e62-c35b70735995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:18.387592 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849aeeca-c96b-4123-8e62-c35b70735995 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:18.387872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849aeeca-c96b-4123-8e62-c35b70735995 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:18.388178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849aeeca-c96b-4123-8e62-c35b70735995 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:18.389007 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849aeeca-c96b-4123-8e62-c35b70735995 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:18.389314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849aeeca-c96b-4123-8e62-c35b70735995 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:18.390994 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849aeeca-c96b-4123-8e62-c35b70735995 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:18.407502 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 623/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jun 22 16:44:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:18.413453 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67543bb-3e38-45b4-8bdb-93f57fbdf1db None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:18.517168 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67543bb-3e38-45b4-8bdb-93f57fbdf1db None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:18.550121 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b23218-0a1a-4595-846a-913552aa05e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:18.550764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b23218-0a1a-4595-846a-913552aa05e5 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:18.551051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b23218-0a1a-4595-846a-913552aa05e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:18.551333 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b23218-0a1a-4595-846a-913552aa05e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:18.605714 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:18.618109 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b23218-0a1a-4595-846a-913552aa05e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:18.619506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b23218-0a1a-4595-846a-913552aa05e5 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:18.712307 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 632/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:44:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 16:44:18.718051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849aeeca-c96b-4123-8e62-c35b70735995 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:18.815180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849aeeca-c96b-4123-8e62-c35b70735995 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:18.827759 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:18.848228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe6e1f-742c-4cb1-a4f6-f90603c29647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:18.849009 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe6e1f-742c-4cb1-a4f6-f90603c29647 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:18.849293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe6e1f-742c-4cb1-a4f6-f90603c29647 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:18.849567 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe6e1f-742c-4cb1-a4f6-f90603c29647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:18.859800 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe6e1f-742c-4cb1-a4f6-f90603c29647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:18.861277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe6e1f-742c-4cb1-a4f6-f90603c29647 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:18.878028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-56fe6e1f-742c-4cb1-a4f6-f90603c29647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:18.878028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:18.878028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:18.878028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:18.878028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:18.878028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:18.878028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:18.878028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:18.878028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:18.878028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:18.878028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:18.878028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:18.878028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:44:18.878028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:44:18.878028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:44:18.879186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:44:18.879186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:18.879186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:18.879186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:18.879186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:18.879186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:18.879186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:18.879186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:18.879186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:18.879186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:18.879186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:18.879186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:18.879186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:18.879186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:18.879186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:18.879186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:18.879186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:18.880267 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:44:18.880267 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:44:18.880267 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:18.880267 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:18.880267 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 624/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:18.885068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b23218-0a1a-4595-846a-913552aa05e5 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:18.972579 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:18.984943 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b23218-0a1a-4595-846a-913552aa05e5 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:19.017752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b2873-3715-4ae3-a7ce-c5ab31745fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:19.018412 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b2873-3715-4ae3-a7ce-c5ab31745fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:19.018696 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b2873-3715-4ae3-a7ce-c5ab31745fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:19.018976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b2873-3715-4ae3-a7ce-c5ab31745fd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:19.019727 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b2873-3715-4ae3-a7ce-c5ab31745fd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:19.020034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b2873-3715-4ae3-a7ce-c5ab31745fd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:19.021484 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b2873-3715-4ae3-a7ce-c5ab31745fd6 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:19.033245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 633/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:19.039542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe6e1f-742c-4cb1-a4f6-f90603c29647 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:19.136280 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe6e1f-742c-4cb1-a4f6-f90603c29647 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:19.170616 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93612bf-3c68-43ac-b72a-b3b008210653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:19.171390 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93612bf-3c68-43ac-b72a-b3b008210653 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:19.171675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93612bf-3c68-43ac-b72a-b3b008210653 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:19.171953 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93612bf-3c68-43ac-b72a-b3b008210653 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:19.178411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93612bf-3c68-43ac-b72a-b3b008210653 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:19.179837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93612bf-3c68-43ac-b72a-b3b008210653 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:19.193146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-b93612bf-3c68-43ac-b72a-b3b008210653 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:44:19.193146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:19.193146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:19.193146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:19.193146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:19.193146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:19.193146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:19.193146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:19.193146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:19.193146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:19.193146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:19.193146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:19.193146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:44:19.193146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:44:19.193146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:44:19.194313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:44:19.194313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:19.194313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:19.194313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:19.194313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:19.194313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:19.194313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:19.194313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:19.194313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:19.194313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:19.194313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:19.194313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:19.194313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:19.194313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:19.194313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:19.194313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:19.194313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:19.195512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:44:19.195512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:44:19.195512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:44:19.195512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:44:19.195512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:44:19.195512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:44:19.195512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:44:19.195512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:19.195512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 625/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:44:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:19.200075 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b2873-3715-4ae3-a7ce-c5ab31745fd6 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:19.297802 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b2873-3715-4ae3-a7ce-c5ab31745fd6 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:19.329996 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f2267-d384-4704-acdb-6863b85e0d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:19.330671 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f2267-d384-4704-acdb-6863b85e0d47 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:19.330954 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f2267-d384-4704-acdb-6863b85e0d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:19.331230 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f2267-d384-4704-acdb-6863b85e0d47 None admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:19.332005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f2267-d384-4704-acdb-6863b85e0d47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:19.332343 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f2267-d384-4704-acdb-6863b85e0d47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:19.333809 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f2267-d384-4704-acdb-6863b85e0d47 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:19.345997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 634/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:44:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:19.352216 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93612bf-3c68-43ac-b72a-b3b008210653 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:19.378797 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:19.450765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93612bf-3c68-43ac-b72a-b3b008210653 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:19.484347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab197ae2-3efb-461b-a7be-b7cb79734c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:19.485106 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab197ae2-3efb-461b-a7be-b7cb79734c78 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:19.485393 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab197ae2-3efb-461b-a7be-b7cb79734c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:19.485673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab197ae2-3efb-461b-a7be-b7cb79734c78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:19.486511 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab197ae2-3efb-461b-a7be-b7cb79734c78 None admin] RBAC: Adding query filter params (role.id=459b0e5c21c94fb1b81f76c65780fdb5, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=5a79a71fa89446c3abbb4fdbf2c93aac) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:19.486827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab197ae2-3efb-461b-a7be-b7cb79734c78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:19.488288 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab197ae2-3efb-461b-a7be-b7cb79734c78 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:19.493782 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 626/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:44:19 2022] GET /identity/v3/role_assignments?user.id=5a79a71fa89446c3abbb4fdbf2c93aac&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=459b0e5c21c94fb1b81f76c65780fdb5 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:21.468700 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd089b-2aa7-48bc-a122-618bcd772f59 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:21.469244 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd089b-2aa7-48bc-a122-618bcd772f59 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:21.469244 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd089b-2aa7-48bc-a122-618bcd772f59 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:21.470636 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 635/1261] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:44:21.476587 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11183e-4910-4a7a-8bb7-3aaa8eaeeef2 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:21.477055 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11183e-4910-4a7a-8bb7-3aaa8eaeeef2 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:21.477161 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11183e-4910-4a7a-8bb7-3aaa8eaeeef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:21.494117 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-4c11183e-4910-4a7a-8bb7-3aaa8eaeeef2 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:44:21.495308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-4c11183e-4910-4a7a-8bb7-3aaa8eaeeef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:44:21.562212 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 627/1262] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:44:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:44:21.585161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd089b-2aa7-48bc-a122-618bcd772f59 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:21.596061 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:21.686356 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd089b-2aa7-48bc-a122-618bcd772f59 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:21.718818 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e1a01-d656-408f-8747-d6f16090c777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:21.719530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e1a01-d656-408f-8747-d6f16090c777 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:21.719815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e1a01-d656-408f-8747-d6f16090c777 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:21.720093 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e1a01-d656-408f-8747-d6f16090c777 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:21.730629 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e1a01-d656-408f-8747-d6f16090c777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:44:21.738177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-816e1a01-d656-408f-8747-d6f16090c777 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:44:21.738177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:21.738177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:21.738177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:21.738177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:21.738177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:21.738177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:21.738177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:21.738177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:21.738177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:21.738177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:21.738177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:21.738177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:44:21.738177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:44:21.738177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:44:21.738177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:44:21.739527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:44:21.739527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:44:21.739527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:44:21.739527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:44:21.739527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:21.739527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:21.739527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:21.739527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:21.739527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:21.739527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:21.739527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:21.739527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:21.739527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:21.739527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:21.739527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:21.739527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:21.740837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:21.740837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:21.740837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:21.740837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:21.740837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:44:21.740837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:44:21.740837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:44:21.740837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:44:21.740837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:44:21.740837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:44:21.740837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:44:21.740837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:44:21.740837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 636/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:44:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:44:21.746243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11183e-4910-4a7a-8bb7-3aaa8eaeeef2 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:21.763809 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:21.840874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11183e-4910-4a7a-8bb7-3aaa8eaeeef2 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:21.873755 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc44ca0-7b6f-4a58-9c6d-bf5d34efb658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:21.874413 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc44ca0-7b6f-4a58-9c6d-bf5d34efb658 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:21.874694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc44ca0-7b6f-4a58-9c6d-bf5d34efb658 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:21.874967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc44ca0-7b6f-4a58-9c6d-bf5d34efb658 None admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:21.875716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc44ca0-7b6f-4a58-9c6d-bf5d34efb658 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:21.876024 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc44ca0-7b6f-4a58-9c6d-bf5d34efb658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:21.877427 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc44ca0-7b6f-4a58-9c6d-bf5d34efb658 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:21.885452 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 628/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:44:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:21.891343 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e1a01-d656-408f-8747-d6f16090c777 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:21.955712 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:21.988372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e1a01-d656-408f-8747-d6f16090c777 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:22.020559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9bee4-5bb2-40c5-86ce-33d0bdd4cd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:22.021397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9bee4-5bb2-40c5-86ce-33d0bdd4cd5a None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:22.021677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9bee4-5bb2-40c5-86ce-33d0bdd4cd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:22.021953 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9bee4-5bb2-40c5-86ce-33d0bdd4cd5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:22.034076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9bee4-5bb2-40c5-86ce-33d0bdd4cd5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:22.035516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9bee4-5bb2-40c5-86ce-33d0bdd4cd5a None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:22.052919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-36e9bee4-5bb2-40c5-86ce-33d0bdd4cd5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:22.052919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:22.052919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:22.052919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:22.052919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:22.052919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:22.052919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:22.052919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:22.052919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:22.052919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:22.052919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:22.052919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:22.052919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:44:22.052919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:44:22.052919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:44:22.054068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:44:22.054068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:22.054068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:22.054068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:22.054068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:22.054068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:22.054068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:22.054068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:22.054068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:22.054068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:22.054068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:22.054068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:22.054068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:22.054068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:22.054068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:22.054068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:22.054068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:22.055219 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:44:22.055219 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:44:22.055219 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:22.055219 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:44:22.055219 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 637/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:22.059954 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc44ca0-7b6f-4a58-9c6d-bf5d34efb658 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:22.139201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:22.159364 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc44ca0-7b6f-4a58-9c6d-bf5d34efb658 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:22.191152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30341477-abad-4e65-a9c1-ff18c2cc2143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:22.191790 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30341477-abad-4e65-a9c1-ff18c2cc2143 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:22.192070 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30341477-abad-4e65-a9c1-ff18c2cc2143 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:22.192375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30341477-abad-4e65-a9c1-ff18c2cc2143 None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:22.193088 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30341477-abad-4e65-a9c1-ff18c2cc2143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:22.193394 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30341477-abad-4e65-a9c1-ff18c2cc2143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:22.194876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30341477-abad-4e65-a9c1-ff18c2cc2143 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:22.206074 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 629/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:22.212923 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9bee4-5bb2-40c5-86ce-33d0bdd4cd5a None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:22.309585 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9bee4-5bb2-40c5-86ce-33d0bdd4cd5a None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:22.328637 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:22.342261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e806a4-5749-469e-85c1-981758e510cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:22.343038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e806a4-5749-469e-85c1-981758e510cd None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:22.343322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e806a4-5749-469e-85c1-981758e510cd None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:22.343598 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e806a4-5749-469e-85c1-981758e510cd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:22.350733 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e806a4-5749-469e-85c1-981758e510cd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:22.352227 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e806a4-5749-469e-85c1-981758e510cd None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:22.365839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-53e806a4-5749-469e-85c1-981758e510cd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 16:44:22.365839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:22.365839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:22.365839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:22.365839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:22.365839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:22.365839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:22.365839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:22.365839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:22.365839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:22.365839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:22.365839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:22.365839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:44:22.365839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:44:22.365839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:44:22.365839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:44:22.370345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:22.370345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:22.370345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:44:22.370345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:44:22.370345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:44:22.370345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:44:22.370345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:22.370345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:22.370345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:22.370345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:22.370345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:22.370345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:22.370345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:22.370345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:22.370345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:22.370345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:22.370345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:22.370345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:22.371559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:22.371559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:22.371559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:44:22.371559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:44:22.371559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:44:22.371559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:44:22.371559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:44:22.371559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:44:22.371559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 16:44:22.371559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:44:22.371559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 638/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:44:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:44:22.373054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30341477-abad-4e65-a9c1-ff18c2cc2143 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:22.472153 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30341477-abad-4e65-a9c1-ff18c2cc2143 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:22.505411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c166f68-df0c-4a41-8d28-679fac44f972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:22.506077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c166f68-df0c-4a41-8d28-679fac44f972 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:22.506362 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c166f68-df0c-4a41-8d28-679fac44f972 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:22.506641 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c166f68-df0c-4a41-8d28-679fac44f972 None admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:22.507567 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c166f68-df0c-4a41-8d28-679fac44f972 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:22.508401 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c166f68-df0c-4a41-8d28-679fac44f972 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:22.509832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c166f68-df0c-4a41-8d28-679fac44f972 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:22.518674 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:22.527816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 630/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jun 22 16:44:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:22.533566 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e806a4-5749-469e-85c1-981758e510cd None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:22.630843 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e806a4-5749-469e-85c1-981758e510cd None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:22.664464 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf18ade-47e7-435f-975f-99f348580739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:22.665242 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf18ade-47e7-435f-975f-99f348580739 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:22.665528 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf18ade-47e7-435f-975f-99f348580739 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:22.665808 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf18ade-47e7-435f-975f-99f348580739 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:22.676027 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf18ade-47e7-435f-975f-99f348580739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:22.677492 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf18ade-47e7-435f-975f-99f348580739 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:22.694249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-5bf18ade-47e7-435f-975f-99f348580739 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:22.694249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:22.694249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:22.694249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:22.694249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:22.694249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:22.694249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:22.694249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:22.694249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:22.694249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:22.694249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:22.694249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:22.694249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:44:22.694249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:44:22.694249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:44:22.695349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:44:22.695349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:22.695349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:22.695349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:22.695349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:22.695349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:22.695349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:22.695349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:22.695349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:22.695349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:22.695349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:22.695349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:22.695349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:22.695349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:22.695349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:22.695349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:22.695349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:22.697103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:44:22.697103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:44:22.697103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:22.697103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:44:22.697103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 639/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:22.701769 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c166f68-df0c-4a41-8d28-679fac44f972 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:22.797789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c166f68-df0c-4a41-8d28-679fac44f972 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:22.831605 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811f793-1a12-429c-a9ed-51e317c4a8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:22.835676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811f793-1a12-429c-a9ed-51e317c4a8fc None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:22.835676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811f793-1a12-429c-a9ed-51e317c4a8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:22.835676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811f793-1a12-429c-a9ed-51e317c4a8fc None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:22.835676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811f793-1a12-429c-a9ed-51e317c4a8fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:22.835676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811f793-1a12-429c-a9ed-51e317c4a8fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:22.835676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811f793-1a12-429c-a9ed-51e317c4a8fc None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:22.846088 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 631/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:22.851788 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf18ade-47e7-435f-975f-99f348580739 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:22.884279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:22.949052 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf18ade-47e7-435f-975f-99f348580739 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:22.983201 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad70d9-0d9b-4c02-810d-d6c0af70ad28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:22.983951 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad70d9-0d9b-4c02-810d-d6c0af70ad28 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:22.984339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad70d9-0d9b-4c02-810d-d6c0af70ad28 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:22.984639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad70d9-0d9b-4c02-810d-d6c0af70ad28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:22.991320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad70d9-0d9b-4c02-810d-d6c0af70ad28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:22.993516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad70d9-0d9b-4c02-810d-d6c0af70ad28 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:23.008014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-01ad70d9-0d9b-4c02-810d-d6c0af70ad28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:44:23.008014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:23.008014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:23.008014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:23.008014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:23.008014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:23.008014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:23.008014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:23.008014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:23.008014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:23.008014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:23.008014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:23.008014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:44:23.008014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:44:23.008014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:44:23.011072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:44:23.011072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:23.011072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:23.011072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:23.011072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:23.011072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:23.011072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:23.011072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:23.011072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:23.011072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:23.011072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:23.011072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:23.011072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:23.011072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:23.011072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:23.011072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:23.011072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:23.012263 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:44:23.012263 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:44:23.012263 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:44:23.012263 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:44:23.012263 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:44:23.012263 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:44:23.012263 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:44:23.012263 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:44:23.012263 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 640/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:44:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:23.015285 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811f793-1a12-429c-a9ed-51e317c4a8fc None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:23.073883 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:23.115367 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811f793-1a12-429c-a9ed-51e317c4a8fc None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:23.149298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42349c-b08f-48af-ba24-b281ad13577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:23.150003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42349c-b08f-48af-ba24-b281ad13577f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:23.150288 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42349c-b08f-48af-ba24-b281ad13577f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:23.150563 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42349c-b08f-48af-ba24-b281ad13577f None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:23.151354 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42349c-b08f-48af-ba24-b281ad13577f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:23.151664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42349c-b08f-48af-ba24-b281ad13577f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:23.153119 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42349c-b08f-48af-ba24-b281ad13577f None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:23.165418 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 632/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:44:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:44:23.171436 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad70d9-0d9b-4c02-810d-d6c0af70ad28 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:23.261188 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:23.270035 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad70d9-0d9b-4c02-810d-d6c0af70ad28 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:23.302888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf877c-6af2-428b-aae4-07af3492cf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:23.303761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf877c-6af2-428b-aae4-07af3492cf0a None admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:23.304047 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf877c-6af2-428b-aae4-07af3492cf0a None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:23.304371 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf877c-6af2-428b-aae4-07af3492cf0a None admin] PATH_INFO: `/v3/projects/59d78923fdef459abaf240bd0975494a/users/5a79a71fa89446c3abbb4fdbf2c93aac/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:23.307057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf877c-6af2-428b-aae4-07af3492cf0a None admin] RBAC: Authorizing `identity:create_grant(project_id=59d78923fdef459abaf240bd0975494a, user_id=5a79a71fa89446c3abbb4fdbf2c93aac, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:23.308523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf877c-6af2-428b-aae4-07af3492cf0a None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:23.394755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 641/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jun 22 16:44:23 2022] PUT /identity/v3/projects/59d78923fdef459abaf240bd0975494a/users/5a79a71fa89446c3abbb4fdbf2c93aac/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:44:25.423485 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31303b-f320-4880-ac42-1ba722a215ab None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:25.424055 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31303b-f320-4880-ac42-1ba722a215ab None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:25.424055 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31303b-f320-4880-ac42-1ba722a215ab None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:25.425487 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 633/1274] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:44:25.430864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f0505-2abc-4234-8559-54487bd83802 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:25.431396 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f0505-2abc-4234-8559-54487bd83802 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:25.431396 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f0505-2abc-4234-8559-54487bd83802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:25.447977 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-fa5f0505-2abc-4234-8559-54487bd83802 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:44:25.449190 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-fa5f0505-2abc-4234-8559-54487bd83802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:44:25.515883 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 642/1275] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:44:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:44:25.540445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31303b-f320-4880-ac42-1ba722a215ab None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:25.640362 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31303b-f320-4880-ac42-1ba722a215ab None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:25.657726 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:25.673868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592fdee-8c53-40ea-9ce3-92e6dcc33304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:25.674628 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592fdee-8c53-40ea-9ce3-92e6dcc33304 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:25.674914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592fdee-8c53-40ea-9ce3-92e6dcc33304 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:25.675192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592fdee-8c53-40ea-9ce3-92e6dcc33304 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:25.685569 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592fdee-8c53-40ea-9ce3-92e6dcc33304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 22 16:44:25.693525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-a592fdee-8c53-40ea-9ce3-92e6dcc33304 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:44:25.693525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:25.693525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:25.693525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:25.693525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:25.693525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:25.693525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:25.693525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:25.693525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:25.693525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:25.693525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:25.693525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:25.693525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 22 16:44:25.693525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 22 16:44:25.693525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 22 16:44:25.693525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 22 16:44:25.694676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 22 16:44:25.694676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 22 16:44:25.694676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 22 16:44:25.694676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 22 16:44:25.694676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:25.694676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:25.694676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:25.694676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:25.694676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:25.694676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:25.694676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:25.694676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:25.694676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:25.694676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:25.694676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:25.694676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:25.695561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:25.695561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:25.695561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:25.695561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:25.695561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 22 16:44:25.695561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 22 16:44:25.695561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 22 16:44:25.695561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 22 16:44:25.695561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 22 16:44:25.695561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 22 16:44:25.695561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 22 16:44:25.695561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:25.695561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 634/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jun 22 16:44:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:25.701606 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f0505-2abc-4234-8559-54487bd83802 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:25.779892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:25.797974 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f0505-2abc-4234-8559-54487bd83802 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:25.831515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631747b-73ad-4ec5-a156-ba97d2c17376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:25.832205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631747b-73ad-4ec5-a156-ba97d2c17376 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:25.832496 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631747b-73ad-4ec5-a156-ba97d2c17376 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:25.832772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631747b-73ad-4ec5-a156-ba97d2c17376 None admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:25.833528 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631747b-73ad-4ec5-a156-ba97d2c17376 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:25.833839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631747b-73ad-4ec5-a156-ba97d2c17376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:25.835242 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631747b-73ad-4ec5-a156-ba97d2c17376 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:25.843768 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 643/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jun 22 16:44:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:25.849667 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592fdee-8c53-40ea-9ce3-92e6dcc33304 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:25.950364 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592fdee-8c53-40ea-9ce3-92e6dcc33304 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:25.982826 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299b10e-5568-40b7-8d38-0559c0c7fd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:25.983600 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299b10e-5568-40b7-8d38-0559c0c7fd60 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:25.983884 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299b10e-5568-40b7-8d38-0559c0c7fd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:25.984189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299b10e-5568-40b7-8d38-0559c0c7fd60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:25.995402 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299b10e-5568-40b7-8d38-0559c0c7fd60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:25.996891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299b10e-5568-40b7-8d38-0559c0c7fd60 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:26.013737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-f299b10e-5568-40b7-8d38-0559c0c7fd60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:26.013737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:26.013737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:26.013737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:26.013737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:26.013737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:26.013737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:26.013737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:26.013737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:26.013737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:26.013737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:26.013737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:26.013737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:44:26.013737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:44:26.013737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:44:26.019503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:44:26.019503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:26.019503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:26.019503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:26.019503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:26.019503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:26.019503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:26.019503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:26.019503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:26.019503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:26.019503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:26.019503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:26.019503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:26.019503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:26.019503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:26.019503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:26.019503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:26.020484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:44:26.020484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:44:26.020484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:26.020484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:26.020484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 635/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 22 16:44:26.020975 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631747b-73ad-4ec5-a156-ba97d2c17376 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:26.118886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631747b-73ad-4ec5-a156-ba97d2c17376 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:26.158937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685443a-5ee9-41ed-b466-9182b8a0ced3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:26.159602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685443a-5ee9-41ed-b466-9182b8a0ced3 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:26.159886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685443a-5ee9-41ed-b466-9182b8a0ced3 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:26.160192 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685443a-5ee9-41ed-b466-9182b8a0ced3 None admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:26.160914 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685443a-5ee9-41ed-b466-9182b8a0ced3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:26.161225 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685443a-5ee9-41ed-b466-9182b8a0ced3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:26.162590 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685443a-5ee9-41ed-b466-9182b8a0ced3 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:26.174598 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 644/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:44:26.180874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299b10e-5568-40b7-8d38-0559c0c7fd60 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:26.220889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:26.287909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299b10e-5568-40b7-8d38-0559c0c7fd60 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:26.322125 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b296dea-e171-4c64-9d83-9db3d12d5ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:26.322913 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b296dea-e171-4c64-9d83-9db3d12d5ace None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:26.323191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b296dea-e171-4c64-9d83-9db3d12d5ace None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:26.323460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b296dea-e171-4c64-9d83-9db3d12d5ace None admin] PATH_INFO: `/v3/users/placement` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:26.331009 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b296dea-e171-4c64-9d83-9db3d12d5ace None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:26.332465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b296dea-e171-4c64-9d83-9db3d12d5ace None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:26.347131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-5b296dea-e171-4c64-9d83-9db3d12d5ace None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 22 16:44:26.347131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:26.347131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:26.347131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:26.347131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:26.347131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:26.347131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:26.347131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:26.347131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:26.347131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:26.347131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:26.347131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:26.347131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 22 16:44:26.347131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 22 16:44:26.347131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 22 16:44:26.347131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 22 16:44:26.348218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:26.348218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:26.348218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 22 16:44:26.348218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:44:26.348218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 22 16:44:26.348218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 22 16:44:26.348218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:26.348218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:26.348218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:26.348218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:26.348218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:26.348218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:26.348218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:26.348218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:26.348218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:26.348218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:26.348218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:26.348218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:26.349275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:26.349275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:26.349275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 22 16:44:26.349275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 22 16:44:26.349275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 22 16:44:26.349275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 22 16:44:26.349275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 22 16:44:26.349275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 22 16:44:26.349275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 22 16:44:26.349275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:26.349275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 636/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:44:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:26.354799 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685443a-5ee9-41ed-b466-9182b8a0ced3 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:26.358506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:26.450580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685443a-5ee9-41ed-b466-9182b8a0ced3 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:26.483504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aefa57-594c-459d-98d1-d62d90453365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:26.484125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aefa57-594c-459d-98d1-d62d90453365 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:26.484411 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aefa57-594c-459d-98d1-d62d90453365 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:26.484685 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aefa57-594c-459d-98d1-d62d90453365 None admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:26.485516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aefa57-594c-459d-98d1-d62d90453365 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:26.485826 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aefa57-594c-459d-98d1-d62d90453365 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:26.487256 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aefa57-594c-459d-98d1-d62d90453365 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:26.503696 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 645/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jun 22 16:44:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:26.509542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b296dea-e171-4c64-9d83-9db3d12d5ace None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:26.608188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:26.617324 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b296dea-e171-4c64-9d83-9db3d12d5ace None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:26.649812 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46259dd-9155-4860-be82-a839cc2fde3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:26.650447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46259dd-9155-4860-be82-a839cc2fde3f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:26.650729 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46259dd-9155-4860-be82-a839cc2fde3f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:26.651004 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46259dd-9155-4860-be82-a839cc2fde3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:26.717382 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46259dd-9155-4860-be82-a839cc2fde3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:26.718854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46259dd-9155-4860-be82-a839cc2fde3f None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:26.804610 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:26.814305 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 637/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jun 22 16:44:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 22 16:44:26.820229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aefa57-594c-459d-98d1-d62d90453365 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:26.881909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:26.919783 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aefa57-594c-459d-98d1-d62d90453365 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:26.952416 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2a02f-15bd-4deb-bf3c-b43c30454c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:26.953254 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2a02f-15bd-4deb-bf3c-b43c30454c00 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:26.953479 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2a02f-15bd-4deb-bf3c-b43c30454c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:26.953757 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2a02f-15bd-4deb-bf3c-b43c30454c00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:26.963814 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2a02f-15bd-4deb-bf3c-b43c30454c00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:26.965288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2a02f-15bd-4deb-bf3c-b43c30454c00 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:26.982724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-7cd2a02f-15bd-4deb-bf3c-b43c30454c00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:26.982724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:26.982724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:26.982724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:26.982724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:26.982724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:26.982724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:26.982724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:26.982724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:26.982724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:26.982724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:26.982724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:26.982724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 22 16:44:26.982724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 22 16:44:26.982724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 22 16:44:26.983760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 22 16:44:26.983760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:26.983760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:26.983760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:26.983760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:26.983760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:26.983760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:26.983760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:26.983760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:26.983760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:26.983760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:26.983760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:26.983760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:26.983760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:26.983760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:26.983760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:26.983760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:26.984921 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 22 16:44:26.984921 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 22 16:44:26.984921 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 22 16:44:26.984921 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:44:26.984921 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 646/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:26.989677 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46259dd-9155-4860-be82-a839cc2fde3f None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:27.088301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46259dd-9155-4860-be82-a839cc2fde3f None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:27.121389 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35547a9-3ab7-4b7d-8cfe-a9b54e22a67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:27.128943 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35547a9-3ab7-4b7d-8cfe-a9b54e22a67a None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:27.128943 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35547a9-3ab7-4b7d-8cfe-a9b54e22a67a None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:27.128943 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35547a9-3ab7-4b7d-8cfe-a9b54e22a67a None admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:27.128943 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35547a9-3ab7-4b7d-8cfe-a9b54e22a67a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:27.128943 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35547a9-3ab7-4b7d-8cfe-a9b54e22a67a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:27.129453 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35547a9-3ab7-4b7d-8cfe-a9b54e22a67a None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:27.142684 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 638/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jun 22 16:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:27.148595 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2a02f-15bd-4deb-bf3c-b43c30454c00 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:27.244362 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2a02f-15bd-4deb-bf3c-b43c30454c00 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:27.257695 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:27.277304 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd8338-3c17-4462-9df3-b05e52e14f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:27.278078 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd8338-3c17-4462-9df3-b05e52e14f7a None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:27.278362 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd8338-3c17-4462-9df3-b05e52e14f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:27.278640 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd8338-3c17-4462-9df3-b05e52e14f7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:27.285011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd8338-3c17-4462-9df3-b05e52e14f7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:27.286453 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd8338-3c17-4462-9df3-b05e52e14f7a None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:27.301178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application [None req-cecd8338-3c17-4462-9df3-b05e52e14f7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:44:27.301178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:27.301178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:27.301178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:27.301178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:27.301178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:27.301178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:27.301178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:27.301178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:27.301178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:27.301178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:27.301178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:27.301178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 22 16:44:27.301178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 22 16:44:27.301178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 22 16:44:27.302117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 22 16:44:27.302117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:27.302117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:27.302117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:27.302117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:27.302117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:27.302117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:27.302117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:27.302117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:27.302117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:27.302117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:27.302117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:27.302117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:27.302117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:27.302117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:27.302117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:27.302117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:27.303338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 22 16:44:27.303338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 22 16:44:27.303338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 22 16:44:27.303338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 22 16:44:27.303338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 22 16:44:27.303338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 22 16:44:27.303338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 22 16:44:27.303338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: ERROR keystone.server.flask.application Jun 22 16:44:27.303338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 647/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jun 22 16:44:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:27.308753 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35547a9-3ab7-4b7d-8cfe-a9b54e22a67a None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:27.357393 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:27.405515 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35547a9-3ab7-4b7d-8cfe-a9b54e22a67a None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:27.437755 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7471433-ae2f-4df2-844a-741bb8d20c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:27.438400 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7471433-ae2f-4df2-844a-741bb8d20c2f None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:27.438687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7471433-ae2f-4df2-844a-741bb8d20c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:27.438967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7471433-ae2f-4df2-844a-741bb8d20c2f None admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:27.439756 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7471433-ae2f-4df2-844a-741bb8d20c2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:27.440068 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7471433-ae2f-4df2-844a-741bb8d20c2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:27.441554 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7471433-ae2f-4df2-844a-741bb8d20c2f None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:27.454141 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 639/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jun 22 16:44:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:27.460257 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd8338-3c17-4462-9df3-b05e52e14f7a None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:27.559690 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd8338-3c17-4462-9df3-b05e52e14f7a None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:27.591953 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44693bc-f322-41dc-a53a-31496ce24736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:27.592628 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44693bc-f322-41dc-a53a-31496ce24736 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:27.592912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44693bc-f322-41dc-a53a-31496ce24736 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:27.593186 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44693bc-f322-41dc-a53a-31496ce24736 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:27.594018 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44693bc-f322-41dc-a53a-31496ce24736 None admin] RBAC: Adding query filter params (role.id=459b0e5c21c94fb1b81f76c65780fdb5, scope.project.id=59d78923fdef459abaf240bd0975494a, user.id=5a79a71fa89446c3abbb4fdbf2c93aac) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:27.594331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44693bc-f322-41dc-a53a-31496ce24736 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:27.595747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44693bc-f322-41dc-a53a-31496ce24736 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:27.601514 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 648/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jun 22 16:44:27 2022] GET /identity/v3/role_assignments?user.id=5a79a71fa89446c3abbb4fdbf2c93aac&scope.project.id=59d78923fdef459abaf240bd0975494a&role.id=459b0e5c21c94fb1b81f76c65780fdb5 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:29.628317 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42be70-e93a-48b9-aa35-ea96bfaa6f1a None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:29.628865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42be70-e93a-48b9-aa35-ea96bfaa6f1a None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:29.628865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42be70-e93a-48b9-aa35-ea96bfaa6f1a None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:29.630244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 640/1288] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:44:29.635583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb5ba3-42e8-4e0d-a58d-6b15bd32a646 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:29.635990 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb5ba3-42e8-4e0d-a58d-6b15bd32a646 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:29.636167 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb5ba3-42e8-4e0d-a58d-6b15bd32a646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:29.653246 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-3fbb5ba3-42e8-4e0d-a58d-6b15bd32a646 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:44:29.654420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3fbb5ba3-42e8-4e0d-a58d-6b15bd32a646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:44:29.683323 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:29.719580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 649/1289] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:44:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:44:29.742061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42be70-e93a-48b9-aa35-ea96bfaa6f1a None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:29.844387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42be70-e93a-48b9-aa35-ea96bfaa6f1a None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:29.854900 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:29.876860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe1078-af99-4954-a5fb-7b253abbba9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:29.877643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe1078-af99-4954-a5fb-7b253abbba9b None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:29.877931 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe1078-af99-4954-a5fb-7b253abbba9b None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:29.878205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe1078-af99-4954-a5fb-7b253abbba9b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:29.878905 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe1078-af99-4954-a5fb-7b253abbba9b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:29.880257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe1078-af99-4954-a5fb-7b253abbba9b None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:29.892658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-6dbe1078-af99-4954-a5fb-7b253abbba9b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 16:44:29.892658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:29.892658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:44:29.892658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:44:29.892658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:44:29.892658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:44:29.892658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:44:29.892658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:44:29.892658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 16:44:29.892658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:29.892658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:44:29.892658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:29.892658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:29.892658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:29.892658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:29.892658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:29.892658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:29.893922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:29.893922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:29.893922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:29.893922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:29.893922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:29.893922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:29.893922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:44:29.893922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:44:29.893922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:44:29.893922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:44:29.893922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:29.893922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:29.893922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:29.893922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:29.893922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:29.893922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:29.894966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:29.894966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:29.894966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:29.894966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:29.894966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:29.894966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:29.894966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:29.894966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:29.894966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:29.894966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:29.894966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:44:29.894966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:44:29.894966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 16:44:29.894966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:29.894966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 641/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jun 22 16:44:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:29.900625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb5ba3-42e8-4e0d-a58d-6b15bd32a646 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:29.996454 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb5ba3-42e8-4e0d-a58d-6b15bd32a646 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:30.031123 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ffe66-11b4-465d-aa60-b1812530832f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:30.031780 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ffe66-11b4-465d-aa60-b1812530832f None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:30.032063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ffe66-11b4-465d-aa60-b1812530832f None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:30.032365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ffe66-11b4-465d-aa60-b1812530832f None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:30.033067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ffe66-11b4-465d-aa60-b1812530832f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:30.033370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ffe66-11b4-465d-aa60-b1812530832f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:30.034726 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ffe66-11b4-465d-aa60-b1812530832f None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:30.039631 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 650/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Jun 22 16:44:29 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:30.045526 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe1078-af99-4954-a5fb-7b253abbba9b None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:30.147380 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe1078-af99-4954-a5fb-7b253abbba9b None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:30.187490 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bf5aa-7c9f-4795-a3ee-cde1ec58018c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:30.188189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bf5aa-7c9f-4795-a3ee-cde1ec58018c None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:30.188485 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bf5aa-7c9f-4795-a3ee-cde1ec58018c None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:30.188751 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bf5aa-7c9f-4795-a3ee-cde1ec58018c None admin] PATH_INFO: `/v3/services` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:30.189486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bf5aa-7c9f-4795-a3ee-cde1ec58018c None admin] RBAC: Adding query filter params (type=placement) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:30.189799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bf5aa-7c9f-4795-a3ee-cde1ec58018c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:30.191193 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bf5aa-7c9f-4795-a3ee-cde1ec58018c None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:30.196958 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 642/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Jun 22 16:44:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:32.249557 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b6999-d556-445a-ae60-7866fd5291c3 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:32.250108 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b6999-d556-445a-ae60-7866fd5291c3 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:32.250205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b6999-d556-445a-ae60-7866fd5291c3 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:32.251514 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 651/1293] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:44:32.256670 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb6461-ba08-441f-81ba-d84371147d5a None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:32.257102 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb6461-ba08-441f-81ba-d84371147d5a None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:32.257215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb6461-ba08-441f-81ba-d84371147d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:32.277231 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-0deb6461-ba08-441f-81ba-d84371147d5a None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:44:32.277231 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0deb6461-ba08-441f-81ba-d84371147d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:44:32.305008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:32.340883 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 643/1294] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:44:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:44:32.363891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b6999-d556-445a-ae60-7866fd5291c3 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:32.395518 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:32.463102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b6999-d556-445a-ae60-7866fd5291c3 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:32.498546 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca840963-d75d-4cc9-86a0-d98569509da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:32.499202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca840963-d75d-4cc9-86a0-d98569509da7 None admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:32.499488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca840963-d75d-4cc9-86a0-d98569509da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:32.499766 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca840963-d75d-4cc9-86a0-d98569509da7 None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:32.500531 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca840963-d75d-4cc9-86a0-d98569509da7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:32.501984 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca840963-d75d-4cc9-86a0-d98569509da7 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:32.575256 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 652/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jun 22 16:44:32 2022] POST /identity/v3/services => generated 246 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:44:34.607280 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d135a1c-f492-43f6-9459-93827d6ad454 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:34.607845 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d135a1c-f492-43f6-9459-93827d6ad454 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:34.607845 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d135a1c-f492-43f6-9459-93827d6ad454 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:34.609342 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 644/1296] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:44:34.614473 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce9f40-be49-4eea-a766-b910ed7aeeb7 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:34.614897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce9f40-be49-4eea-a766-b910ed7aeeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:34.615048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce9f40-be49-4eea-a766-b910ed7aeeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:34.632385 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-d6ce9f40-be49-4eea-a766-b910ed7aeeb7 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:44:34.633650 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d6ce9f40-be49-4eea-a766-b910ed7aeeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:44:34.704658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 653/1297] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:44:34 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:44:34.728250 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d135a1c-f492-43f6-9459-93827d6ad454 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:34.827042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d135a1c-f492-43f6-9459-93827d6ad454 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:34.865442 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d5616-73d9-4d95-bdb2-7d420153e98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:34.866159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5616-73d9-4d95-bdb2-7d420153e98e None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:34.866446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5616-73d9-4d95-bdb2-7d420153e98e None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:34.866718 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5616-73d9-4d95-bdb2-7d420153e98e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:34.867371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d5616-73d9-4d95-bdb2-7d420153e98e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:34.868775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d5616-73d9-4d95-bdb2-7d420153e98e None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:34.880570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-fc6d5616-73d9-4d95-bdb2-7d420153e98e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 16:44:34.880570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:34.880570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:44:34.880570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:44:34.880570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:44:34.880570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:44:34.880570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:44:34.880570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:44:34.880570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 16:44:34.880570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:34.880570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:44:34.880570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:34.880570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:34.880570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:34.880570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:34.880570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:34.880570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:34.885948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:34.885948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:34.885948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:34.885948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:34.885948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:34.885948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:34.885948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:44:34.885948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:44:34.885948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:44:34.885948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:44:34.885948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:34.885948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:34.885948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:34.885948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:34.885948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:34.885948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:34.887041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:34.887041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:34.887041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:34.887041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:34.887041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:34.887041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:34.887041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:34.887041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:34.887041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:34.887041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:34.887041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:44:34.887041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:44:34.887041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 16:44:34.887041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:34.887041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 645/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jun 22 16:44:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:34.889271 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce9f40-be49-4eea-a766-b910ed7aeeb7 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:34.908406 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:34.986514 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce9f40-be49-4eea-a766-b910ed7aeeb7 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:35.019202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8607929-b78c-4b96-909e-bd87837df5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:35.019862 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8607929-b78c-4b96-909e-bd87837df5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:35.020182 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8607929-b78c-4b96-909e-bd87837df5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:35.020460 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8607929-b78c-4b96-909e-bd87837df5e3 None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:35.021170 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8607929-b78c-4b96-909e-bd87837df5e3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:35.021478 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8607929-b78c-4b96-909e-bd87837df5e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:35.022848 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8607929-b78c-4b96-909e-bd87837df5e3 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:35.028565 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 654/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Jun 22 16:44:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:35.034311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d5616-73d9-4d95-bdb2-7d420153e98e None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:35.064973 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:35.130264 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d5616-73d9-4d95-bdb2-7d420153e98e None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:35.162971 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d34145-5ae5-4286-990c-0b5f3b5717ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:35.163609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d34145-5ae5-4286-990c-0b5f3b5717ef None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:35.163895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d34145-5ae5-4286-990c-0b5f3b5717ef None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:35.164218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d34145-5ae5-4286-990c-0b5f3b5717ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:35.165006 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d34145-5ae5-4286-990c-0b5f3b5717ef None admin] RBAC: Adding query filter params (interface=public, service_id=b9045510d83f4b3391f9b971e932b035, region_id=RegionOne) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:35.165321 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d34145-5ae5-4286-990c-0b5f3b5717ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:35.166678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d34145-5ae5-4286-990c-0b5f3b5717ef None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:35.172748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 646/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jun 22 16:44:35 2022] GET /identity/v3/endpoints?service_id=b9045510d83f4b3391f9b971e932b035&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:35.178499 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8607929-b78c-4b96-909e-bd87837df5e3 None admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:35.259108 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:35.277139 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8607929-b78c-4b96-909e-bd87837df5e3 None admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:35.309558 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268f998-050b-4e8f-a2d0-09da0755b927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:35.310248 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268f998-050b-4e8f-a2d0-09da0755b927 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:35.310540 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268f998-050b-4e8f-a2d0-09da0755b927 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:35.310822 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268f998-050b-4e8f-a2d0-09da0755b927 None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:35.311506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268f998-050b-4e8f-a2d0-09da0755b927 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:35.312908 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268f998-050b-4e8f-a2d0-09da0755b927 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:35.319661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 655/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jun 22 16:44:35 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:44:37.357285 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a67d9-fb8e-4a24-9b05-14fcba4913ff None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:37.357868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a67d9-fb8e-4a24-9b05-14fcba4913ff None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:37.357868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a67d9-fb8e-4a24-9b05-14fcba4913ff None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:37.359212 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 647/1302] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:44:37.364485 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54747e69-cfc8-4b17-8164-b07c2700720d None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:37.364861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54747e69-cfc8-4b17-8164-b07c2700720d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:37.365044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54747e69-cfc8-4b17-8164-b07c2700720d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:37.380803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-54747e69-cfc8-4b17-8164-b07c2700720d None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:44:37.381977 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-54747e69-cfc8-4b17-8164-b07c2700720d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:44:37.447730 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 656/1303] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:44:37 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 22 16:44:37.471589 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a67d9-fb8e-4a24-9b05-14fcba4913ff None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:37.562484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:37.568951 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a67d9-fb8e-4a24-9b05-14fcba4913ff None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:37.602188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acf65c-1ac8-477d-880c-57f0ecd50e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:37.602971 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acf65c-1ac8-477d-880c-57f0ecd50e57 None admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:37.603254 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acf65c-1ac8-477d-880c-57f0ecd50e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:37.603529 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acf65c-1ac8-477d-880c-57f0ecd50e57 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:37.604219 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acf65c-1ac8-477d-880c-57f0ecd50e57 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:37.605568 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acf65c-1ac8-477d-880c-57f0ecd50e57 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:37.617748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application [None req-70acf65c-1ac8-477d-880c-57f0ecd50e57 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 16:44:37.617748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:37.617748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 22 16:44:37.617748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 22 16:44:37.617748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 22 16:44:37.617748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 22 16:44:37.617748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 22 16:44:37.617748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:44:37.617748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 16:44:37.617748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:37.617748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 22 16:44:37.617748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:37.617748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 22 16:44:37.617748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 22 16:44:37.617748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 22 16:44:37.617748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 22 16:44:37.617748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 22 16:44:37.619038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 22 16:44:37.619038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 22 16:44:37.619038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 22 16:44:37.619038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 22 16:44:37.619038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 22 16:44:37.619038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 22 16:44:37.619038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 22 16:44:37.619038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 22 16:44:37.619038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 22 16:44:37.619038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 22 16:44:37.619038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 22 16:44:37.619038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 22 16:44:37.619038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 22 16:44:37.619038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 22 16:44:37.619038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 22 16:44:37.619038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.get_or_create( Jun 22 16:44:37.620237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 22 16:44:37.620237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application with Lock( Jun 22 16:44:37.620237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 22 16:44:37.620237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self._enter() Jun 22 16:44:37.620237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 22 16:44:37.620237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 22 16:44:37.620237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 22 16:44:37.620237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application return self.creator() Jun 22 16:44:37.620237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 22 16:44:37.620237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application created_value = creator( Jun 22 16:44:37.620237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 22 16:44:37.620237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 22 16:44:37.620237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 22 16:44:37.620237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: ERROR keystone.server.flask.application Jun 22 16:44:37.620237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 648/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jun 22 16:44:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 22 16:44:37.624911 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54747e69-cfc8-4b17-8164-b07c2700720d None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:37.698473 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:37.719898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54747e69-cfc8-4b17-8164-b07c2700720d None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:37.751629 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d67d26-24b6-4ab8-a09f-19b07f485273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:37.752316 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d67d26-24b6-4ab8-a09f-19b07f485273 None admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:37.752601 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d67d26-24b6-4ab8-a09f-19b07f485273 None admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:37.752878 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d67d26-24b6-4ab8-a09f-19b07f485273 None admin] PATH_INFO: `/v3/services` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:37.753585 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d67d26-24b6-4ab8-a09f-19b07f485273 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:44:37.753891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d67d26-24b6-4ab8-a09f-19b07f485273 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:37.755250 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d67d26-24b6-4ab8-a09f-19b07f485273 None admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:37.760818 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 657/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Jun 22 16:44:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:44:37.766837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acf65c-1ac8-477d-880c-57f0ecd50e57 None admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:44:37.862272 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acf65c-1ac8-477d-880c-57f0ecd50e57 None admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:44:37.896210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98ccd5-1e07-4412-b301-6ed765537a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:44:37.896792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98ccd5-1e07-4412-b301-6ed765537a92 None admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:44:37.897075 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98ccd5-1e07-4412-b301-6ed765537a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:44:37.897351 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98ccd5-1e07-4412-b301-6ed765537a92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:44:37.898091 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98ccd5-1e07-4412-b301-6ed765537a92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:44:37.899444 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98ccd5-1e07-4412-b301-6ed765537a92 None admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:44:37.995279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 649/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jun 22 16:44:37 2022] POST /identity/v3/endpoints => generated 331 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:44:47.771592 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=30 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:44:47.989951 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:50:35.599909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad53c64-95a3-465e-862f-c4b381faffea None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:35.600526 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad53c64-95a3-465e-862f-c4b381faffea None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:35.600526 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad53c64-95a3-465e-862f-c4b381faffea None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:35.607231 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a132457-a2b3-464f-b57d-73992f5b4218 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:35.607694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a132457-a2b3-464f-b57d-73992f5b4218 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:35.607779 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a132457-a2b3-464f-b57d-73992f5b4218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:35.611282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 658/1307] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:50:35 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:50:35.694671 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-7a132457-a2b3-464f-b57d-73992f5b4218 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:50:35.695804 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-7a132457-a2b3-464f-b57d-73992f5b4218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:35.870441 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 650/1308] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:50:35.912603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29568bd-4ff4-4fdf-8148-d07e5c01ed90 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:35.912805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29568bd-4ff4-4fdf-8148-d07e5c01ed90 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:35.913094 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29568bd-4ff4-4fdf-8148-d07e5c01ed90 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:35.914761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 659/1309] 10.222.0.18 () {54 vars in 964 bytes} [Wed Jun 22 16:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:50:35.923837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7772b3-4ee1-46f8-b0e1-04349bed97dd None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:35.924299 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7772b3-4ee1-46f8-b0e1-04349bed97dd None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:35.924651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7772b3-4ee1-46f8-b0e1-04349bed97dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:36.020539 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-cf7772b3-4ee1-46f8-b0e1-04349bed97dd None None] MFA Rules not processed for user `9090c22ba9f041e2a8d00750d853435a`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:50:36.021968 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-cf7772b3-4ee1-46f8-b0e1-04349bed97dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:36.044806 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:50:36.104040 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 651/1310] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Jun 22 16:50:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:50:36.114878 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29568bd-4ff4-4fdf-8148-d07e5c01ed90 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:50:36.120466 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e29568bd-4ff4-4fdf-8148-d07e5c01ed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:36.233802 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29568bd-4ff4-4fdf-8148-d07e5c01ed90 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:50:36.309438 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee8762-c6a7-4a16-85f8-2a5544e84027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:50:36.310090 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee8762-c6a7-4a16-85f8-2a5544e84027 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:36.310373 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee8762-c6a7-4a16-85f8-2a5544e84027 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:36.310651 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee8762-c6a7-4a16-85f8-2a5544e84027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:36.312331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-ddee8762-c6a7-4a16-85f8-2a5544e84027 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:36.368035 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:50:36.425043 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee8762-c6a7-4a16-85f8-2a5544e84027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:50:36.427026 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee8762-c6a7-4a16-85f8-2a5544e84027 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:50:36.446701 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 660/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:50:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:50:38.848445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55741f68-c057-4712-a021-40283773ccc3 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:38.848974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55741f68-c057-4712-a021-40283773ccc3 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:38.849085 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55741f68-c057-4712-a021-40283773ccc3 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:38.850573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 652/1312] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:50:38.855557 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fee4ff-5338-49a5-96e6-6d1f8628e32a None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:38.855948 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fee4ff-5338-49a5-96e6-6d1f8628e32a None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:38.856144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fee4ff-5338-49a5-96e6-6d1f8628e32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:38.932029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-44fee4ff-5338-49a5-96e6-6d1f8628e32a None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:50:38.933665 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-44fee4ff-5338-49a5-96e6-6d1f8628e32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:39.048176 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 661/1313] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:50:39.094851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c19e2-f421-432f-95db-51480d9dbc08 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:39.095156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c19e2-f421-432f-95db-51480d9dbc08 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:39.095549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c19e2-f421-432f-95db-51480d9dbc08 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:39.097059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 653/1314] 10.222.0.18 () {54 vars in 964 bytes} [Wed Jun 22 16:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:50:39.102935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8bfc4-38cb-4978-8ac7-3425f3b381fd None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:39.103170 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8bfc4-38cb-4978-8ac7-3425f3b381fd None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:39.103448 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8bfc4-38cb-4978-8ac7-3425f3b381fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:39.114355 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:50:39.192733 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-8fe8bfc4-38cb-4978-8ac7-3425f3b381fd None None] MFA Rules not processed for user `9090c22ba9f041e2a8d00750d853435a`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:50:39.193965 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-8fe8bfc4-38cb-4978-8ac7-3425f3b381fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:39.291886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 662/1315] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Jun 22 16:50:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:50:39.301297 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c19e2-f421-432f-95db-51480d9dbc08 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:50:39.302891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-ce5c19e2-f421-432f-95db-51480d9dbc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:39.411099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c19e2-f421-432f-95db-51480d9dbc08 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:50:39.483496 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:50:39.486234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010e090-0439-4238-9a27-3fd5992dc5ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:50:39.486887 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010e090-0439-4238-9a27-3fd5992dc5ff service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:39.487171 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010e090-0439-4238-9a27-3fd5992dc5ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:39.487449 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010e090-0439-4238-9a27-3fd5992dc5ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:39.489186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0010e090-0439-4238-9a27-3fd5992dc5ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:39.598821 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010e090-0439-4238-9a27-3fd5992dc5ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:50:39.600244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010e090-0439-4238-9a27-3fd5992dc5ff service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:50:39.618142 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 654/1316] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:50:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:50:42.335723 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b01cd-9ae0-4efe-86e4-441e1dc03506 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:42.336278 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b01cd-9ae0-4efe-86e4-441e1dc03506 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:42.336385 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b01cd-9ae0-4efe-86e4-441e1dc03506 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:42.337723 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 663/1317] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:50:42.342713 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83952a8-bd0c-478e-bda1-ccbfab25ef98 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:42.343083 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83952a8-bd0c-478e-bda1-ccbfab25ef98 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:42.343267 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83952a8-bd0c-478e-bda1-ccbfab25ef98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:42.405858 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-b83952a8-bd0c-478e-bda1-ccbfab25ef98 None None] MFA Rules not processed for user `bb405bf4f38249d1957087830723f0ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:50:42.407045 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b83952a8-bd0c-478e-bda1-ccbfab25ef98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:42.457049 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:50:42.500445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 655/1318] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:50:42 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:50:42.542799 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b01cd-9ae0-4efe-86e4-441e1dc03506 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:50:42.544387 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-937b01cd-9ae0-4efe-86e4-441e1dc03506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:42.642755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b01cd-9ae0-4efe-86e4-441e1dc03506 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:50:42.645589 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:50:42.715321 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c2bd5-ec53-4a0d-affd-ce77909844f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:50:42.715960 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c2bd5-ec53-4a0d-affd-ce77909844f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:42.716277 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c2bd5-ec53-4a0d-affd-ce77909844f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:42.716548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c2bd5-ec53-4a0d-affd-ce77909844f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:42.718161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-b12c2bd5-ec53-4a0d-affd-ce77909844f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:42.820603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c2bd5-ec53-4a0d-affd-ce77909844f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:50:42.822022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c2bd5-ec53-4a0d-affd-ce77909844f2 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:50:42.840040 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 664/1319] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:50:42 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:50:45.656837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b09655-ba11-435d-b282-4557ac75f70b None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:45.657377 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b09655-ba11-435d-b282-4557ac75f70b None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:45.657377 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b09655-ba11-435d-b282-4557ac75f70b None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:45.658784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 656/1320] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:50:45.663976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7aae5e-b86a-4f8e-94cc-4359e08e8d15 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:45.664445 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7aae5e-b86a-4f8e-94cc-4359e08e8d15 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:45.664545 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7aae5e-b86a-4f8e-94cc-4359e08e8d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:45.702533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:50:45.726581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-3b7aae5e-b86a-4f8e-94cc-4359e08e8d15 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:50:45.727769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3b7aae5e-b86a-4f8e-94cc-4359e08e8d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:45.820981 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 665/1321] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:50:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:50:45.859520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b09655-ba11-435d-b282-4557ac75f70b None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:50:45.861088 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-14b09655-ba11-435d-b282-4557ac75f70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:45.963110 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b09655-ba11-435d-b282-4557ac75f70b None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:50:46.037311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49a14d-106e-4c9d-a955-5b39424ca619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:50:46.037959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49a14d-106e-4c9d-a955-5b39424ca619 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:46.038237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49a14d-106e-4c9d-a955-5b39424ca619 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:46.038509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49a14d-106e-4c9d-a955-5b39424ca619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:46.040184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-5a49a14d-106e-4c9d-a955-5b39424ca619 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:46.048438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:50:46.146702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49a14d-106e-4c9d-a955-5b39424ca619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:50:46.148410 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49a14d-106e-4c9d-a955-5b39424ca619 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:50:46.165811 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 657/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:50:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:50:49.260747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdf135-86ea-4a1b-8029-795d53d4bd1d None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:49.261266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdf135-86ea-4a1b-8029-795d53d4bd1d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:49.261355 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdf135-86ea-4a1b-8029-795d53d4bd1d None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:49.262814 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 666/1323] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:50:49.267806 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc742f8d-4dd0-4fca-90f0-60aca0045bbb None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:49.268232 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc742f8d-4dd0-4fca-90f0-60aca0045bbb None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:49.268414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc742f8d-4dd0-4fca-90f0-60aca0045bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:49.332372 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-fc742f8d-4dd0-4fca-90f0-60aca0045bbb None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:50:49.334135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-fc742f8d-4dd0-4fca-90f0-60aca0045bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:49.406414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:50:49.448181 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 658/1324] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:50:49.484961 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdf135-86ea-4a1b-8029-795d53d4bd1d None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:50:49.486543 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-4acdf135-86ea-4a1b-8029-795d53d4bd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:49.594058 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdf135-86ea-4a1b-8029-795d53d4bd1d None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:50:49.606093 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:50:49.666801 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d23f0-9a3f-4320-adae-9b992d666464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:50:49.667441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d23f0-9a3f-4320-adae-9b992d666464 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:49.667721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d23f0-9a3f-4320-adae-9b992d666464 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:49.667994 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d23f0-9a3f-4320-adae-9b992d666464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:49.669710 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-9f5d23f0-9a3f-4320-adae-9b992d666464 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:49.777337 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d23f0-9a3f-4320-adae-9b992d666464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:50:49.778686 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d23f0-9a3f-4320-adae-9b992d666464 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:50:49.796323 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 667/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:50:51.889050 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87135782-24f4-4064-8845-5a08f56b23df None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:51.889579 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87135782-24f4-4064-8845-5a08f56b23df None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:51.889670 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87135782-24f4-4064-8845-5a08f56b23df None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:51.891001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 659/1326] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:50:51.896222 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cb1d2-0521-4ffc-892f-0d6abeeb415c None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:51.896668 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cb1d2-0521-4ffc-892f-0d6abeeb415c None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:51.896776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cb1d2-0521-4ffc-892f-0d6abeeb415c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:51.942917 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:50:51.960376 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-321cb1d2-0521-4ffc-892f-0d6abeeb415c None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:50:51.961573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-321cb1d2-0521-4ffc-892f-0d6abeeb415c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:52.057616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 668/1327] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:50:52.093425 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87135782-24f4-4064-8845-5a08f56b23df None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:50:52.094998 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-87135782-24f4-4064-8845-5a08f56b23df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:52.200581 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87135782-24f4-4064-8845-5a08f56b23df None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:50:52.278112 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce75b0-3281-40b8-ae34-b96500174285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:50:52.278755 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce75b0-3281-40b8-ae34-b96500174285 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:52.279036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce75b0-3281-40b8-ae34-b96500174285 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:52.279341 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce75b0-3281-40b8-ae34-b96500174285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:52.280990 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e3ce75b0-3281-40b8-ae34-b96500174285 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:52.297244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:50:52.389856 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce75b0-3281-40b8-ae34-b96500174285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:50:52.391291 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce75b0-3281-40b8-ae34-b96500174285 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:50:52.410357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 660/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:50:54.507164 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0c019-2eac-469a-be6e-d1adabe2122a None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:54.507706 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0c019-2eac-469a-be6e-d1adabe2122a None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:54.507706 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0c019-2eac-469a-be6e-d1adabe2122a None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:54.509184 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 669/1329] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:50:54.514534 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bd658-b1f5-488f-bdb3-04ef08dfe545 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:54.514931 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bd658-b1f5-488f-bdb3-04ef08dfe545 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:54.515239 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bd658-b1f5-488f-bdb3-04ef08dfe545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:54.581447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-631bd658-b1f5-488f-bdb3-04ef08dfe545 None None] MFA Rules not processed for user `bb405bf4f38249d1957087830723f0ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:50:54.582722 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-631bd658-b1f5-488f-bdb3-04ef08dfe545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:54.649168 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:50:54.681884 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 661/1330] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:50:54 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:50:54.719233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0c019-2eac-469a-be6e-d1adabe2122a None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:50:54.720880 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-26b0c019-2eac-469a-be6e-d1adabe2122a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:54.822214 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0c019-2eac-469a-be6e-d1adabe2122a None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:50:54.842256 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:50:54.897668 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6f288-3f25-447a-b11c-e9c989c01640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:50:54.898595 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6f288-3f25-447a-b11c-e9c989c01640 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:54.898940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6f288-3f25-447a-b11c-e9c989c01640 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:54.899224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6f288-3f25-447a-b11c-e9c989c01640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:54.900906 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-dfe6f288-3f25-447a-b11c-e9c989c01640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:55.011764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6f288-3f25-447a-b11c-e9c989c01640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:50:55.013257 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6f288-3f25-447a-b11c-e9c989c01640 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:50:55.044804 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 670/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:50:54 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:50:57.577568 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66385018-a3e3-4c99-a81b-b67c1f78612a None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:57.577568 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66385018-a3e3-4c99-a81b-b67c1f78612a None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:57.577568 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66385018-a3e3-4c99-a81b-b67c1f78612a None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:57.578904 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 662/1332] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:50:57.584910 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80fea1-672c-4960-b496-a232a542ed9e None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:57.585293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80fea1-672c-4960-b496-a232a542ed9e None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:57.585448 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80fea1-672c-4960-b496-a232a542ed9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:57.649474 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:50:57.652059 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-ed80fea1-672c-4960-b496-a232a542ed9e None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:50:57.653315 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-ed80fea1-672c-4960-b496-a232a542ed9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:57.761936 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 671/1333] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:50:57.797719 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66385018-a3e3-4c99-a81b-b67c1f78612a None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:50:57.800578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-66385018-a3e3-4c99-a81b-b67c1f78612a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:57.905084 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66385018-a3e3-4c99-a81b-b67c1f78612a None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:50:57.984390 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842c18f-e5dd-4262-af8f-6b8868919aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:50:57.985183 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842c18f-e5dd-4262-af8f-6b8868919aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:50:57.985313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842c18f-e5dd-4262-af8f-6b8868919aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:50:57.985589 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842c18f-e5dd-4262-af8f-6b8868919aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:50:57.987254 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-c842c18f-e5dd-4262-af8f-6b8868919aa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:50:58.016227 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:50:58.097053 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842c18f-e5dd-4262-af8f-6b8868919aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:50:58.099068 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842c18f-e5dd-4262-af8f-6b8868919aa0 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:50:58.117864 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 663/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:50:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:51:00.216879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4290ebf-3859-451d-8200-7833bf1cde45 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:00.217441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4290ebf-3859-451d-8200-7833bf1cde45 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:00.217441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4290ebf-3859-451d-8200-7833bf1cde45 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:00.218833 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 672/1335] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:00.223893 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dfb3f-c54f-4090-b5a3-595d7c3801fb None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:00.224367 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dfb3f-c54f-4090-b5a3-595d7c3801fb None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:00.224500 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dfb3f-c54f-4090-b5a3-595d7c3801fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:00.289140 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-264dfb3f-c54f-4090-b5a3-595d7c3801fb None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:00.290290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-264dfb3f-c54f-4090-b5a3-595d7c3801fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:00.362489 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:51:00.384803 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 664/1336] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:00.424238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4290ebf-3859-451d-8200-7833bf1cde45 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:51:00.425826 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f4290ebf-3859-451d-8200-7833bf1cde45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:00.526663 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4290ebf-3859-451d-8200-7833bf1cde45 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:51:00.554911 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:51:00.599589 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a824d-cac0-4660-91ae-442d47bde0ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:51:00.600262 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a824d-cac0-4660-91ae-442d47bde0ce service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:00.600550 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a824d-cac0-4660-91ae-442d47bde0ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:00.600822 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a824d-cac0-4660-91ae-442d47bde0ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:00.602451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-110a824d-cac0-4660-91ae-442d47bde0ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:00.713108 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a824d-cac0-4660-91ae-442d47bde0ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:51:00.714545 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a824d-cac0-4660-91ae-442d47bde0ce service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:51:00.733129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 673/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:51:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:51:03.387344 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85bb76-ffc5-4da7-9418-ce508efc2e51 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:03.387880 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85bb76-ffc5-4da7-9418-ce508efc2e51 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:03.387995 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85bb76-ffc5-4da7-9418-ce508efc2e51 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:03.389325 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 665/1338] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:03.394374 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b82961-aca1-4cdb-bb45-a20dae804f1b None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:03.394792 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b82961-aca1-4cdb-bb45-a20dae804f1b None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:03.394942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b82961-aca1-4cdb-bb45-a20dae804f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:03.465337 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-27b82961-aca1-4cdb-bb45-a20dae804f1b None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:03.466543 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-27b82961-aca1-4cdb-bb45-a20dae804f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:03.475107 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:51:03.568115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 674/1339] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:51:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:03.603314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85bb76-ffc5-4da7-9418-ce508efc2e51 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:51:03.604900 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-5a85bb76-ffc5-4da7-9418-ce508efc2e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:03.706145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85bb76-ffc5-4da7-9418-ce508efc2e51 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:51:03.777771 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad828a-3fb9-40dd-a7dd-e444b0624a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:51:03.778402 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad828a-3fb9-40dd-a7dd-e444b0624a99 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:03.778687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad828a-3fb9-40dd-a7dd-e444b0624a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:03.778965 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad828a-3fb9-40dd-a7dd-e444b0624a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:03.780628 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-91ad828a-3fb9-40dd-a7dd-e444b0624a99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:03.814354 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:51:03.888509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad828a-3fb9-40dd-a7dd-e444b0624a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:51:03.889938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad828a-3fb9-40dd-a7dd-e444b0624a99 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:51:03.908285 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 666/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:51:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:51:08.119325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54a94b-2e21-41ff-b702-19513dbf0b88 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:08.119846 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54a94b-2e21-41ff-b702-19513dbf0b88 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:08.119980 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54a94b-2e21-41ff-b702-19513dbf0b88 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:08.121300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 675/1341] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:08.126802 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcf9bd-3464-4b0b-b017-e68d745b14c3 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:08.127282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcf9bd-3464-4b0b-b017-e68d745b14c3 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:08.127387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcf9bd-3464-4b0b-b017-e68d745b14c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:08.211091 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-21bcf9bd-3464-4b0b-b017-e68d745b14c3 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:08.212348 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-21bcf9bd-3464-4b0b-b017-e68d745b14c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:08.311363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:51:08.324376 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 667/1342] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:08.364392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54a94b-2e21-41ff-b702-19513dbf0b88 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:51:08.366475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-ba54a94b-2e21-41ff-b702-19513dbf0b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:08.463566 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54a94b-2e21-41ff-b702-19513dbf0b88 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:51:08.467006 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd028541-d2ae-414b-a4b3-c7072b73f25f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:51:08.467646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd028541-d2ae-414b-a4b3-c7072b73f25f service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:08.467931 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd028541-d2ae-414b-a4b3-c7072b73f25f service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:08.468239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd028541-d2ae-414b-a4b3-c7072b73f25f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:08.477082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd028541-d2ae-414b-a4b3-c7072b73f25f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:51:08.478512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd028541-d2ae-414b-a4b3-c7072b73f25f service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:51:08.487675 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 676/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:51:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:51:11.574036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410dab0-6f9a-472b-98b7-ceb7750f1855 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:11.574578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410dab0-6f9a-472b-98b7-ceb7750f1855 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:11.574578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410dab0-6f9a-472b-98b7-ceb7750f1855 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:11.575969 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 668/1344] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:11.581131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bb586-e445-4d83-b293-87b7fa606aca None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:11.581554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bb586-e445-4d83-b293-87b7fa606aca None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:11.581821 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bb586-e445-4d83-b293-87b7fa606aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:11.609144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-7a6bb586-e445-4d83-b293-87b7fa606aca None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:11.610343 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-7a6bb586-e445-4d83-b293-87b7fa606aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:11.638259 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:51:11.686082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 677/1345] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:51:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:11.725772 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410dab0-6f9a-472b-98b7-ceb7750f1855 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:51:11.737608 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410dab0-6f9a-472b-98b7-ceb7750f1855 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:51:11.741609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072202f-62b4-48a9-bc17-aa0df4db93f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:51:11.742206 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072202f-62b4-48a9-bc17-aa0df4db93f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:11.742488 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072202f-62b4-48a9-bc17-aa0df4db93f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:11.742761 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072202f-62b4-48a9-bc17-aa0df4db93f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:11.752076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072202f-62b4-48a9-bc17-aa0df4db93f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:51:11.753528 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072202f-62b4-48a9-bc17-aa0df4db93f2 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:51:11.762961 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 669/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:51:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:51:15.962241 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66bff7-427e-4ed0-afca-593f39a584e2 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:15.962783 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66bff7-427e-4ed0-afca-593f39a584e2 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:15.962783 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e66bff7-427e-4ed0-afca-593f39a584e2 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:15.964094 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 678/1347] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:15.969199 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13013fb1-97fc-41cf-b30f-c2a1a2f5937d None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:15.969583 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13013fb1-97fc-41cf-b30f-c2a1a2f5937d None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:15.969763 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13013fb1-97fc-41cf-b30f-c2a1a2f5937d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:15.987756 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-13013fb1-97fc-41cf-b30f-c2a1a2f5937d None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:15.989009 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-13013fb1-97fc-41cf-b30f-c2a1a2f5937d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:15.996898 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 670/1348] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:16.034723 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66bff7-427e-4ed0-afca-593f39a584e2 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:51:16.046212 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e66bff7-427e-4ed0-afca-593f39a584e2 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:51:16.049825 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6677ab9-e344-4d0c-8bd4-d6fba712a9e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:51:16.050463 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6677ab9-e344-4d0c-8bd4-d6fba712a9e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:16.050754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6677ab9-e344-4d0c-8bd4-d6fba712a9e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:16.051054 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6677ab9-e344-4d0c-8bd4-d6fba712a9e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:16.060475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6677ab9-e344-4d0c-8bd4-d6fba712a9e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:51:16.062426 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6677ab9-e344-4d0c-8bd4-d6fba712a9e6 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:51:16.071729 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 679/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:51:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:51:21.067602 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017d11d-1142-4907-bfae-ab4377f2d4b5 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:21.068053 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017d11d-1142-4907-bfae-ab4377f2d4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:21.068278 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017d11d-1142-4907-bfae-ab4377f2d4b5 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:21.069581 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 671/1350] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 16:51:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:21.074875 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873903b-f94b-43fb-a6fd-2d0aba2c7006 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:21.075739 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873903b-f94b-43fb-a6fd-2d0aba2c7006 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:21.076091 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873903b-f94b-43fb-a6fd-2d0aba2c7006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:21.171025 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-3873903b-f94b-43fb-a6fd-2d0aba2c7006 None None] MFA Rules not processed for user `5a79a71fa89446c3abbb4fdbf2c93aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:21.172336 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3873903b-f94b-43fb-a6fd-2d0aba2c7006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:21.289036 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 680/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 16:51:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:51:25.570273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685efdf5-71cb-43ae-b3a7-834f48e88355 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:25.571216 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685efdf5-71cb-43ae-b3a7-834f48e88355 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:25.571561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685efdf5-71cb-43ae-b3a7-834f48e88355 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:25.573175 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 672/1352] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 16:51:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:25.578915 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33848fe-3dac-46c9-862c-517ceacc444b None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:25.579451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33848fe-3dac-46c9-862c-517ceacc444b None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:25.579451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33848fe-3dac-46c9-862c-517ceacc444b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:25.598912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-c33848fe-3dac-46c9-862c-517ceacc444b None None] MFA Rules not processed for user `5a79a71fa89446c3abbb4fdbf2c93aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:25.600252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c33848fe-3dac-46c9-862c-517ceacc444b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:25.615451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 681/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 16:51:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:25.983327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=13 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:51:27.123691 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a886b7f-b871-4db3-8f15-8b440a3bbd10 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:27.124369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a886b7f-b871-4db3-8f15-8b440a3bbd10 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:27.124369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a886b7f-b871-4db3-8f15-8b440a3bbd10 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:27.125701 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 673/1354] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 16:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:27.131099 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f30bb-f699-4bd1-9516-654ad3f561b1 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:27.131497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f30bb-f699-4bd1-9516-654ad3f561b1 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:27.131661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f30bb-f699-4bd1-9516-654ad3f561b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:27.149669 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-fc5f30bb-f699-4bd1-9516-654ad3f561b1 None None] MFA Rules not processed for user `5a79a71fa89446c3abbb4fdbf2c93aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:27.150861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-fc5f30bb-f699-4bd1-9516-654ad3f561b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:27.159603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 682/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 16:51:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:30.860557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a70da-7ee4-4f0a-b5bb-44c478f162f4 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:30.861457 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a70da-7ee4-4f0a-b5bb-44c478f162f4 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:30.861901 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a70da-7ee4-4f0a-b5bb-44c478f162f4 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:30.867753 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 674/1356] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:51:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:30.869504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9030c0f-d703-4733-98a8-c456ee41d4b3 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:30.870914 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9030c0f-d703-4733-98a8-c456ee41d4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:30.871198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9030c0f-d703-4733-98a8-c456ee41d4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:30.893989 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-a9030c0f-d703-4733-98a8-c456ee41d4b3 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:30.895554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-a9030c0f-d703-4733-98a8-c456ee41d4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:30.905400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 683/1357] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:30.965963 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d9b1b-ecd0-444e-98f8-e3365be281e4 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:30.967695 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d9b1b-ecd0-444e-98f8-e3365be281e4 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:30.968539 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d9b1b-ecd0-444e-98f8-e3365be281e4 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:30.970912 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 675/1358] 10.222.0.18 () {54 vars in 961 bytes} [Wed Jun 22 16:51:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:30.978231 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f783b-d849-4cba-a465-ae38c7295ff8 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:30.979254 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f783b-d849-4cba-a465-ae38c7295ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:30.979759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f783b-d849-4cba-a465-ae38c7295ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:31.033014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:51:31.040991 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-2d7f783b-d849-4cba-a465-ae38c7295ff8 None None] MFA Rules not processed for user `78e7bdfffdc84465a570d135d1d86380`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:31.042986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2d7f783b-d849-4cba-a465-ae38c7295ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:31.127540 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 684/1359] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Jun 22 16:51:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:51:31.136322 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d9b1b-ecd0-444e-98f8-e3365be281e4 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:51:31.153524 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d9b1b-ecd0-444e-98f8-e3365be281e4 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:51:31.159047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc9cdc-035a-4485-b7d6-028c7bea2814 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:51:31.159689 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc9cdc-035a-4485-b7d6-028c7bea2814 service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:31.160773 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc9cdc-035a-4485-b7d6-028c7bea2814 service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:31.161244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc9cdc-035a-4485-b7d6-028c7bea2814 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:31.171442 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc9cdc-035a-4485-b7d6-028c7bea2814 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:51:31.173057 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc9cdc-035a-4485-b7d6-028c7bea2814 service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:51:31.184756 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 676/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:51:33.437983 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b05fe-e03c-4237-be6d-e8b1e87a44df None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:33.438512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b05fe-e03c-4237-be6d-e8b1e87a44df None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:33.438512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b05fe-e03c-4237-be6d-e8b1e87a44df None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:33.439900 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 685/1361] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:51:33.445769 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781b915-7dac-495a-8890-715d3b010195 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:33.446187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781b915-7dac-495a-8890-715d3b010195 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:33.446319 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781b915-7dac-495a-8890-715d3b010195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:33.464266 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-e781b915-7dac-495a-8890-715d3b010195 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:33.465453 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e781b915-7dac-495a-8890-715d3b010195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:33.474079 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 677/1362] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:33.517689 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b05fe-e03c-4237-be6d-e8b1e87a44df None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:51:33.533165 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b05fe-e03c-4237-be6d-e8b1e87a44df None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:51:33.538626 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d616b1f-7a75-4df6-9bb6-2386f03a82d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:51:33.539257 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d616b1f-7a75-4df6-9bb6-2386f03a82d0 service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:33.539540 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d616b1f-7a75-4df6-9bb6-2386f03a82d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:33.539814 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d616b1f-7a75-4df6-9bb6-2386f03a82d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:33.548255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d616b1f-7a75-4df6-9bb6-2386f03a82d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:51:33.549847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d616b1f-7a75-4df6-9bb6-2386f03a82d0 service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:51:33.559836 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 686/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:51:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:51:36.007497 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30242ef-3844-4711-b88b-f13a7585f4bd None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:36.008041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30242ef-3844-4711-b88b-f13a7585f4bd None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:36.008041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30242ef-3844-4711-b88b-f13a7585f4bd None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:36.018414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 678/1364] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:51:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:36.028552 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b92d8-375a-488d-bd48-ed2333db6044 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:36.028552 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b92d8-375a-488d-bd48-ed2333db6044 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:36.028974 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b92d8-375a-488d-bd48-ed2333db6044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:36.057038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-9d7b92d8-375a-488d-bd48-ed2333db6044 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:36.058183 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-9d7b92d8-375a-488d-bd48-ed2333db6044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:36.067127 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 687/1365] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:36.115566 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ff268-9598-4a1b-872c-23012a0b76ba None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:36.116078 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ff268-9598-4a1b-872c-23012a0b76ba None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:36.116423 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ff268-9598-4a1b-872c-23012a0b76ba None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:36.117800 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 679/1366] 10.222.0.18 () {54 vars in 961 bytes} [Wed Jun 22 16:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:36.123389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b47fa2-1dd1-4126-8d16-5b69fb052e56 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:36.123676 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b47fa2-1dd1-4126-8d16-5b69fb052e56 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:36.123985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b47fa2-1dd1-4126-8d16-5b69fb052e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:36.142202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-64b47fa2-1dd1-4126-8d16-5b69fb052e56 None None] MFA Rules not processed for user `78e7bdfffdc84465a570d135d1d86380`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:36.143402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-64b47fa2-1dd1-4126-8d16-5b69fb052e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:36.152815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 688/1367] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Jun 22 16:51:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:36.160811 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ff268-9598-4a1b-872c-23012a0b76ba None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:51:36.177307 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ff268-9598-4a1b-872c-23012a0b76ba None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:51:36.182811 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0a2c4-2aee-4ee4-a6f0-9f1e3f75df81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:51:36.183443 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0a2c4-2aee-4ee4-a6f0-9f1e3f75df81 service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:36.183729 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0a2c4-2aee-4ee4-a6f0-9f1e3f75df81 service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:36.184009 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0a2c4-2aee-4ee4-a6f0-9f1e3f75df81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:36.192642 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0a2c4-2aee-4ee4-a6f0-9f1e3f75df81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:51:36.194210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0a2c4-2aee-4ee4-a6f0-9f1e3f75df81 service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:51:36.203632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 680/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:51:38.438560 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465a013-b5df-4b9f-a57b-b615f1ebdf26 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:38.439112 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465a013-b5df-4b9f-a57b-b615f1ebdf26 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:38.439112 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465a013-b5df-4b9f-a57b-b615f1ebdf26 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:38.440530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 689/1369] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:38.446314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c806450-db54-41ea-8a0d-538f1f665af9 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:38.447064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c806450-db54-41ea-8a0d-538f1f665af9 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:38.447347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c806450-db54-41ea-8a0d-538f1f665af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:38.465921 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-2c806450-db54-41ea-8a0d-538f1f665af9 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:38.467113 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-2c806450-db54-41ea-8a0d-538f1f665af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:38.475676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 681/1370] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:38.519993 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465a013-b5df-4b9f-a57b-b615f1ebdf26 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:51:38.534676 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465a013-b5df-4b9f-a57b-b615f1ebdf26 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:51:38.540488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a3ba3-6fb2-439f-8292-91e86b3fccb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:51:38.541177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a3ba3-6fb2-439f-8292-91e86b3fccb8 service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:38.541465 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a3ba3-6fb2-439f-8292-91e86b3fccb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:38.541744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a3ba3-6fb2-439f-8292-91e86b3fccb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:38.549946 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a3ba3-6fb2-439f-8292-91e86b3fccb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:51:38.551558 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a3ba3-6fb2-439f-8292-91e86b3fccb8 service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:51:38.561219 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 690/1371] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:51:39.071282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20092e-2223-4805-820e-da20bac1f33d None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:39.076809 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20092e-2223-4805-820e-da20bac1f33d None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:39.076809 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20092e-2223-4805-820e-da20bac1f33d None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:39.076809 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 682/1372] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:39.078609 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bca073-e1dc-4fba-939f-3f72b0b2314f None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:39.078899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bca073-e1dc-4fba-939f-3f72b0b2314f None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:39.079365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bca073-e1dc-4fba-939f-3f72b0b2314f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:39.098418 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-81bca073-e1dc-4fba-939f-3f72b0b2314f None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:39.099955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-81bca073-e1dc-4fba-939f-3f72b0b2314f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:39.108660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 691/1373] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:51:39.454759 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fa58a-4724-4969-ad50-6dd4afd07dd1 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:39.454759 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fa58a-4724-4969-ad50-6dd4afd07dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:39.454759 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fa58a-4724-4969-ad50-6dd4afd07dd1 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:39.456961 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 683/1374] 10.222.0.18 () {54 vars in 963 bytes} [Wed Jun 22 16:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:39.461314 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d2c45-9338-418e-8a24-34db3c34c21d None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:39.461800 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d2c45-9338-418e-8a24-34db3c34c21d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:39.461964 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d2c45-9338-418e-8a24-34db3c34c21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:39.512654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-bb7d2c45-9338-418e-8a24-34db3c34c21d None None] MFA Rules not processed for user `5d28208f3127499a98a9d50f8d63ea6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:39.513864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-bb7d2c45-9338-418e-8a24-34db3c34c21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:39.583905 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 692/1375] 10.222.0.18 () {58 vars in 1060 bytes} [Wed Jun 22 16:51:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:39.591284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fa58a-4724-4969-ad50-6dd4afd07dd1 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:51:39.602497 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fa58a-4724-4969-ad50-6dd4afd07dd1 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:51:39.605970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0db402-6a0c-405c-be2e-c69f1290db2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:51:39.606613 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0db402-6a0c-405c-be2e-c69f1290db2e service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:39.606901 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0db402-6a0c-405c-be2e-c69f1290db2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:39.607180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0db402-6a0c-405c-be2e-c69f1290db2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:39.619102 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0db402-6a0c-405c-be2e-c69f1290db2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:51:39.620865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0db402-6a0c-405c-be2e-c69f1290db2e service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:51:39.631909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 684/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 16:51:40.787144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394db659-a0e9-47d4-9d5e-9c1cc615cbf6 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:40.787677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394db659-a0e9-47d4-9d5e-9c1cc615cbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:40.787677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394db659-a0e9-47d4-9d5e-9c1cc615cbf6 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:40.789032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 693/1377] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:40.794298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6133f1-d44b-4b04-90c4-31099aa88f38 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:40.794699 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6133f1-d44b-4b04-90c4-31099aa88f38 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:40.794887 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6133f1-d44b-4b04-90c4-31099aa88f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:40.812567 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-bf6133f1-d44b-4b04-90c4-31099aa88f38 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:40.813759 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-bf6133f1-d44b-4b04-90c4-31099aa88f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:40.822229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 685/1378] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:40.865639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394db659-a0e9-47d4-9d5e-9c1cc615cbf6 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:51:40.880485 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394db659-a0e9-47d4-9d5e-9c1cc615cbf6 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:51:40.885884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71138adf-fd3a-4765-a373-f8f7089671c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:51:40.886518 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71138adf-fd3a-4765-a373-f8f7089671c8 service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:40.886806 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71138adf-fd3a-4765-a373-f8f7089671c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:40.887090 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71138adf-fd3a-4765-a373-f8f7089671c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:40.895145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71138adf-fd3a-4765-a373-f8f7089671c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:51:40.896764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71138adf-fd3a-4765-a373-f8f7089671c8 service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:51:40.900932 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:51:40.906845 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 694/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:51:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:51:43.125275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803e7e8-594f-4040-b10b-4fb4b1b8d8ae None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:43.125848 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803e7e8-594f-4040-b10b-4fb4b1b8d8ae None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:43.125848 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803e7e8-594f-4040-b10b-4fb4b1b8d8ae None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:43.127192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 686/1380] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:43.132657 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8a1ee-4e04-45d4-9bc0-a6bcb9908b8d None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:43.133100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8a1ee-4e04-45d4-9bc0-a6bcb9908b8d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:43.133303 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8a1ee-4e04-45d4-9bc0-a6bcb9908b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:43.151535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-3dc8a1ee-4e04-45d4-9bc0-a6bcb9908b8d None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:43.152741 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3dc8a1ee-4e04-45d4-9bc0-a6bcb9908b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:43.164233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 695/1381] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:51:43.211829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803e7e8-594f-4040-b10b-4fb4b1b8d8ae None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:51:43.231707 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803e7e8-594f-4040-b10b-4fb4b1b8d8ae None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:51:43.240450 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f64e6b-d17c-4db3-9b3a-0414b51ab476 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:51:43.243292 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f64e6b-d17c-4db3-9b3a-0414b51ab476 service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:43.243942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f64e6b-d17c-4db3-9b3a-0414b51ab476 service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:43.244471 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f64e6b-d17c-4db3-9b3a-0414b51ab476 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:43.256863 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f64e6b-d17c-4db3-9b3a-0414b51ab476 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:51:43.258842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f64e6b-d17c-4db3-9b3a-0414b51ab476 service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:51:43.282445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 687/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:51:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:51:45.460526 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ba7b0-f5b5-42b7-b66b-db8dd3ebb8e2 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:45.461082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ba7b0-f5b5-42b7-b66b-db8dd3ebb8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:45.461082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ba7b0-f5b5-42b7-b66b-db8dd3ebb8e2 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:45.462691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 696/1383] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:45.467835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856bb22-5ae1-4734-b865-566fbc65bd47 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:45.468262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856bb22-5ae1-4734-b865-566fbc65bd47 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:45.468449 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856bb22-5ae1-4734-b865-566fbc65bd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:45.487068 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-7856bb22-5ae1-4734-b865-566fbc65bd47 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:45.488282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-7856bb22-5ae1-4734-b865-566fbc65bd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:45.496134 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 688/1384] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:45.539728 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ba7b0-f5b5-42b7-b66b-db8dd3ebb8e2 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:51:45.561580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ba7b0-f5b5-42b7-b66b-db8dd3ebb8e2 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:51:45.569198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc789e89-40a6-4b73-9b88-7e87186c358a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:51:45.570178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc789e89-40a6-4b73-9b88-7e87186c358a service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:45.570663 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc789e89-40a6-4b73-9b88-7e87186c358a service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:45.571228 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc789e89-40a6-4b73-9b88-7e87186c358a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:45.580068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc789e89-40a6-4b73-9b88-7e87186c358a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:51:45.581822 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc789e89-40a6-4b73-9b88-7e87186c358a service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:51:45.593586 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 697/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:51:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:51:47.638994 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabf1fb-1e50-4035-81ed-d36767fb272a None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:47.639677 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabf1fb-1e50-4035-81ed-d36767fb272a None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:47.639677 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabf1fb-1e50-4035-81ed-d36767fb272a None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:47.640992 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 689/1386] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:47.646213 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f474b4-09da-406d-9431-0e72c23f410f None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:47.646732 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f474b4-09da-406d-9431-0e72c23f410f None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:47.646920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f474b4-09da-406d-9431-0e72c23f410f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:47.665541 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-51f474b4-09da-406d-9431-0e72c23f410f None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:47.666696 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-51f474b4-09da-406d-9431-0e72c23f410f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:47.674506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 698/1387] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:47.725625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabf1fb-1e50-4035-81ed-d36767fb272a None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:51:47.745170 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabf1fb-1e50-4035-81ed-d36767fb272a None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:51:47.750840 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d1d6c-6a0d-42fa-a5fd-be4b5cff08da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:51:47.751481 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d1d6c-6a0d-42fa-a5fd-be4b5cff08da service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:47.751811 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d1d6c-6a0d-42fa-a5fd-be4b5cff08da service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:47.752085 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d1d6c-6a0d-42fa-a5fd-be4b5cff08da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:47.761049 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d1d6c-6a0d-42fa-a5fd-be4b5cff08da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:51:47.762622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d1d6c-6a0d-42fa-a5fd-be4b5cff08da service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:51:47.772516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 690/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:51:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:51:50.042745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c2dc1-cf36-4e3c-b390-da956b6ee6f1 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:50.043411 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c2dc1-cf36-4e3c-b390-da956b6ee6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:50.043411 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c2dc1-cf36-4e3c-b390-da956b6ee6f1 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:50.044684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 699/1389] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:50.050175 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add28850-9241-4b31-b557-de2845a02cbe None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:50.050601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add28850-9241-4b31-b557-de2845a02cbe None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:50.050764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add28850-9241-4b31-b557-de2845a02cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:50.068838 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-add28850-9241-4b31-b557-de2845a02cbe None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:50.070046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-add28850-9241-4b31-b557-de2845a02cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:50.077917 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 691/1390] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:50.123440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c2dc1-cf36-4e3c-b390-da956b6ee6f1 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:51:50.139289 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c2dc1-cf36-4e3c-b390-da956b6ee6f1 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:51:50.145477 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32b558-8d8b-49e3-8798-19c3f19d2cb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:51:50.146124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32b558-8d8b-49e3-8798-19c3f19d2cb9 service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:50.146414 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32b558-8d8b-49e3-8798-19c3f19d2cb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:50.146696 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32b558-8d8b-49e3-8798-19c3f19d2cb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:50.155434 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32b558-8d8b-49e3-8798-19c3f19d2cb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:51:50.157063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32b558-8d8b-49e3-8798-19c3f19d2cb9 service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:51:50.166523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 700/1391] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:51:52.386036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc7516-173f-490b-b4ae-7221646fbac9 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:52.386748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc7516-173f-490b-b4ae-7221646fbac9 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:52.386748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc7516-173f-490b-b4ae-7221646fbac9 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:52.387956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 692/1392] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:51:52.393152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d2eb1-029f-4431-bd2c-6b9b2c600554 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:52.393625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d2eb1-029f-4431-bd2c-6b9b2c600554 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:52.393792 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d2eb1-029f-4431-bd2c-6b9b2c600554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:52.411958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-4e7d2eb1-029f-4431-bd2c-6b9b2c600554 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:52.413186 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-4e7d2eb1-029f-4431-bd2c-6b9b2c600554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:52.420918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 701/1393] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:52.464696 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc7516-173f-490b-b4ae-7221646fbac9 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:51:52.479647 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc7516-173f-490b-b4ae-7221646fbac9 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:51:52.485154 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a5338-a470-4860-8d93-cadafa7dd689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:51:52.485846 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a5338-a470-4860-8d93-cadafa7dd689 service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:52.486196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a5338-a470-4860-8d93-cadafa7dd689 service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:52.486486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a5338-a470-4860-8d93-cadafa7dd689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:52.495553 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a5338-a470-4860-8d93-cadafa7dd689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:51:52.497207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a5338-a470-4860-8d93-cadafa7dd689 service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:51:52.506567 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 693/1394] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 16:51:54.712666 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23ac16-96cd-4a5e-8610-3d2b813c2a24 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:54.713234 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23ac16-96cd-4a5e-8610-3d2b813c2a24 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:54.713354 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23ac16-96cd-4a5e-8610-3d2b813c2a24 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:54.714784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 702/1395] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:54.720571 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fb444-dda7-41f6-ab9f-8fa1948c661f None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:54.720998 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fb444-dda7-41f6-ab9f-8fa1948c661f None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:54.721165 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fb444-dda7-41f6-ab9f-8fa1948c661f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:54.738769 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-ef2fb444-dda7-41f6-ab9f-8fa1948c661f None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:54.739943 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-ef2fb444-dda7-41f6-ab9f-8fa1948c661f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:54.747618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 694/1396] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:54.791490 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23ac16-96cd-4a5e-8610-3d2b813c2a24 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:51:54.806366 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23ac16-96cd-4a5e-8610-3d2b813c2a24 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:51:54.811850 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df69dd-be1f-4abf-bbd1-aec851b0d9b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:51:54.812514 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df69dd-be1f-4abf-bbd1-aec851b0d9b5 service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:54.812802 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df69dd-be1f-4abf-bbd1-aec851b0d9b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:54.813080 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df69dd-be1f-4abf-bbd1-aec851b0d9b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:54.822054 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df69dd-be1f-4abf-bbd1-aec851b0d9b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:51:54.823632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df69dd-be1f-4abf-bbd1-aec851b0d9b5 service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:51:54.833101 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 703/1397] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:51:54.912668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a90a18-c095-4076-9851-6fdfa501b56a None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:54.912954 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a90a18-c095-4076-9851-6fdfa501b56a None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:54.913235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a90a18-c095-4076-9851-6fdfa501b56a None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:54.914716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 695/1398] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:54.920762 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240397f-ffd5-49cc-8e69-619c17152fb0 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:54.921053 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240397f-ffd5-49cc-8e69-619c17152fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:54.921332 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240397f-ffd5-49cc-8e69-619c17152fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:54.944622 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-c240397f-ffd5-49cc-8e69-619c17152fb0 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:54.945838 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c240397f-ffd5-49cc-8e69-619c17152fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:54.953880 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 704/1399] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:55.010616 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b5256-269e-4eee-a9c9-48c914bcad96 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:55.010904 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b5256-269e-4eee-a9c9-48c914bcad96 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:55.011183 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b5256-269e-4eee-a9c9-48c914bcad96 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:55.012595 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 696/1400] 10.222.0.18 () {54 vars in 962 bytes} [Wed Jun 22 16:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:55.017489 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e2c42-238e-43fa-9ac0-51cf1a23c76c None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:55.017782 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e2c42-238e-43fa-9ac0-51cf1a23c76c None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:55.018091 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e2c42-238e-43fa-9ac0-51cf1a23c76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:55.073573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-175e2c42-238e-43fa-9ac0-51cf1a23c76c None None] MFA Rules not processed for user `144e0074ab4d4e5c8743e4f7d68a89b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:55.074847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-175e2c42-238e-43fa-9ac0-51cf1a23c76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:55.140841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 705/1401] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Jun 22 16:51:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:55.149763 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b5256-269e-4eee-a9c9-48c914bcad96 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:51:55.160920 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b5256-269e-4eee-a9c9-48c914bcad96 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:51:55.165106 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a336101-2600-4b4c-baf7-ef1066f3a367 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '144e0074ab4d4e5c8743e4f7d68a89b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:51:55.165760 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a336101-2600-4b4c-baf7-ef1066f3a367 service glance] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:55.166042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a336101-2600-4b4c-baf7-ef1066f3a367 service glance] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:55.166321 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a336101-2600-4b4c-baf7-ef1066f3a367 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:55.176950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a336101-2600-4b4c-baf7-ef1066f3a367 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:51:55.178389 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a336101-2600-4b4c-baf7-ef1066f3a367 service glance] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:51:55.188558 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 697/1402] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:51:56.081062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5756d4f-0bfa-4394-8ccd-32c53b68a9df None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:56.081524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5756d4f-0bfa-4394-8ccd-32c53b68a9df None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:56.081812 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5756d4f-0bfa-4394-8ccd-32c53b68a9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:56.132007 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-b5756d4f-0bfa-4394-8ccd-32c53b68a9df None None] MFA Rules not processed for user `2a0a8cfb2482466a98340adab9980d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:56.133260 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-b5756d4f-0bfa-4394-8ccd-32c53b68a9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:56.174675 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:51:56.198351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 706/1403] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 16:51:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:56.239855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc6cd8-2714-400d-8a21-1967461a6751 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:56.240549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc6cd8-2714-400d-8a21-1967461a6751 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:56.240651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc6cd8-2714-400d-8a21-1967461a6751 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:56.242195 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 698/1404] 10.222.0.18 () {54 vars in 942 bytes} [Wed Jun 22 16:51:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:56.248713 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c674f2-7690-4def-814b-6cf0f67e061d None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:56.249000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c674f2-7690-4def-814b-6cf0f67e061d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:56.249276 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c674f2-7690-4def-814b-6cf0f67e061d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:56.295374 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-58c674f2-7690-4def-814b-6cf0f67e061d None None] MFA Rules not processed for user `861452a1dc634bf69ce630d7dcd8a2d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:56.296581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-58c674f2-7690-4def-814b-6cf0f67e061d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:56.367611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 707/1405] 10.222.0.18 () {58 vars in 1039 bytes} [Wed Jun 22 16:51:56 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:51:56.377117 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc6cd8-2714-400d-8a21-1967461a6751 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:51:56.384980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=61 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:51:56.391468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc6cd8-2714-400d-8a21-1967461a6751 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:51:56.396561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a6c8f-c730-4145-9ce5-75b4c94d0fea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861452a1dc634bf69ce630d7dcd8a2d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:51:56.397250 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a6c8f-c730-4145-9ce5-75b4c94d0fea service swift] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:56.397544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a6c8f-c730-4145-9ce5-75b4c94d0fea service swift] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:56.399804 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a6c8f-c730-4145-9ce5-75b4c94d0fea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:56.406206 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a6c8f-c730-4145-9ce5-75b4c94d0fea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:51:56.407863 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a6c8f-c730-4145-9ce5-75b4c94d0fea service swift] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:51:56.416271 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 699/1406] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 16:51:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 16:51:57.075112 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8408cc-c008-4538-8f25-19c8f5beb864 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:57.075683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8408cc-c008-4538-8f25-19c8f5beb864 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:57.075968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8408cc-c008-4538-8f25-19c8f5beb864 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:57.081165 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 708/1407] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:51:57.083364 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9e840-8a7f-4f47-82f9-dfddfc04dedf None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:57.083659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9e840-8a7f-4f47-82f9-dfddfc04dedf None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:57.083943 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9e840-8a7f-4f47-82f9-dfddfc04dedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:57.105560 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-dbf9e840-8a7f-4f47-82f9-dfddfc04dedf None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:51:57.107161 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-dbf9e840-8a7f-4f47-82f9-dfddfc04dedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:51:57.120324 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 700/1408] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:51:57.165269 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8408cc-c008-4538-8f25-19c8f5beb864 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:51:57.181172 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8408cc-c008-4538-8f25-19c8f5beb864 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:51:57.186628 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c53645-5b6b-423f-bcb8-a2fb2be47bdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:51:57.187259 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c53645-5b6b-423f-bcb8-a2fb2be47bdb service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:51:57.191728 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c53645-5b6b-423f-bcb8-a2fb2be47bdb service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:51:57.192048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c53645-5b6b-423f-bcb8-a2fb2be47bdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:51:57.202411 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c53645-5b6b-423f-bcb8-a2fb2be47bdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:51:57.204066 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c53645-5b6b-423f-bcb8-a2fb2be47bdb service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:51:57.214995 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 709/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:07.099618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=8 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:52:07.210202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=59 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:52:19.844640 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edcc27-d83f-493b-be64-37dacd4ca1c6 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:19.845196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edcc27-d83f-493b-be64-37dacd4ca1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:19.845196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edcc27-d83f-493b-be64-37dacd4ca1c6 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:19.846634 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 701/1410] 10.222.0.18 () {54 vars in 918 bytes} [Wed Jun 22 16:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:52:19.851884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8ace5-623a-445f-915c-1a540183316d None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:19.852331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8ace5-623a-445f-915c-1a540183316d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:19.852498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8ace5-623a-445f-915c-1a540183316d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:19.872119 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-61f8ace5-623a-445f-915c-1a540183316d None None] MFA Rules not processed for user `5a79a71fa89446c3abbb4fdbf2c93aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:52:19.873368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-61f8ace5-623a-445f-915c-1a540183316d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:19.883333 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 710/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Jun 22 16:52:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:52:19.897476 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a9777-fbed-407e-852e-9b97bbcea16e None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:19.897773 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a9777-fbed-407e-852e-9b97bbcea16e None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:19.898055 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a9777-fbed-407e-852e-9b97bbcea16e None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:19.899739 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 702/1412] 10.222.0.18 () {54 vars in 918 bytes} [Wed Jun 22 16:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:52:19.904293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b60833-484f-4ab0-93f7-14a6991d90f2 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:19.904586 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b60833-484f-4ab0-93f7-14a6991d90f2 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:19.904867 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b60833-484f-4ab0-93f7-14a6991d90f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:19.922672 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-e7b60833-484f-4ab0-93f7-14a6991d90f2 None None] MFA Rules not processed for user `78e7bdfffdc84465a570d135d1d86380`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:52:19.923856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e7b60833-484f-4ab0-93f7-14a6991d90f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:19.933651 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 711/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Jun 22 16:52:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:52:22.419858 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a27fa-30e3-4c02-ac09-a1737190f055 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:22.420422 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a27fa-30e3-4c02-ac09-a1737190f055 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:22.420422 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a27fa-30e3-4c02-ac09-a1737190f055 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:22.421821 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 16:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:52:22.427842 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da90d91-c81d-40ed-9795-c9feef3b59f2 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:22.428280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da90d91-c81d-40ed-9795-c9feef3b59f2 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:22.428436 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da90d91-c81d-40ed-9795-c9feef3b59f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:22.445999 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-9da90d91-c81d-40ed-9795-c9feef3b59f2 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:52:22.447176 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-9da90d91-c81d-40ed-9795-c9feef3b59f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:22.454782 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 16:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:52:22.498308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a27fa-30e3-4c02-ac09-a1737190f055 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:52:22.512429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a27fa-30e3-4c02-ac09-a1737190f055 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:52:22.517803 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99a9bd-b320-418c-ad4d-d1809e73ad3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:52:22.518429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99a9bd-b320-418c-ad4d-d1809e73ad3e service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:22.518713 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99a9bd-b320-418c-ad4d-d1809e73ad3e service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:22.518989 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99a9bd-b320-418c-ad4d-d1809e73ad3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:22.527263 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99a9bd-b320-418c-ad4d-d1809e73ad3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:52:22.528869 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99a9bd-b320-418c-ad4d-d1809e73ad3e service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:52:22.538677 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 704/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:23.448621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155257c5-553d-4b1d-926c-78d5a86e77f5 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:23.449180 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155257c5-553d-4b1d-926c-78d5a86e77f5 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:23.449180 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155257c5-553d-4b1d-926c-78d5a86e77f5 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:23.450542 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 16:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:52:23.455479 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192ef54-5d24-438d-97e7-4c7dbb73b512 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:23.455878 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192ef54-5d24-438d-97e7-4c7dbb73b512 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:23.456043 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192ef54-5d24-438d-97e7-4c7dbb73b512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:23.474728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-0192ef54-5d24-438d-97e7-4c7dbb73b512 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:52:23.475915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0192ef54-5d24-438d-97e7-4c7dbb73b512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:23.483910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 16:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:52:23.633948 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155257c5-553d-4b1d-926c-78d5a86e77f5 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:52:23.648531 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155257c5-553d-4b1d-926c-78d5a86e77f5 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:52:23.653980 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de448717-9c68-4dd8-8d11-645fe7f60917 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:52:23.654607 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de448717-9c68-4dd8-8d11-645fe7f60917 service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:23.654887 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de448717-9c68-4dd8-8d11-645fe7f60917 service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:23.655162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de448717-9c68-4dd8-8d11-645fe7f60917 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:23.663908 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de448717-9c68-4dd8-8d11-645fe7f60917 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:52:23.665521 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de448717-9c68-4dd8-8d11-645fe7f60917 service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:52:23.674744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 714/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:24.551588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90940906-d41f-434d-a9be-ea2a4e588954 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:24.552193 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90940906-d41f-434d-a9be-ea2a4e588954 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:24.552193 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90940906-d41f-434d-a9be-ea2a4e588954 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:24.553541 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 16:52:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:52:24.558446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb139228-4a58-4f94-9288-f8d67f6af0ba None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:24.558882 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb139228-4a58-4f94-9288-f8d67f6af0ba None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:24.559020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb139228-4a58-4f94-9288-f8d67f6af0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:24.576840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-cb139228-4a58-4f94-9288-f8d67f6af0ba None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:52:24.578044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-cb139228-4a58-4f94-9288-f8d67f6af0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:24.585894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 16:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:52:24.749350 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90940906-d41f-434d-a9be-ea2a4e588954 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:52:24.763870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90940906-d41f-434d-a9be-ea2a4e588954 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:52:24.769171 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772f16c-e536-4e08-aad9-eb9e258ea7a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:52:24.770407 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772f16c-e536-4e08-aad9-eb9e258ea7a7 service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:24.770689 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772f16c-e536-4e08-aad9-eb9e258ea7a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:24.770963 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772f16c-e536-4e08-aad9-eb9e258ea7a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:24.779164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772f16c-e536-4e08-aad9-eb9e258ea7a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:52:24.780766 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772f16c-e536-4e08-aad9-eb9e258ea7a7 service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:52:24.789997 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 707/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:52:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:25.645792 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718898c-f858-4168-96d2-bcb29d713ff5 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:25.646379 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718898c-f858-4168-96d2-bcb29d713ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:25.646533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718898c-f858-4168-96d2-bcb29d713ff5 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:25.647861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 16:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:52:25.653142 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671a7a9-2f58-468a-844e-3c64d542ed21 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:25.653534 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671a7a9-2f58-468a-844e-3c64d542ed21 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:25.653704 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671a7a9-2f58-468a-844e-3c64d542ed21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:25.671663 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-6671a7a9-2f58-468a-844e-3c64d542ed21 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:52:25.672872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6671a7a9-2f58-468a-844e-3c64d542ed21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:25.681144 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 16:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:52:25.828397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718898c-f858-4168-96d2-bcb29d713ff5 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:52:25.842636 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718898c-f858-4168-96d2-bcb29d713ff5 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:52:25.848015 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2ecb6-1f9c-4bc6-9c37-f6d9d36e6fcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:52:25.848673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2ecb6-1f9c-4bc6-9c37-f6d9d36e6fcb service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:25.848959 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2ecb6-1f9c-4bc6-9c37-f6d9d36e6fcb service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:25.849239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2ecb6-1f9c-4bc6-9c37-f6d9d36e6fcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:25.857223 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2ecb6-1f9c-4bc6-9c37-f6d9d36e6fcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:52:25.858826 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2ecb6-1f9c-4bc6-9c37-f6d9d36e6fcb service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:52:25.868865 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 717/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:26.730684 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8981bb8-ca38-4405-b789-2c4ae10d2511 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:26.731253 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8981bb8-ca38-4405-b789-2c4ae10d2511 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:26.731253 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8981bb8-ca38-4405-b789-2c4ae10d2511 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:26.732721 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 16:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:52:26.737614 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43295b-9c42-4d95-9bba-256f61604dbe None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:26.738014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43295b-9c42-4d95-9bba-256f61604dbe None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:26.738172 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43295b-9c42-4d95-9bba-256f61604dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:26.756360 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-be43295b-9c42-4d95-9bba-256f61604dbe None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:52:26.757562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-be43295b-9c42-4d95-9bba-256f61604dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:26.765390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 16:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:52:26.915631 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8981bb8-ca38-4405-b789-2c4ae10d2511 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:52:26.929809 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8981bb8-ca38-4405-b789-2c4ae10d2511 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:52:26.935144 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a9974-b59d-45fa-aece-4ce592ba9a9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:52:26.935771 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a9974-b59d-45fa-aece-4ce592ba9a9c service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:26.936051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a9974-b59d-45fa-aece-4ce592ba9a9c service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:26.936354 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a9974-b59d-45fa-aece-4ce592ba9a9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:26.944980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a9974-b59d-45fa-aece-4ce592ba9a9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:52:26.946548 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a9974-b59d-45fa-aece-4ce592ba9a9c service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:52:26.956032 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 710/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:27.834091 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a1d6d-3749-4758-bfa6-f8aef39284b4 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:27.834638 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a1d6d-3749-4758-bfa6-f8aef39284b4 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:27.834638 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a1d6d-3749-4758-bfa6-f8aef39284b4 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:27.836025 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 16:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:52:27.840939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec564ab-df7c-43ac-af4f-71f72b110b9c None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:27.841373 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec564ab-df7c-43ac-af4f-71f72b110b9c None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:27.841495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec564ab-df7c-43ac-af4f-71f72b110b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:27.859525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-bec564ab-df7c-43ac-af4f-71f72b110b9c None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:52:27.860736 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-bec564ab-df7c-43ac-af4f-71f72b110b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:27.868392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 16:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:52:28.018161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a1d6d-3749-4758-bfa6-f8aef39284b4 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:52:28.033435 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a1d6d-3749-4758-bfa6-f8aef39284b4 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:52:28.039033 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd623da5-12b1-4a6f-9adb-3b07d7608ea9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:52:28.039676 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd623da5-12b1-4a6f-9adb-3b07d7608ea9 service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:28.040003 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd623da5-12b1-4a6f-9adb-3b07d7608ea9 service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:28.040317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd623da5-12b1-4a6f-9adb-3b07d7608ea9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:28.050008 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd623da5-12b1-4a6f-9adb-3b07d7608ea9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:52:28.052140 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd623da5-12b1-4a6f-9adb-3b07d7608ea9 service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:52:28.064822 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 720/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:28.922923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd881c-e6ef-473e-9516-9aa14c97eb59 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:28.923486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd881c-e6ef-473e-9516-9aa14c97eb59 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:28.923486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd881c-e6ef-473e-9516-9aa14c97eb59 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:28.924914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 16:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:52:28.930451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac11c72-3f34-42a6-8228-1f6994a29a0d None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:28.930883 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac11c72-3f34-42a6-8228-1f6994a29a0d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:28.931019 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac11c72-3f34-42a6-8228-1f6994a29a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:28.948588 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-aac11c72-3f34-42a6-8228-1f6994a29a0d None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:52:28.949949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-aac11c72-3f34-42a6-8228-1f6994a29a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:28.957705 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 16:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:52:29.108958 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd881c-e6ef-473e-9516-9aa14c97eb59 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:52:29.123382 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd881c-e6ef-473e-9516-9aa14c97eb59 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:52:29.128722 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70132d5a-6bab-4bef-abff-a2d4c1d0ba0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:52:29.129342 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70132d5a-6bab-4bef-abff-a2d4c1d0ba0c service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:29.129623 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70132d5a-6bab-4bef-abff-a2d4c1d0ba0c service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:29.129896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70132d5a-6bab-4bef-abff-a2d4c1d0ba0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:29.137808 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70132d5a-6bab-4bef-abff-a2d4c1d0ba0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:52:29.139366 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70132d5a-6bab-4bef-abff-a2d4c1d0ba0c service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:52:29.148557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 713/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:52:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:30.027003 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc87aae-8e49-4ebd-8934-8ed7a7f5850f None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:30.027393 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc87aae-8e49-4ebd-8934-8ed7a7f5850f None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:30.027563 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc87aae-8e49-4ebd-8934-8ed7a7f5850f None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:30.028974 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 16:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:52:30.033881 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67b56e-802e-4af2-afbd-f4d80123247a None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:30.034285 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67b56e-802e-4af2-afbd-f4d80123247a None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:30.034437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67b56e-802e-4af2-afbd-f4d80123247a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:30.053165 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-ec67b56e-802e-4af2-afbd-f4d80123247a None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:52:30.054367 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-ec67b56e-802e-4af2-afbd-f4d80123247a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:30.062209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 16:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:52:30.219661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc87aae-8e49-4ebd-8934-8ed7a7f5850f None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:52:30.234624 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc87aae-8e49-4ebd-8934-8ed7a7f5850f None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:52:30.240536 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f001bb-d80e-4c54-ae8d-313d73ee8f22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:52:30.241162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f001bb-d80e-4c54-ae8d-313d73ee8f22 service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:30.241448 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f001bb-d80e-4c54-ae8d-313d73ee8f22 service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:30.241727 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f001bb-d80e-4c54-ae8d-313d73ee8f22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:30.249720 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f001bb-d80e-4c54-ae8d-313d73ee8f22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:52:30.251298 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f001bb-d80e-4c54-ae8d-313d73ee8f22 service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:52:30.261151 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 723/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:31.117854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348adfa-2be4-4325-b491-9ac8be9e259e None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:31.118407 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348adfa-2be4-4325-b491-9ac8be9e259e None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:31.118519 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348adfa-2be4-4325-b491-9ac8be9e259e None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:31.119817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 16:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:52:31.124750 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c300f4c-1903-40c7-a927-22eb7f759d33 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:31.125163 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c300f4c-1903-40c7-a927-22eb7f759d33 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:31.125311 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c300f4c-1903-40c7-a927-22eb7f759d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:31.143138 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-1c300f4c-1903-40c7-a927-22eb7f759d33 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:52:31.144874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-1c300f4c-1903-40c7-a927-22eb7f759d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:31.152826 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 16:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:52:31.302238 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348adfa-2be4-4325-b491-9ac8be9e259e None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:52:31.316759 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348adfa-2be4-4325-b491-9ac8be9e259e None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:52:31.322386 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb8aa2-9e7b-4972-ba8b-a92535159247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:52:31.323018 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb8aa2-9e7b-4972-ba8b-a92535159247 service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:31.323320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb8aa2-9e7b-4972-ba8b-a92535159247 service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:31.323593 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb8aa2-9e7b-4972-ba8b-a92535159247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:31.331697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb8aa2-9e7b-4972-ba8b-a92535159247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:52:31.333798 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb8aa2-9e7b-4972-ba8b-a92535159247 service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:52:31.342963 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 716/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:33.265008 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cabf44-f923-427a-a637-0dfeff80cebd None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:33.265606 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cabf44-f923-427a-a637-0dfeff80cebd None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:33.265606 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cabf44-f923-427a-a637-0dfeff80cebd None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:33.266940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 16:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:52:33.272212 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ad9b7-0198-4bce-ae06-4a795653044d None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:33.272663 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ad9b7-0198-4bce-ae06-4a795653044d None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:33.272773 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ad9b7-0198-4bce-ae06-4a795653044d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:33.290134 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-ec7ad9b7-0198-4bce-ae06-4a795653044d None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:52:33.291251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-ec7ad9b7-0198-4bce-ae06-4a795653044d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:33.298844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 16:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:52:33.337407 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cabf44-f923-427a-a637-0dfeff80cebd None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:52:33.348058 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cabf44-f923-427a-a637-0dfeff80cebd None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:52:33.351610 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89418ba-d01b-4d3c-a2f2-dcf236eda24c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:52:33.352301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89418ba-d01b-4d3c-a2f2-dcf236eda24c service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:33.352589 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89418ba-d01b-4d3c-a2f2-dcf236eda24c service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:33.352869 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89418ba-d01b-4d3c-a2f2-dcf236eda24c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:33.361656 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89418ba-d01b-4d3c-a2f2-dcf236eda24c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:52:33.363590 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89418ba-d01b-4d3c-a2f2-dcf236eda24c service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:52:33.372888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 726/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:35.544561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd69399-6b95-4d81-8f53-62e7a66cb1eb None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:35.545100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd69399-6b95-4d81-8f53-62e7a66cb1eb None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:35.545100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd69399-6b95-4d81-8f53-62e7a66cb1eb None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:35.546524 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 16:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:52:35.551895 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99dee3-b60b-4922-bea3-cb6a4d163f9d None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:35.552335 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99dee3-b60b-4922-bea3-cb6a4d163f9d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:35.552488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99dee3-b60b-4922-bea3-cb6a4d163f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:35.569650 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-0d99dee3-b60b-4922-bea3-cb6a4d163f9d None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:52:35.570840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-0d99dee3-b60b-4922-bea3-cb6a4d163f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:35.578505 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 16:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:52:35.617269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd69399-6b95-4d81-8f53-62e7a66cb1eb None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:52:35.627760 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd69399-6b95-4d81-8f53-62e7a66cb1eb None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:52:35.631272 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdea5c8-c14d-4a6d-8783-bb81ee86dd5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:52:35.631904 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdea5c8-c14d-4a6d-8783-bb81ee86dd5d service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:35.632221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdea5c8-c14d-4a6d-8783-bb81ee86dd5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:35.632502 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdea5c8-c14d-4a6d-8783-bb81ee86dd5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:35.641327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdea5c8-c14d-4a6d-8783-bb81ee86dd5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:52:35.642748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdea5c8-c14d-4a6d-8783-bb81ee86dd5d service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:52:35.653081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 719/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:38.058533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814054ba-bf31-40d0-941a-96a9988899fd None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:38.061200 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814054ba-bf31-40d0-941a-96a9988899fd None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:38.061200 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814054ba-bf31-40d0-941a-96a9988899fd None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:38.061200 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 16:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:52:38.065632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e037786-dbec-43b3-a02f-cb98daeddfee None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:38.066597 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e037786-dbec-43b3-a02f-cb98daeddfee None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:38.066730 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e037786-dbec-43b3-a02f-cb98daeddfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:38.084614 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-9e037786-dbec-43b3-a02f-cb98daeddfee None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:52:38.085814 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-9e037786-dbec-43b3-a02f-cb98daeddfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:38.093733 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 16:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:52:38.133090 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814054ba-bf31-40d0-941a-96a9988899fd None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:52:38.143690 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814054ba-bf31-40d0-941a-96a9988899fd None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:52:38.147564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781296de-ad25-46ef-8497-35fe7df379f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:52:38.148326 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781296de-ad25-46ef-8497-35fe7df379f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:38.148503 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781296de-ad25-46ef-8497-35fe7df379f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:38.148775 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781296de-ad25-46ef-8497-35fe7df379f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:38.164026 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781296de-ad25-46ef-8497-35fe7df379f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:52:38.166183 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781296de-ad25-46ef-8497-35fe7df379f8 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:52:38.176668 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 729/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:40.313895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b097f-53dd-46d5-a043-a880996ba243 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:40.314529 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b097f-53dd-46d5-a043-a880996ba243 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:40.314529 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b097f-53dd-46d5-a043-a880996ba243 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:40.315740 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 16:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:52:40.321074 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa04982-efa7-4c66-abd8-92f72b4d1ff2 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:40.321518 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa04982-efa7-4c66-abd8-92f72b4d1ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:40.321628 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa04982-efa7-4c66-abd8-92f72b4d1ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:40.339714 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-7aa04982-efa7-4c66-abd8-92f72b4d1ff2 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:52:40.340919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-7aa04982-efa7-4c66-abd8-92f72b4d1ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:40.349073 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 16:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:52:40.389822 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b097f-53dd-46d5-a043-a880996ba243 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:52:40.400694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b097f-53dd-46d5-a043-a880996ba243 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:52:40.404179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86623686-452e-4098-b0ac-a8d87ade9d63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:52:40.404807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86623686-452e-4098-b0ac-a8d87ade9d63 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:40.405091 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86623686-452e-4098-b0ac-a8d87ade9d63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:40.405369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86623686-452e-4098-b0ac-a8d87ade9d63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:40.414558 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86623686-452e-4098-b0ac-a8d87ade9d63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:52:40.415981 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86623686-452e-4098-b0ac-a8d87ade9d63 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:52:40.426050 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 722/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:42.501597 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb920670-6afe-4ebf-b86d-6303c7c020e6 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:42.502167 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb920670-6afe-4ebf-b86d-6303c7c020e6 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:42.502167 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb920670-6afe-4ebf-b86d-6303c7c020e6 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:42.503596 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 16:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:52:42.508685 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e78cba-4451-4330-8032-20cb9c2da6ca None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:42.509058 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e78cba-4451-4330-8032-20cb9c2da6ca None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:42.509252 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e78cba-4451-4330-8032-20cb9c2da6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:42.526614 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-80e78cba-4451-4330-8032-20cb9c2da6ca None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:52:42.527804 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-80e78cba-4451-4330-8032-20cb9c2da6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:42.535987 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 16:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:52:42.573316 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb920670-6afe-4ebf-b86d-6303c7c020e6 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:52:42.583949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb920670-6afe-4ebf-b86d-6303c7c020e6 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:52:42.587421 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94015fb3-4dcc-4f8f-adb2-55b2e8895941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:52:42.593538 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94015fb3-4dcc-4f8f-adb2-55b2e8895941 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:42.593538 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94015fb3-4dcc-4f8f-adb2-55b2e8895941 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:42.593538 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94015fb3-4dcc-4f8f-adb2-55b2e8895941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:42.597985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94015fb3-4dcc-4f8f-adb2-55b2e8895941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:52:42.599491 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94015fb3-4dcc-4f8f-adb2-55b2e8895941 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:52:42.609133 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 732/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:44.809909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094392c-904c-4a0f-b99b-a1702ea33e6d None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:44.810470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094392c-904c-4a0f-b99b-a1702ea33e6d None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:44.810470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094392c-904c-4a0f-b99b-a1702ea33e6d None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:44.811888 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 16:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:52:44.817722 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4624f-3ada-4f8f-835f-715e9ede78a3 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:44.818122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4624f-3ada-4f8f-835f-715e9ede78a3 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:44.818297 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4624f-3ada-4f8f-835f-715e9ede78a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:44.835948 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-23c4624f-3ada-4f8f-835f-715e9ede78a3 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:52:44.837163 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-23c4624f-3ada-4f8f-835f-715e9ede78a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:44.844782 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 16:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:52:44.883292 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094392c-904c-4a0f-b99b-a1702ea33e6d None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:52:44.884982 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-2094392c-904c-4a0f-b99b-a1702ea33e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:44.898142 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094392c-904c-4a0f-b99b-a1702ea33e6d None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:52:44.901849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0900025-9f61-410b-a1db-776ee93e2ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:52:44.902467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0900025-9f61-410b-a1db-776ee93e2ece service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:44.902753 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0900025-9f61-410b-a1db-776ee93e2ece service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:44.903025 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0900025-9f61-410b-a1db-776ee93e2ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:44.911614 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0900025-9f61-410b-a1db-776ee93e2ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:52:44.913048 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0900025-9f61-410b-a1db-776ee93e2ece service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:52:44.922184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 725/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:47.246383 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb2da4-912f-4dbf-b960-0ac330a28efc None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:47.246936 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb2da4-912f-4dbf-b960-0ac330a28efc None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:47.246936 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb2da4-912f-4dbf-b960-0ac330a28efc None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:47.248432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 16:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:52:47.253727 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b62a94-ca5f-4a4b-8d4f-95812d7964d5 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:47.254121 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b62a94-ca5f-4a4b-8d4f-95812d7964d5 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:47.254218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b62a94-ca5f-4a4b-8d4f-95812d7964d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:47.260331 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=70 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:52:47.272009 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-79b62a94-ca5f-4a4b-8d4f-95812d7964d5 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:52:47.355272 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-79b62a94-ca5f-4a4b-8d4f-95812d7964d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:47.355272 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 16:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:52:47.355976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb2da4-912f-4dbf-b960-0ac330a28efc None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:52:47.355976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=73 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:52:47.355976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb2da4-912f-4dbf-b960-0ac330a28efc None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:52:47.355976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0753e-6425-44e2-a324-2d764ec3c0c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:52:47.356383 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0753e-6425-44e2-a324-2d764ec3c0c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:47.356383 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0753e-6425-44e2-a324-2d764ec3c0c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:47.356383 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0753e-6425-44e2-a324-2d764ec3c0c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:47.356383 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0753e-6425-44e2-a324-2d764ec3c0c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:52:47.356383 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0753e-6425-44e2-a324-2d764ec3c0c7 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:52:47.356983 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 735/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:52:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:49.447871 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af32635-3cb1-4796-b117-b3c2ded28372 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:49.448539 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af32635-3cb1-4796-b117-b3c2ded28372 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:49.448539 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af32635-3cb1-4796-b117-b3c2ded28372 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:49.449854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 16:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:52:49.454964 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259f524-bca3-4d9f-b0b9-c88a571a5960 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:49.455390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259f524-bca3-4d9f-b0b9-c88a571a5960 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:49.455510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259f524-bca3-4d9f-b0b9-c88a571a5960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:49.473264 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-9259f524-bca3-4d9f-b0b9-c88a571a5960 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:52:49.474437 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-9259f524-bca3-4d9f-b0b9-c88a571a5960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:49.482035 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 16:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:52:49.519327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af32635-3cb1-4796-b117-b3c2ded28372 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:52:49.530462 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af32635-3cb1-4796-b117-b3c2ded28372 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:52:49.533969 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b63bc-39e6-4a00-a250-e0210a073a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:52:49.535103 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b63bc-39e6-4a00-a250-e0210a073a7a service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:49.535386 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b63bc-39e6-4a00-a250-e0210a073a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:49.535663 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b63bc-39e6-4a00-a250-e0210a073a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:49.544607 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b63bc-39e6-4a00-a250-e0210a073a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:52:49.546024 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b63bc-39e6-4a00-a250-e0210a073a7a service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:52:49.555939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 728/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:51.602670 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760f0b9-556f-4d44-9add-ea3245cfeb75 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:51.603228 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760f0b9-556f-4d44-9add-ea3245cfeb75 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:51.603228 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760f0b9-556f-4d44-9add-ea3245cfeb75 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:51.604634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 16:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:52:51.609787 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf5e0c-3184-482c-830b-3de5fda5b1da None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:51.610172 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf5e0c-3184-482c-830b-3de5fda5b1da None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:51.610338 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf5e0c-3184-482c-830b-3de5fda5b1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:51.628242 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-84cf5e0c-3184-482c-830b-3de5fda5b1da None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:52:51.629427 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-84cf5e0c-3184-482c-830b-3de5fda5b1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:51.636994 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 16:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:52:51.672923 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760f0b9-556f-4d44-9add-ea3245cfeb75 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:52:51.683941 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760f0b9-556f-4d44-9add-ea3245cfeb75 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:52:51.687410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1100a9-e230-4eec-adb5-0fe8be2d076a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:52:51.688029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1100a9-e230-4eec-adb5-0fe8be2d076a service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:51.688340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1100a9-e230-4eec-adb5-0fe8be2d076a service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:51.688616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1100a9-e230-4eec-adb5-0fe8be2d076a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:51.697155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1100a9-e230-4eec-adb5-0fe8be2d076a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:52:51.698576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1100a9-e230-4eec-adb5-0fe8be2d076a service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:52:51.707655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 738/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:52:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:52:53.805249 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55796451-332c-4244-9d5c-efa71f8f68c4 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:53.805766 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55796451-332c-4244-9d5c-efa71f8f68c4 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:53.805896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55796451-332c-4244-9d5c-efa71f8f68c4 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:53.807172 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 16:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:52:53.812418 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d718d-9ad7-4334-9a40-3edd936e6e3e None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:53.812853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d718d-9ad7-4334-9a40-3edd936e6e3e None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:53.812985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d718d-9ad7-4334-9a40-3edd936e6e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:53.842781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-6b0d718d-9ad7-4334-9a40-3edd936e6e3e None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:52:53.844041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-6b0d718d-9ad7-4334-9a40-3edd936e6e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:52:53.851842 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 16:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:52:53.888149 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55796451-332c-4244-9d5c-efa71f8f68c4 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:52:53.899592 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55796451-332c-4244-9d5c-efa71f8f68c4 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:52:53.903054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42b08c-3632-44b3-b9ce-49e8ea78df97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:52:53.903680 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42b08c-3632-44b3-b9ce-49e8ea78df97 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:52:53.903963 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42b08c-3632-44b3-b9ce-49e8ea78df97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:52:53.904277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42b08c-3632-44b3-b9ce-49e8ea78df97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:52:53.913038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42b08c-3632-44b3-b9ce-49e8ea78df97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:52:53.914399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42b08c-3632-44b3-b9ce-49e8ea78df97 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:52:53.923639 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 731/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:52:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:53:03.832401 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=17 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:53:03.919601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=17 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:53:13.772180 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b014e22-1b95-488c-a59a-c72499ff7d87 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:13.772765 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b014e22-1b95-488c-a59a-c72499ff7d87 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:13.772765 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b014e22-1b95-488c-a59a-c72499ff7d87 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:13.774260 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 740/1471] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:53:13.780018 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe4b17-0613-4f8b-9270-e0766cefe419 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:13.780452 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe4b17-0613-4f8b-9270-e0766cefe419 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:13.780604 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe4b17-0613-4f8b-9270-e0766cefe419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:13.797788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-d7fe4b17-0613-4f8b-9270-e0766cefe419 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:53:13.798967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-d7fe4b17-0613-4f8b-9270-e0766cefe419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:53:13.807110 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 732/1472] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:53:13.853281 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8738ad-5332-4b97-9439-ffe163f88459 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:13.853639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8738ad-5332-4b97-9439-ffe163f88459 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:13.853925 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8738ad-5332-4b97-9439-ffe163f88459 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:13.855278 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 741/1473] 10.222.0.18 () {54 vars in 962 bytes} [Wed Jun 22 16:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:53:13.859784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953ad32-c5d7-4b07-aee7-bb9ec6bb8d11 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:13.860074 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953ad32-c5d7-4b07-aee7-bb9ec6bb8d11 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:13.860370 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953ad32-c5d7-4b07-aee7-bb9ec6bb8d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:13.878684 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-6953ad32-c5d7-4b07-aee7-bb9ec6bb8d11 None None] MFA Rules not processed for user `144e0074ab4d4e5c8743e4f7d68a89b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:53:13.879854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6953ad32-c5d7-4b07-aee7-bb9ec6bb8d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:53:13.886154 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 733/1474] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Jun 22 16:53:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:53:13.893063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8738ad-5332-4b97-9439-ffe163f88459 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:53:13.904042 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8738ad-5332-4b97-9439-ffe163f88459 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:53:13.910050 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a4e2e-250f-44d7-82a8-b805e383b6fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '144e0074ab4d4e5c8743e4f7d68a89b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:53:13.910925 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a4e2e-250f-44d7-82a8-b805e383b6fe service glance] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:13.911210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a4e2e-250f-44d7-82a8-b805e383b6fe service glance] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:13.911485 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a4e2e-250f-44d7-82a8-b805e383b6fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:13.922482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a4e2e-250f-44d7-82a8-b805e383b6fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:53:13.923895 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a4e2e-250f-44d7-82a8-b805e383b6fe service glance] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:53:13.936361 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 742/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:53:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:53:16.054817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e27acc-870d-4bac-867d-ad72851ac0bc None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:16.055272 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e27acc-870d-4bac-867d-ad72851ac0bc None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:16.055389 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e27acc-870d-4bac-867d-ad72851ac0bc None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:16.056781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 734/1476] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:53:16.061963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1bb6f-6390-4d23-9912-1b1e4364baa0 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:16.062797 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1bb6f-6390-4d23-9912-1b1e4364baa0 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:16.063081 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1bb6f-6390-4d23-9912-1b1e4364baa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:16.081099 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-03e1bb6f-6390-4d23-9912-1b1e4364baa0 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:53:16.082296 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-03e1bb6f-6390-4d23-9912-1b1e4364baa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:53:16.090012 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 743/1477] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:53:16.113424 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e27acc-870d-4bac-867d-ad72851ac0bc None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:53:16.125600 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e27acc-870d-4bac-867d-ad72851ac0bc None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:53:16.130559 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee0dd0-b719-485c-ae7d-b9ad1dda2272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:53:16.131194 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee0dd0-b719-485c-ae7d-b9ad1dda2272 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:16.131475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee0dd0-b719-485c-ae7d-b9ad1dda2272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:16.131749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee0dd0-b719-485c-ae7d-b9ad1dda2272 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:16.132513 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee0dd0-b719-485c-ae7d-b9ad1dda2272 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:53:16.134261 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: WARNING py.warnings [None req-15ee0dd0-b719-485c-ae7d-b9ad1dda2272 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:53:16.134261 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: warnings.warn(msg) Jun 22 16:53:16.134261 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: Jun 22 16:53:16.135390 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee0dd0-b719-485c-ae7d-b9ad1dda2272 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:53:16.154937 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 735/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jun 22 16:53:16 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:53:18.197614 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e8ed2-bc79-4083-8c17-d4714311ce28 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:18.198141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e8ed2-bc79-4083-8c17-d4714311ce28 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:18.198141 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e8ed2-bc79-4083-8c17-d4714311ce28 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:18.199454 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 744/1479] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:53:18.204655 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9928d8-0645-4a2f-9242-7cbd983debc6 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:18.205050 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9928d8-0645-4a2f-9242-7cbd983debc6 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:18.205337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9928d8-0645-4a2f-9242-7cbd983debc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:18.222873 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-1e9928d8-0645-4a2f-9242-7cbd983debc6 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:53:18.224128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-1e9928d8-0645-4a2f-9242-7cbd983debc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:53:18.231928 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 736/1480] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:53:18.274366 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e8ed2-bc79-4083-8c17-d4714311ce28 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:53:18.288975 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e8ed2-bc79-4083-8c17-d4714311ce28 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:53:18.294368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca6e1c-845f-47db-8aee-e72055e83c04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:53:18.295003 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca6e1c-845f-47db-8aee-e72055e83c04 service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:18.295290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca6e1c-845f-47db-8aee-e72055e83c04 service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:18.295571 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca6e1c-845f-47db-8aee-e72055e83c04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:18.304181 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca6e1c-845f-47db-8aee-e72055e83c04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:53:18.305768 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca6e1c-845f-47db-8aee-e72055e83c04 service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:53:18.315660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 745/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:53:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:53:20.529438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677eaf79-f840-4e9b-9e51-8549a767b5ea None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:20.530014 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677eaf79-f840-4e9b-9e51-8549a767b5ea None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:20.530014 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677eaf79-f840-4e9b-9e51-8549a767b5ea None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:20.531373 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 737/1482] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:53:20.536698 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cc383-34e6-4851-9cb5-0d0e1fb6bc32 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:20.537118 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cc383-34e6-4851-9cb5-0d0e1fb6bc32 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:20.537256 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cc383-34e6-4851-9cb5-0d0e1fb6bc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:20.555128 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-3e5cc383-34e6-4851-9cb5-0d0e1fb6bc32 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:53:20.556361 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3e5cc383-34e6-4851-9cb5-0d0e1fb6bc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:53:20.564080 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 746/1483] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:53:20.600619 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677eaf79-f840-4e9b-9e51-8549a767b5ea None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:53:20.611115 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677eaf79-f840-4e9b-9e51-8549a767b5ea None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:53:20.615024 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513cffb6-9f48-47c2-acbb-80c833951fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:53:20.615641 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cffb6-9f48-47c2-acbb-80c833951fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:20.615933 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cffb6-9f48-47c2-acbb-80c833951fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:20.616221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cffb6-9f48-47c2-acbb-80c833951fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:20.624931 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513cffb6-9f48-47c2-acbb-80c833951fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:53:20.626337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513cffb6-9f48-47c2-acbb-80c833951fb8 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:53:20.636189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 738/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:53:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:53:22.733300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e5a79-1917-4845-ba73-b8ed91805612 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:22.733870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e5a79-1917-4845-ba73-b8ed91805612 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:22.733870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e5a79-1917-4845-ba73-b8ed91805612 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:22.735232 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 747/1485] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:53:22.741943 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec47862-402f-453a-a155-7d2035973d33 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:22.742351 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec47862-402f-453a-a155-7d2035973d33 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:22.742498 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec47862-402f-453a-a155-7d2035973d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:22.761194 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-aec47862-402f-453a-a155-7d2035973d33 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:53:22.762385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-aec47862-402f-453a-a155-7d2035973d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:53:22.770044 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 739/1486] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:53:22.808335 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e5a79-1917-4845-ba73-b8ed91805612 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:53:22.819571 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e5a79-1917-4845-ba73-b8ed91805612 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:53:22.823042 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa61212-79aa-4a91-bf05-069d84f27425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:53:22.823722 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa61212-79aa-4a91-bf05-069d84f27425 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:22.823955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa61212-79aa-4a91-bf05-069d84f27425 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:22.824269 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa61212-79aa-4a91-bf05-069d84f27425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:22.833021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa61212-79aa-4a91-bf05-069d84f27425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:53:22.834439 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa61212-79aa-4a91-bf05-069d84f27425 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:53:22.843608 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 748/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:53:25.047257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525e800-09b3-4958-80c8-d58182e13f0e None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:25.047752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525e800-09b3-4958-80c8-d58182e13f0e None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:25.047863 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525e800-09b3-4958-80c8-d58182e13f0e None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:25.049768 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 740/1488] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:53:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:53:25.055131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925566fa-01c9-413d-9a34-6ce3e083190b None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:25.055588 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925566fa-01c9-413d-9a34-6ce3e083190b None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:25.055728 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925566fa-01c9-413d-9a34-6ce3e083190b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:25.078696 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-925566fa-01c9-413d-9a34-6ce3e083190b None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:53:25.079967 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-925566fa-01c9-413d-9a34-6ce3e083190b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:53:25.087945 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 749/1489] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:53:25.128731 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525e800-09b3-4958-80c8-d58182e13f0e None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:53:25.139252 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525e800-09b3-4958-80c8-d58182e13f0e None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:53:25.142702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069bc09-2d42-4d52-8218-0962282c10a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:53:25.143323 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069bc09-2d42-4d52-8218-0962282c10a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:25.143606 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069bc09-2d42-4d52-8218-0962282c10a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:25.143880 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069bc09-2d42-4d52-8218-0962282c10a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:25.152925 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069bc09-2d42-4d52-8218-0962282c10a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:53:25.154331 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069bc09-2d42-4d52-8218-0962282c10a3 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:53:25.164120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 741/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:53:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:53:27.622742 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef629c65-8a7c-4297-b6ff-2ee5fb94ca39 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:27.623300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef629c65-8a7c-4297-b6ff-2ee5fb94ca39 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:27.623300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef629c65-8a7c-4297-b6ff-2ee5fb94ca39 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:27.624702 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 750/1491] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jun 22 16:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:53:27.630428 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607a6b4-4421-41f9-a014-3ba312d6645e None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:27.630831 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607a6b4-4421-41f9-a014-3ba312d6645e None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:27.630978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607a6b4-4421-41f9-a014-3ba312d6645e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:27.648720 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-3607a6b4-4421-41f9-a014-3ba312d6645e None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:53:27.650160 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-3607a6b4-4421-41f9-a014-3ba312d6645e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:53:27.657832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 742/1492] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jun 22 16:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:53:27.696397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef629c65-8a7c-4297-b6ff-2ee5fb94ca39 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:53:27.707324 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef629c65-8a7c-4297-b6ff-2ee5fb94ca39 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:53:27.710863 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1946a-4a5e-4796-af32-313439b2271e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:53:27.711481 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1946a-4a5e-4796-af32-313439b2271e service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:53:27.711764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1946a-4a5e-4796-af32-313439b2271e service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:53:27.712040 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1946a-4a5e-4796-af32-313439b2271e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:53:27.720682 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1946a-4a5e-4796-af32-313439b2271e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:53:27.722095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1946a-4a5e-4796-af32-313439b2271e service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:53:27.731618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 751/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:53:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:53:37.643456 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=33 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:53:37.727092 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=33 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:55:06.419057 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43533cbc-48b2-46aa-98b8-102d1aa6e762 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:55:06.419635 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43533cbc-48b2-46aa-98b8-102d1aa6e762 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:55:06.419635 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43533cbc-48b2-46aa-98b8-102d1aa6e762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:55:06.437136 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-43533cbc-48b2-46aa-98b8-102d1aa6e762 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:55:06.438317 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-43533cbc-48b2-46aa-98b8-102d1aa6e762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:55:06.446663 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 743/1494] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:55:06.456091 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637a842-6e47-4dc3-99b1-89320815926a None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:55:06.456598 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637a842-6e47-4dc3-99b1-89320815926a None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:55:06.456702 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637a842-6e47-4dc3-99b1-89320815926a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:55:06.473980 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-e637a842-6e47-4dc3-99b1-89320815926a None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:55:06.475170 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e637a842-6e47-4dc3-99b1-89320815926a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:55:06.482845 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 752/1495] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:55:06.487117 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43533cbc-48b2-46aa-98b8-102d1aa6e762 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:55:06.496694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43533cbc-48b2-46aa-98b8-102d1aa6e762 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:55:06.501634 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9219b-dc21-4d42-adf4-a223267f70d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:55:06.502383 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9219b-dc21-4d42-adf4-a223267f70d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:55:06.502669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9219b-dc21-4d42-adf4-a223267f70d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:55:06.502944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9219b-dc21-4d42-adf4-a223267f70d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:55:06.503668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9219b-dc21-4d42-adf4-a223267f70d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:55:06.503980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9219b-dc21-4d42-adf4-a223267f70d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:55:06.505019 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: WARNING py.warnings [None req-e8f9219b-dc21-4d42-adf4-a223267f70d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:55:06.505019 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: warnings.warn(msg) Jun 22 16:55:06.505019 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: Jun 22 16:55:06.505912 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9219b-dc21-4d42-adf4-a223267f70d1 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:55:06.517760 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 744/1496] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:55:06.525635 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637a842-6e47-4dc3-99b1-89320815926a None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:55:06.534766 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637a842-6e47-4dc3-99b1-89320815926a None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:55:06.539203 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb6ff3-9d13-4238-89d2-7ae52bc1efff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:55:06.539849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb6ff3-9d13-4238-89d2-7ae52bc1efff admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:55:06.540179 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb6ff3-9d13-4238-89d2-7ae52bc1efff admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:55:06.540457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb6ff3-9d13-4238-89d2-7ae52bc1efff admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:55:06.541165 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb6ff3-9d13-4238-89d2-7ae52bc1efff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:55:06.543008 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: WARNING py.warnings [None req-19cb6ff3-9d13-4238-89d2-7ae52bc1efff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:55:06.543008 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: warnings.warn(msg) Jun 22 16:55:06.543008 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: Jun 22 16:55:06.544242 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb6ff3-9d13-4238-89d2-7ae52bc1efff admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:55:06.670514 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 753/1497] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:55:06 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:55:06.674816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9219b-dc21-4d42-adf4-a223267f70d1 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:55:06.684631 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9219b-dc21-4d42-adf4-a223267f70d1 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:55:06.743960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939da94-9ffb-4980-b164-2f98c26e824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:55:06.744649 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939da94-9ffb-4980-b164-2f98c26e824d admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:55:06.744938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939da94-9ffb-4980-b164-2f98c26e824d admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:55:06.745215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939da94-9ffb-4980-b164-2f98c26e824d admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:55:06.745906 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939da94-9ffb-4980-b164-2f98c26e824d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:55:06.746916 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: WARNING py.warnings [None req-4939da94-9ffb-4980-b164-2f98c26e824d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:55:06.746916 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: warnings.warn(msg) Jun 22 16:55:06.746916 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: Jun 22 16:55:06.748134 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939da94-9ffb-4980-b164-2f98c26e824d admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:55:06.824771 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 745/1498] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:55:06 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:55:06.827947 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb6ff3-9d13-4238-89d2-7ae52bc1efff admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:55:06.838131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb6ff3-9d13-4238-89d2-7ae52bc1efff admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:55:06.842583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d660943-9976-4673-9e57-987302e2a08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:55:06.843225 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d660943-9976-4673-9e57-987302e2a08e admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:55:06.843506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d660943-9976-4673-9e57-987302e2a08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:55:06.843785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d660943-9976-4673-9e57-987302e2a08e admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:55:06.844546 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d660943-9976-4673-9e57-987302e2a08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:55:06.845543 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: WARNING py.warnings [None req-9d660943-9976-4673-9e57-987302e2a08e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:55:06.845543 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: warnings.warn(msg) Jun 22 16:55:06.845543 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: Jun 22 16:55:06.846410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d660943-9976-4673-9e57-987302e2a08e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:55:06.858777 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 754/1499] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:55:06.863453 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939da94-9ffb-4980-b164-2f98c26e824d admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:55:06.873426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939da94-9ffb-4980-b164-2f98c26e824d admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:55:06.878625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f402b-319c-4ec8-adb1-69c8e9a3a394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:55:06.879266 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f402b-319c-4ec8-adb1-69c8e9a3a394 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:55:06.879546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f402b-319c-4ec8-adb1-69c8e9a3a394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:55:06.879821 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f402b-319c-4ec8-adb1-69c8e9a3a394 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:55:06.880578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f402b-319c-4ec8-adb1-69c8e9a3a394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:55:06.881626 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: WARNING py.warnings [None req-f53f402b-319c-4ec8-adb1-69c8e9a3a394 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:55:06.881626 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: warnings.warn(msg) Jun 22 16:55:06.881626 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: Jun 22 16:55:06.882520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f402b-319c-4ec8-adb1-69c8e9a3a394 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:55:06.895661 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 746/1500] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:55:06.899748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d660943-9976-4673-9e57-987302e2a08e admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:55:06.910043 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d660943-9976-4673-9e57-987302e2a08e admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:55:06.914614 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f37fb-664b-4f70-9837-f57fab18fb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:55:06.915603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f37fb-664b-4f70-9837-f57fab18fb98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:55:06.915885 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f37fb-664b-4f70-9837-f57fab18fb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:55:06.916190 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f37fb-664b-4f70-9837-f57fab18fb98 admin admin] PATH_INFO: `/v3/projects/a57282d8706b4a179414cae176088d19/users/4a9e0fb08b6e4969a53863f954717212/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:55:06.931177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f37fb-664b-4f70-9837-f57fab18fb98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a57282d8706b4a179414cae176088d19, user_id=4a9e0fb08b6e4969a53863f954717212, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:55:06.932228 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: WARNING py.warnings [None req-de5f37fb-664b-4f70-9837-f57fab18fb98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:55:06.932228 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: warnings.warn(msg) Jun 22 16:55:06.932228 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: Jun 22 16:55:06.934159 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f37fb-664b-4f70-9837-f57fab18fb98 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:55:07.003423 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 755/1501] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:55:06 2022] PUT /identity/v3/projects/a57282d8706b4a179414cae176088d19/users/4a9e0fb08b6e4969a53863f954717212/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:55:07.014582 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61773e4-a5cd-4d8f-8ffe-f569b20751c7 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:55:07.014870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61773e4-a5cd-4d8f-8ffe-f569b20751c7 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:55:07.015170 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61773e4-a5cd-4d8f-8ffe-f569b20751c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:55:07.041058 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-a61773e4-a5cd-4d8f-8ffe-f569b20751c7 None None] MFA Rules not processed for user `4a9e0fb08b6e4969a53863f954717212`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:55:07.042257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-a61773e4-a5cd-4d8f-8ffe-f569b20751c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:55:07.123663 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 747/1502] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:55:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:55:07.137397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f740ef-52ec-4f7a-b841-8db8ee110199 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:55:07.137690 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f740ef-52ec-4f7a-b841-8db8ee110199 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:55:07.137968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f740ef-52ec-4f7a-b841-8db8ee110199 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:55:07.139329 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 756/1503] 10.222.0.18 () {54 vars in 963 bytes} [Wed Jun 22 16:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:55:07.144168 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f555c-963f-4873-b4d4-ec728a9320a3 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:55:07.144636 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f555c-963f-4873-b4d4-ec728a9320a3 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:55:07.144920 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f555c-963f-4873-b4d4-ec728a9320a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:55:07.163044 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-a20f555c-963f-4873-b4d4-ec728a9320a3 None None] MFA Rules not processed for user `5d28208f3127499a98a9d50f8d63ea6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:55:07.164276 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-a20f555c-963f-4873-b4d4-ec728a9320a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:55:07.206996 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:55:07.214426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 748/1504] 10.222.0.18 () {58 vars in 1060 bytes} [Wed Jun 22 16:55:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:55:07.222483 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f740ef-52ec-4f7a-b841-8db8ee110199 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:55:07.233198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f740ef-52ec-4f7a-b841-8db8ee110199 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:55:07.237447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e261ad-7561-4665-8c05-2a96a6384261 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:55:07.238069 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e261ad-7561-4665-8c05-2a96a6384261 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:55:07.238353 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e261ad-7561-4665-8c05-2a96a6384261 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:55:07.238628 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e261ad-7561-4665-8c05-2a96a6384261 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:55:07.247202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e261ad-7561-4665-8c05-2a96a6384261 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:55:07.248651 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e261ad-7561-4665-8c05-2a96a6384261 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:55:07.257352 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 757/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:55:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:55:07.300025 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30aa79-fe79-4010-899f-f074f58238a8 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:55:07.300377 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30aa79-fe79-4010-899f-f074f58238a8 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:55:07.300657 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30aa79-fe79-4010-899f-f074f58238a8 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:55:07.301972 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 749/1506] 10.222.0.18 () {52 vars in 829 bytes} [Wed Jun 22 16:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:55:07.305494 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e261ad-7561-4665-8c05-2a96a6384261 service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:55:07.365284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e261ad-7561-4665-8c05-2a96a6384261 service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:55:07.369693 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c34281-ce7d-4ea1-8ab1-7bb82a8b1b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:55:07.370547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c34281-ce7d-4ea1-8ab1-7bb82a8b1b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:55:07.370825 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c34281-ce7d-4ea1-8ab1-7bb82a8b1b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:55:07.371100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c34281-ce7d-4ea1-8ab1-7bb82a8b1b00 admin admin] PATH_INFO: `/v3/users/4a9e0fb08b6e4969a53863f954717212` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:55:07.372295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c34281-ce7d-4ea1-8ab1-7bb82a8b1b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a9e0fb08b6e4969a53863f954717212)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:55:07.373297 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: WARNING py.warnings [None req-d3c34281-ce7d-4ea1-8ab1-7bb82a8b1b00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:55:07.373297 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: warnings.warn(msg) Jun 22 16:55:07.373297 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: Jun 22 16:55:07.374525 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c34281-ce7d-4ea1-8ab1-7bb82a8b1b00 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:55:07.574685 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d3c34281-ce7d-4ea1-8ab1-7bb82a8b1b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a9e0fb08b6e4969a53863f954717212'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:55:07.586859 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d3c34281-ce7d-4ea1-8ab1-7bb82a8b1b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a9e0fb08b6e4969a53863f954717212'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:55:07.587516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d3c34281-ce7d-4ea1-8ab1-7bb82a8b1b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a9e0fb08b6e4969a53863f954717212'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:55:07.605638 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d3c34281-ce7d-4ea1-8ab1-7bb82a8b1b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a9e0fb08b6e4969a53863f954717212'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:55:07.606558 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d3c34281-ce7d-4ea1-8ab1-7bb82a8b1b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a9e0fb08b6e4969a53863f954717212'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:55:07.610845 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:55:07.728119 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 758/1507] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:55:07 2022] DELETE /identity/v3/users/4a9e0fb08b6e4969a53863f954717212 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:55:07.732499 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2abdd-2915-4b42-892b-5c604b441fa8 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:55:07.736182 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2abdd-2915-4b42-892b-5c604b441fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:55:07.736182 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2abdd-2915-4b42-892b-5c604b441fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:55:07.753927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-e7e2abdd-2915-4b42-892b-5c604b441fa8 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:55:07.755112 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e7e2abdd-2915-4b42-892b-5c604b441fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:55:07.812267 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 750/1508] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:55:07.822372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c34281-ce7d-4ea1-8ab1-7bb82a8b1b00 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:55:07.823798 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d3c34281-ce7d-4ea1-8ab1-7bb82a8b1b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:55:07.878820 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c34281-ce7d-4ea1-8ab1-7bb82a8b1b00 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:55:07.882276 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9f0fb-8427-42d4-b6a1-e9cc033884b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:55:07.882908 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9f0fb-8427-42d4-b6a1-e9cc033884b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:55:07.883192 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9f0fb-8427-42d4-b6a1-e9cc033884b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:55:07.883469 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9f0fb-8427-42d4-b6a1-e9cc033884b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:55:07.892220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9f0fb-8427-42d4-b6a1-e9cc033884b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:55:07.893646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9f0fb-8427-42d4-b6a1-e9cc033884b8 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:55:07.903062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 759/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:55:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 16:55:08.375424 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2abdd-2915-4b42-892b-5c604b441fa8 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:55:08.376916 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e7e2abdd-2915-4b42-892b-5c604b441fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:55:08.388701 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2abdd-2915-4b42-892b-5c604b441fa8 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:55:08.393912 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe3676-59f3-4c99-ab27-9f7ab5281388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:55:08.394793 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe3676-59f3-4c99-ab27-9f7ab5281388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:55:08.395076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe3676-59f3-4c99-ab27-9f7ab5281388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:55:08.395347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe3676-59f3-4c99-ab27-9f7ab5281388 admin admin] PATH_INFO: `/v3/projects/a57282d8706b4a179414cae176088d19` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:55:08.396630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe3676-59f3-4c99-ab27-9f7ab5281388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a57282d8706b4a179414cae176088d19)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:55:08.397638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: WARNING py.warnings [None req-4ebe3676-59f3-4c99-ab27-9f7ab5281388 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:55:08.397638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: warnings.warn(msg) Jun 22 16:55:08.397638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: Jun 22 16:55:08.398836 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe3676-59f3-4c99-ab27-9f7ab5281388 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:55:08.566789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4ebe3676-59f3-4c99-ab27-9f7ab5281388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a57282d8706b4a179414cae176088d19', 'request_id': 'req-4ebe3676-59f3-4c99-ab27-9f7ab5281388'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:55:08.670072 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4ebe3676-59f3-4c99-ab27-9f7ab5281388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a57282d8706b4a179414cae176088d19', 'request_id': 'req-4ebe3676-59f3-4c99-ab27-9f7ab5281388'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:55:08.670072 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4ebe3676-59f3-4c99-ab27-9f7ab5281388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a57282d8706b4a179414cae176088d19', 'request_id': 'req-4ebe3676-59f3-4c99-ab27-9f7ab5281388'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:55:08.688146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4ebe3676-59f3-4c99-ab27-9f7ab5281388 admin admin] The token cache is being invalidate because project a57282d8706b4a179414cae176088d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:55:08.689131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4ebe3676-59f3-4c99-ab27-9f7ab5281388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:55:08.689845 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4ebe3676-59f3-4c99-ab27-9f7ab5281388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:55:08.691672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 751/1510] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:55:08 2022] DELETE /identity/v3/projects/a57282d8706b4a179414cae176088d19 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:55:17.898750 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:55:18.684869 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:56:47.681642 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9167104-281e-4eee-b6d1-cd9665bbce59 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:56:47.682250 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9167104-281e-4eee-b6d1-cd9665bbce59 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:56:47.682250 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9167104-281e-4eee-b6d1-cd9665bbce59 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:56:47.683591 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 16:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:56:47.688366 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528bf2c-3cc4-4d3f-b329-ee93dd2cae18 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:56:47.688763 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528bf2c-3cc4-4d3f-b329-ee93dd2cae18 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:56:47.688922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528bf2c-3cc4-4d3f-b329-ee93dd2cae18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:56:47.706939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-8528bf2c-3cc4-4d3f-b329-ee93dd2cae18 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:56:47.708156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-8528bf2c-3cc4-4d3f-b329-ee93dd2cae18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:56:47.764836 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 16:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:56:47.919480 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9167104-281e-4eee-b6d1-cd9665bbce59 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:56:47.921187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e9167104-281e-4eee-b6d1-cd9665bbce59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:56:47.997289 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9167104-281e-4eee-b6d1-cd9665bbce59 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:56:48.004700 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2ed06-64b4-44b7-9dfe-90cb1df88007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:56:48.008637 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2ed06-64b4-44b7-9dfe-90cb1df88007 service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:56:48.008637 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2ed06-64b4-44b7-9dfe-90cb1df88007 service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:56:48.008637 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2ed06-64b4-44b7-9dfe-90cb1df88007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:56:48.017740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2ed06-64b4-44b7-9dfe-90cb1df88007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:56:48.019389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2ed06-64b4-44b7-9dfe-90cb1df88007 service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:56:48.029699 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 761/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:56:48.860245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190910b-2b91-4385-ba93-7a7d10327d12 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:56:48.860807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190910b-2b91-4385-ba93-7a7d10327d12 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:56:48.860807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190910b-2b91-4385-ba93-7a7d10327d12 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:56:48.862192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 16:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:56:48.867012 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c922a-7015-4a43-86a5-e634b94c62eb None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:56:48.867473 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c922a-7015-4a43-86a5-e634b94c62eb None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:56:48.867609 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c922a-7015-4a43-86a5-e634b94c62eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:56:48.885953 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-645c922a-7015-4a43-86a5-e634b94c62eb None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:56:48.887190 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-645c922a-7015-4a43-86a5-e634b94c62eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:56:48.894937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 16:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:56:49.044603 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190910b-2b91-4385-ba93-7a7d10327d12 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:56:49.058721 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190910b-2b91-4385-ba93-7a7d10327d12 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:56:49.063968 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08b65c-96d8-40fa-ba9a-876d34d0bc76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:56:49.064619 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08b65c-96d8-40fa-ba9a-876d34d0bc76 service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:56:49.064902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08b65c-96d8-40fa-ba9a-876d34d0bc76 service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:56:49.065175 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08b65c-96d8-40fa-ba9a-876d34d0bc76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:56:49.073689 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08b65c-96d8-40fa-ba9a-876d34d0bc76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:56:49.075265 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08b65c-96d8-40fa-ba9a-876d34d0bc76 service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:56:49.084569 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 754/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:56:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:56:49.422095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe23d1-5c75-4dcb-9d81-900fabdafd35 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:56:49.422302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe23d1-5c75-4dcb-9d81-900fabdafd35 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:56:49.422584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe23d1-5c75-4dcb-9d81-900fabdafd35 None None] PATH_INFO: `/v3` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:56:49.423909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 763/1517] 10.222.0.50 () {54 vars in 925 bytes} [Wed Jun 22 16:56:49 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:56:49.430780 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2974d-13c7-47ff-9e70-0feceedfd891 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:56:49.431075 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2974d-13c7-47ff-9e70-0feceedfd891 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:56:49.431359 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2974d-13c7-47ff-9e70-0feceedfd891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:56:49.448937 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-35b2974d-13c7-47ff-9e70-0feceedfd891 None None] MFA Rules not processed for user `5a79a71fa89446c3abbb4fdbf2c93aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:56:49.450131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-35b2974d-13c7-47ff-9e70-0feceedfd891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:56:49.511220 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 755/1518] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Jun 22 16:56:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:56:58.880124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=37 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:56:58.972881 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bf077-7542-472f-8f38-d4b94ba16f68 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:56:58.973090 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bf077-7542-472f-8f38-d4b94ba16f68 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:56:58.973362 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bf077-7542-472f-8f38-d4b94ba16f68 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:56:58.974814 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 764/1519] 10.222.0.18 () {54 vars in 960 bytes} [Wed Jun 22 16:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:56:58.979741 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babf850-d7bf-4e65-a9ab-48e9b2bd45c4 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:56:58.980218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babf850-d7bf-4e65-a9ab-48e9b2bd45c4 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:56:58.980327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babf850-d7bf-4e65-a9ab-48e9b2bd45c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:56:58.998817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-1babf850-d7bf-4e65-a9ab-48e9b2bd45c4 None None] MFA Rules not processed for user `5a79a71fa89446c3abbb4fdbf2c93aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:56:59.000060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-1babf850-d7bf-4e65-a9ab-48e9b2bd45c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:56:59.009664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 756/1520] 10.222.0.18 () {58 vars in 1057 bytes} [Wed Jun 22 16:56:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:56:59.017415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bf077-7542-472f-8f38-d4b94ba16f68 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:56:59.033133 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bf077-7542-472f-8f38-d4b94ba16f68 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:56:59.039781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d7c31-020d-4c8c-a122-e8248a48b5fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79a71fa89446c3abbb4fdbf2c93aac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:56:59.040442 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d7c31-020d-4c8c-a122-e8248a48b5fd service placement] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:56:59.040729 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d7c31-020d-4c8c-a122-e8248a48b5fd service placement] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:56:59.041195 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d7c31-020d-4c8c-a122-e8248a48b5fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:56:59.051058 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d7c31-020d-4c8c-a122-e8248a48b5fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:56:59.052738 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d7c31-020d-4c8c-a122-e8248a48b5fd service placement] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:56:59.062917 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 765/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:56:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:57:00.327017 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f3ebf-56fa-4ffd-97c1-f2bff11b25ad None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:57:00.327564 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f3ebf-56fa-4ffd-97c1-f2bff11b25ad None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:57:00.327564 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f3ebf-56fa-4ffd-97c1-f2bff11b25ad None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:57:00.329016 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 16:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:57:00.333638 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d88a4-858f-4a1c-8697-2a91cca40cac None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:57:00.334079 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d88a4-858f-4a1c-8697-2a91cca40cac None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:57:00.334211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d88a4-858f-4a1c-8697-2a91cca40cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:57:00.357265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-758d88a4-858f-4a1c-8697-2a91cca40cac None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:57:00.358453 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-758d88a4-858f-4a1c-8697-2a91cca40cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:57:00.366192 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 16:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:57:00.518311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f3ebf-56fa-4ffd-97c1-f2bff11b25ad None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:57:00.534445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f3ebf-56fa-4ffd-97c1-f2bff11b25ad None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:57:00.540404 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bd3e0-b5f8-455d-a939-d602f824963b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:57:00.541026 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bd3e0-b5f8-455d-a939-d602f824963b service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:57:00.541305 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bd3e0-b5f8-455d-a939-d602f824963b service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:57:00.541577 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bd3e0-b5f8-455d-a939-d602f824963b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:57:00.549673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bd3e0-b5f8-455d-a939-d602f824963b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:57:00.551244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bd3e0-b5f8-455d-a939-d602f824963b service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:57:00.560688 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 758/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:57:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:57:01.400417 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138da09-0b0c-47db-abda-74b84d9ffb7e None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:57:01.401228 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138da09-0b0c-47db-abda-74b84d9ffb7e None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:57:01.401338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138da09-0b0c-47db-abda-74b84d9ffb7e None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:57:01.402683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 22 16:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 22 16:57:01.407741 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5345e0-6ced-41b4-8fa0-bbc695ff2b67 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:57:01.408159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5345e0-6ced-41b4-8fa0-bbc695ff2b67 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:57:01.408387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5345e0-6ced-41b4-8fa0-bbc695ff2b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:57:01.426070 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-da5345e0-6ced-41b4-8fa0-bbc695ff2b67 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:57:01.427381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-da5345e0-6ced-41b4-8fa0-bbc695ff2b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:57:01.435582 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 22 16:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:57:01.586053 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138da09-0b0c-47db-abda-74b84d9ffb7e None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:57:01.599932 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138da09-0b0c-47db-abda-74b84d9ffb7e None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:57:01.605220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe66be3-d4be-4e22-b27a-b3540e0825a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:57:01.605849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe66be3-d4be-4e22-b27a-b3540e0825a2 service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:57:01.606134 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe66be3-d4be-4e22-b27a-b3540e0825a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:57:01.606414 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe66be3-d4be-4e22-b27a-b3540e0825a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:57:01.614325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe66be3-d4be-4e22-b27a-b3540e0825a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:57:01.615917 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe66be3-d4be-4e22-b27a-b3540e0825a2 service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:57:01.625618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 768/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:57:05.510295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de94914-0364-49c9-9743-8234546dd5c5 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:57:05.510888 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de94914-0364-49c9-9743-8234546dd5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:57:05.510888 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de94914-0364-49c9-9743-8234546dd5c5 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:57:05.512269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 16:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:57:05.517773 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7369f73-ba0e-4214-97dd-c42542f1367c None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:57:05.518173 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7369f73-ba0e-4214-97dd-c42542f1367c None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:57:05.518332 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7369f73-ba0e-4214-97dd-c42542f1367c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:57:05.536121 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-d7369f73-ba0e-4214-97dd-c42542f1367c None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:57:05.537315 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d7369f73-ba0e-4214-97dd-c42542f1367c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:57:05.545435 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 16:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:57:05.582342 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de94914-0364-49c9-9743-8234546dd5c5 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:57:05.584265 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-4de94914-0364-49c9-9743-8234546dd5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:57:05.639973 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de94914-0364-49c9-9743-8234546dd5c5 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:57:05.643443 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c812bc6-22d1-49b2-8b7e-20413380aa07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:57:05.644069 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c812bc6-22d1-49b2-8b7e-20413380aa07 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:57:05.644385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c812bc6-22d1-49b2-8b7e-20413380aa07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:57:05.644659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c812bc6-22d1-49b2-8b7e-20413380aa07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:57:05.653640 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c812bc6-22d1-49b2-8b7e-20413380aa07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:57:05.655037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c812bc6-22d1-49b2-8b7e-20413380aa07 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:57:05.659840 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:57:05.664396 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 761/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:57:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:57:07.676264 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f6756-d0be-47c8-bf88-4ac6c80ff4c5 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:57:07.676811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f6756-d0be-47c8-bf88-4ac6c80ff4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:57:07.676811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f6756-d0be-47c8-bf88-4ac6c80ff4c5 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:57:07.678099 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 16:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:57:07.683207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bfa6f-7dbd-4e2a-aa8a-1c74c2a74d65 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:57:07.683660 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bfa6f-7dbd-4e2a-aa8a-1c74c2a74d65 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:57:07.683760 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bfa6f-7dbd-4e2a-aa8a-1c74c2a74d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:57:07.702272 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-b53bfa6f-7dbd-4e2a-aa8a-1c74c2a74d65 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:57:07.703456 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b53bfa6f-7dbd-4e2a-aa8a-1c74c2a74d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:57:07.711184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 16:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:57:07.746857 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f6756-d0be-47c8-bf88-4ac6c80ff4c5 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:57:07.757345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f6756-d0be-47c8-bf88-4ac6c80ff4c5 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:57:07.761286 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbc352-ee6b-4f13-beda-c1351130c36a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:57:07.761907 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbc352-ee6b-4f13-beda-c1351130c36a service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:57:07.762189 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbc352-ee6b-4f13-beda-c1351130c36a service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:57:07.762465 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbc352-ee6b-4f13-beda-c1351130c36a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:57:07.771016 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbc352-ee6b-4f13-beda-c1351130c36a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:57:07.772471 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbc352-ee6b-4f13-beda-c1351130c36a service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:57:07.782827 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 771/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:57:11.326275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79056c1e-600c-4a22-95cf-0a4a8315d740 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:57:11.326826 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79056c1e-600c-4a22-95cf-0a4a8315d740 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:57:11.326826 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79056c1e-600c-4a22-95cf-0a4a8315d740 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:57:11.328140 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 16:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:57:11.333258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabced7-1e8f-45a1-b053-843b666f66ce None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:57:11.333661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabced7-1e8f-45a1-b053-843b666f66ce None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:57:11.333823 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabced7-1e8f-45a1-b053-843b666f66ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:57:11.353946 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-bcabced7-1e8f-45a1-b053-843b666f66ce None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:57:11.355217 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-bcabced7-1e8f-45a1-b053-843b666f66ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:57:11.363024 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 16:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:57:11.673769 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79056c1e-600c-4a22-95cf-0a4a8315d740 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:57:11.675441 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-79056c1e-600c-4a22-95cf-0a4a8315d740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:57:11.731482 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79056c1e-600c-4a22-95cf-0a4a8315d740 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:57:11.734988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f1175-ee22-442a-ac7a-500c9d67359f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:57:11.735618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f1175-ee22-442a-ac7a-500c9d67359f service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:57:11.735897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f1175-ee22-442a-ac7a-500c9d67359f service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:57:11.736200 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f1175-ee22-442a-ac7a-500c9d67359f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:57:11.745483 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f1175-ee22-442a-ac7a-500c9d67359f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:57:11.746942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f1175-ee22-442a-ac7a-500c9d67359f service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:57:11.756215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 764/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:57:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:57:13.807049 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5965e2b-418c-468c-977d-8cb4b5fd1cbb None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:57:13.807484 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5965e2b-418c-468c-977d-8cb4b5fd1cbb None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:57:13.807610 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5965e2b-418c-468c-977d-8cb4b5fd1cbb None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:57:13.809041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 22 16:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:57:13.814219 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552a64f-18a3-459e-a6f6-069c90c21e6a None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:57:13.814597 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552a64f-18a3-459e-a6f6-069c90c21e6a None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:57:13.814780 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552a64f-18a3-459e-a6f6-069c90c21e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:57:13.832752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-1552a64f-18a3-459e-a6f6-069c90c21e6a None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:57:13.833936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-1552a64f-18a3-459e-a6f6-069c90c21e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:57:13.842166 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 22 16:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:57:14.140451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5965e2b-418c-468c-977d-8cb4b5fd1cbb None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:57:14.142172 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d5965e2b-418c-468c-977d-8cb4b5fd1cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:57:14.155379 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5965e2b-418c-468c-977d-8cb4b5fd1cbb None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:57:14.158912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79398e42-ce0f-4a4f-9e4c-8254016b858b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:57:14.159540 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79398e42-ce0f-4a4f-9e4c-8254016b858b service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:57:14.159826 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79398e42-ce0f-4a4f-9e4c-8254016b858b service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:57:14.160128 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79398e42-ce0f-4a4f-9e4c-8254016b858b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:57:14.168893 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79398e42-ce0f-4a4f-9e4c-8254016b858b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:57:14.170318 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79398e42-ce0f-4a4f-9e4c-8254016b858b service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:57:14.179574 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 774/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:57:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:57:23.827620 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=32 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:57:24.175472 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=33 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:44.204684 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95283f2e-93be-46c9-b2a8-930969496573 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.205361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95283f2e-93be-46c9-b2a8-930969496573 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.205361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95283f2e-93be-46c9-b2a8-930969496573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.232251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-95283f2e-93be-46c9-b2a8-930969496573 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:44.233919 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-95283f2e-93be-46c9-b2a8-930969496573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:44.246038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 766/1540] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:58:44.256725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5534155-8582-451b-b340-5745e23af7bf None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.257332 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5534155-8582-451b-b340-5745e23af7bf None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.257332 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5534155-8582-451b-b340-5745e23af7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.289308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-f5534155-8582-451b-b340-5745e23af7bf None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:44.290575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f5534155-8582-451b-b340-5745e23af7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:44.310432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 775/1541] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:58:44.315298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95283f2e-93be-46c9-b2a8-930969496573 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:44.328523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95283f2e-93be-46c9-b2a8-930969496573 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:44.336430 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3fde7-34d5-49ce-9b74-b0d63cde8066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:44.337399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3fde7-34d5-49ce-9b74-b0d63cde8066 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.337901 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3fde7-34d5-49ce-9b74-b0d63cde8066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.338413 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3fde7-34d5-49ce-9b74-b0d63cde8066 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.339460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3fde7-34d5-49ce-9b74-b0d63cde8066 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:58:44.340012 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3fde7-34d5-49ce-9b74-b0d63cde8066 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:44.341851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3fde7-34d5-49ce-9b74-b0d63cde8066 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:44.369531 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 767/1542] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:58:44.378042 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5534155-8582-451b-b340-5745e23af7bf None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:44.394835 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5534155-8582-451b-b340-5745e23af7bf None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:44.405059 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac47425-d62a-4318-85f0-56f4882c054f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:44.405745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac47425-d62a-4318-85f0-56f4882c054f admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.406032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac47425-d62a-4318-85f0-56f4882c054f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.407217 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac47425-d62a-4318-85f0-56f4882c054f admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.407942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac47425-d62a-4318-85f0-56f4882c054f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:44.410099 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac47425-d62a-4318-85f0-56f4882c054f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:44.470971 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ae234-dcf9-4886-b531-1b5f89d35b9d None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.471181 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ae234-dcf9-4886-b531-1b5f89d35b9d None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.471462 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ae234-dcf9-4886-b531-1b5f89d35b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.499258 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-750ae234-dcf9-4886-b531-1b5f89d35b9d None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:44.501436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-750ae234-dcf9-4886-b531-1b5f89d35b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:44.520465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 768/1543] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:58:44.521906 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2c1f4-1094-4df7-8821-b6db0200c29b None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.522198 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2c1f4-1094-4df7-8821-b6db0200c29b None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.522475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2c1f4-1094-4df7-8821-b6db0200c29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.549368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 776/1544] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:58:44 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:44.551375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-e0f2c1f4-1094-4df7-8821-b6db0200c29b None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:44.551733 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7431b-d91c-4264-a2c0-d6d97ba10bf3 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.553128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e0f2c1f4-1094-4df7-8821-b6db0200c29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:44.557312 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7431b-d91c-4264-a2c0-d6d97ba10bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.557711 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7431b-d91c-4264-a2c0-d6d97ba10bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.596015 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-e6b7431b-d91c-4264-a2c0-d6d97ba10bf3 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:44.597286 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e6b7431b-d91c-4264-a2c0-d6d97ba10bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:44.689641 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 777/1545] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:44.691314 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8c7b0-5d68-4b9c-83bd-e8f1a6d726e0 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.692009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8c7b0-5d68-4b9c-83bd-e8f1a6d726e0 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.693311 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8c7b0-5d68-4b9c-83bd-e8f1a6d726e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.717554 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 769/1546] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:44.718410 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2c1f4-1094-4df7-8821-b6db0200c29b None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:44.732266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-63f8c7b0-5d68-4b9c-83bd-e8f1a6d726e0 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:44.733145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2c1f4-1094-4df7-8821-b6db0200c29b None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:44.733406 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-63f8c7b0-5d68-4b9c-83bd-e8f1a6d726e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:44.737890 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fabf3-4557-4396-9f05-39e8d9d8e6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:44.738563 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fabf3-4557-4396-9f05-39e8d9d8e6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.738845 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fabf3-4557-4396-9f05-39e8d9d8e6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.739119 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fabf3-4557-4396-9f05-39e8d9d8e6e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.739813 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fabf3-4557-4396-9f05-39e8d9d8e6e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:44.741938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 778/1547] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:44.742079 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fabf3-4557-4396-9f05-39e8d9d8e6e2 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:44.744421 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc205d-fcd5-4fe8-b497-758a5d53ed11 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.744421 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc205d-fcd5-4fe8-b497-758a5d53ed11 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.744421 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc205d-fcd5-4fe8-b497-758a5d53ed11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.761735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-a1dc205d-fcd5-4fe8-b497-758a5d53ed11 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:44.773905 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-a1dc205d-fcd5-4fe8-b497-758a5d53ed11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:44.773905 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 779/1548] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:44.773905 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e26a0-3fa1-434b-b1d1-bd6df18d1b16 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.773905 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e26a0-3fa1-434b-b1d1-bd6df18d1b16 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.773905 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e26a0-3fa1-434b-b1d1-bd6df18d1b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.792542 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-702e26a0-3fa1-434b-b1d1-bd6df18d1b16 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:44.793738 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-702e26a0-3fa1-434b-b1d1-bd6df18d1b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:44.801546 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 780/1549] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:44.803096 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dc8f7-5b2a-4c23-a64a-97243a06e6ff None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.803096 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dc8f7-5b2a-4c23-a64a-97243a06e6ff None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.803412 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dc8f7-5b2a-4c23-a64a-97243a06e6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.820686 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-d77dc8f7-5b2a-4c23-a64a-97243a06e6ff None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:44.821865 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d77dc8f7-5b2a-4c23-a64a-97243a06e6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:44.826749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 770/1550] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:58:44 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:44.827961 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f1bf5-a206-4243-b056-cc8a879a4302 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.828349 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f1bf5-a206-4243-b056-cc8a879a4302 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.828728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f1bf5-a206-4243-b056-cc8a879a4302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.830926 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 781/1551] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:44.832264 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a7fe4-4508-4a9e-a891-00b4ab38a7aa None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.832558 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a7fe4-4508-4a9e-a891-00b4ab38a7aa None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.832861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a7fe4-4508-4a9e-a891-00b4ab38a7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.846722 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-672f1bf5-a206-4243-b056-cc8a879a4302 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:44.847916 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-672f1bf5-a206-4243-b056-cc8a879a4302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:44.850912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-661a7fe4-4508-4a9e-a891-00b4ab38a7aa None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:44.852669 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-661a7fe4-4508-4a9e-a891-00b4ab38a7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:44.856236 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 771/1552] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:44.857004 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f1bf5-a206-4243-b056-cc8a879a4302 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:44.866191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f1bf5-a206-4243-b056-cc8a879a4302 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:44.868466 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 782/1553] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:44.869885 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4464b-c759-4c02-848c-ecd29237f2ee None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.870231 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4464b-c759-4c02-848c-ecd29237f2ee None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.870455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4464b-c759-4c02-848c-ecd29237f2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.870749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0d686-d454-407e-aecb-a10ffc15c7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:44.871388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0d686-d454-407e-aecb-a10ffc15c7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.871672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0d686-d454-407e-aecb-a10ffc15c7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.872120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0d686-d454-407e-aecb-a10ffc15c7e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.872736 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0d686-d454-407e-aecb-a10ffc15c7e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:58:44.873040 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0d686-d454-407e-aecb-a10ffc15c7e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:44.874614 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0d686-d454-407e-aecb-a10ffc15c7e7 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:44.892789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 772/1554] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:58:44.892789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aca451-a45a-4196-a3f5-211377ead8a0 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.892789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aca451-a45a-4196-a3f5-211377ead8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.892789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aca451-a45a-4196-a3f5-211377ead8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.894279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-62f4464b-c759-4c02-848c-ecd29237f2ee None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:44.895484 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-62f4464b-c759-4c02-848c-ecd29237f2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:44.904233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 783/1555] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:44.905250 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a642a-51b9-49f0-a237-3b149fec54a5 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.905510 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-37aca451-a45a-4196-a3f5-211377ead8a0 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:44.905630 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a642a-51b9-49f0-a237-3b149fec54a5 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.905822 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a642a-51b9-49f0-a237-3b149fec54a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.906667 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-37aca451-a45a-4196-a3f5-211377ead8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:44.915256 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 773/1556] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:44.915903 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aca451-a45a-4196-a3f5-211377ead8a0 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:44.924130 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-d44a642a-51b9-49f0-a237-3b149fec54a5 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:44.924931 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aca451-a45a-4196-a3f5-211377ead8a0 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:44.925321 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d44a642a-51b9-49f0-a237-3b149fec54a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:44.929405 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91381123-b546-4759-b04b-ef8c1915c4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:44.930061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91381123-b546-4759-b04b-ef8c1915c4ad admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.930341 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91381123-b546-4759-b04b-ef8c1915c4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.930616 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91381123-b546-4759-b04b-ef8c1915c4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.931334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91381123-b546-4759-b04b-ef8c1915c4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:44.936232 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91381123-b546-4759-b04b-ef8c1915c4ad admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:44.936400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 784/1557] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:44.936400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a642a-51b9-49f0-a237-3b149fec54a5 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:44.945120 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a642a-51b9-49f0-a237-3b149fec54a5 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:44.947288 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 774/1558] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:44.947288 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915676b2-1275-4adc-b96e-89d553a6273e None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.947288 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915676b2-1275-4adc-b96e-89d553a6273e None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.947288 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915676b2-1275-4adc-b96e-89d553a6273e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.952217 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e39c5-7609-4045-9faa-1985aecd354b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:44.952918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e39c5-7609-4045-9faa-1985aecd354b admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.953209 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e39c5-7609-4045-9faa-1985aecd354b admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.953598 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e39c5-7609-4045-9faa-1985aecd354b admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.954366 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e39c5-7609-4045-9faa-1985aecd354b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:58:44.954681 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e39c5-7609-4045-9faa-1985aecd354b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:44.955734 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: WARNING py.warnings [None req-1e5e39c5-7609-4045-9faa-1985aecd354b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:58:44.955734 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: warnings.warn(msg) Jun 22 16:58:44.955734 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: Jun 22 16:58:44.956646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e39c5-7609-4045-9faa-1985aecd354b admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:44.964826 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-915676b2-1275-4adc-b96e-89d553a6273e None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:44.966013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-915676b2-1275-4adc-b96e-89d553a6273e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:44.974542 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 785/1559] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:58:44.974542 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e39c5-7609-4045-9faa-1985aecd354b admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:44.979581 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 775/1560] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:44.980534 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915676b2-1275-4adc-b96e-89d553a6273e None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:44.980739 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e39c5-7609-4045-9faa-1985aecd354b admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:44.985327 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07b902-beb2-495e-97f6-e2ef4ec99f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:44.985914 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07b902-beb2-495e-97f6-e2ef4ec99f74 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.986198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07b902-beb2-495e-97f6-e2ef4ec99f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.986475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07b902-beb2-495e-97f6-e2ef4ec99f74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.987197 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07b902-beb2-495e-97f6-e2ef4ec99f74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:58:44.987511 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07b902-beb2-495e-97f6-e2ef4ec99f74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:44.989132 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07b902-beb2-495e-97f6-e2ef4ec99f74 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:44.989844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915676b2-1275-4adc-b96e-89d553a6273e None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:44.995000 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b069bf-bd20-4bb8-9b6d-c909c0f46e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:44.995624 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b069bf-bd20-4bb8-9b6d-c909c0f46e41 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:44.995906 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b069bf-bd20-4bb8-9b6d-c909c0f46e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:44.996215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b069bf-bd20-4bb8-9b6d-c909c0f46e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:44.996906 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b069bf-bd20-4bb8-9b6d-c909c0f46e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:44.997938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: WARNING py.warnings [None req-a4b069bf-bd20-4bb8-9b6d-c909c0f46e41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:58:44.997938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: warnings.warn(msg) Jun 22 16:58:44.997938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: Jun 22 16:58:44.999108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b069bf-bd20-4bb8-9b6d-c909c0f46e41 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:45.008366 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 786/1561] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:58:45.008366 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178fbc9-c70f-49af-9f63-5cab9a8fee1f None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:45.008366 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178fbc9-c70f-49af-9f63-5cab9a8fee1f None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:45.008366 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178fbc9-c70f-49af-9f63-5cab9a8fee1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:45.026116 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-3178fbc9-c70f-49af-9f63-5cab9a8fee1f None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:45.027054 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3178fbc9-c70f-49af-9f63-5cab9a8fee1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:45.035044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 787/1562] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:45.035807 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178fbc9-c70f-49af-9f63-5cab9a8fee1f None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:45.045648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178fbc9-c70f-49af-9f63-5cab9a8fee1f None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:45.050285 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb934ac-050d-4e0d-bae7-4a381992dbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:45.050915 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb934ac-050d-4e0d-bae7-4a381992dbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:45.051232 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb934ac-050d-4e0d-bae7-4a381992dbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:45.051511 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb934ac-050d-4e0d-bae7-4a381992dbf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:45.052273 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb934ac-050d-4e0d-bae7-4a381992dbf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:58:45.052584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb934ac-050d-4e0d-bae7-4a381992dbf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:45.054184 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb934ac-050d-4e0d-bae7-4a381992dbf2 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:45.066108 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 788/1563] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:58:45.067525 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb934ac-050d-4e0d-bae7-4a381992dbf2 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:45.077098 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb934ac-050d-4e0d-bae7-4a381992dbf2 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:45.083251 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d23e0a-4dde-4f33-bd71-c268db79e135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:45.083863 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d23e0a-4dde-4f33-bd71-c268db79e135 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:45.084169 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d23e0a-4dde-4f33-bd71-c268db79e135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:45.084447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d23e0a-4dde-4f33-bd71-c268db79e135 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:45.088194 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 776/1564] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:58:44 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:45.088351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d23e0a-4dde-4f33-bd71-c268db79e135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:58:45.088351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d23e0a-4dde-4f33-bd71-c268db79e135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:45.088539 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b069bf-bd20-4bb8-9b6d-c909c0f46e41 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:45.088634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d23e0a-4dde-4f33-bd71-c268db79e135 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:45.106209 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 789/1565] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:58:45.106209 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d23e0a-4dde-4f33-bd71-c268db79e135 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:45.111436 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d23e0a-4dde-4f33-bd71-c268db79e135 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:45.135346 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:45.139263 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:45.151979 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b069bf-bd20-4bb8-9b6d-c909c0f46e41 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:45.156997 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3e64d-56c2-4dc3-b801-4e3292e7e0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:45.157699 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3e64d-56c2-4dc3-b801-4e3292e7e0ac admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:45.157990 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3e64d-56c2-4dc3-b801-4e3292e7e0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:45.158271 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3e64d-56c2-4dc3-b801-4e3292e7e0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:45.159011 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3e64d-56c2-4dc3-b801-4e3292e7e0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:45.160786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3e64d-56c2-4dc3-b801-4e3292e7e0ac admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:45.174118 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 777/1566] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:45.174296 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34d216-846b-4fb3-92c2-f6cae104b606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:45.174296 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34d216-846b-4fb3-92c2-f6cae104b606 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:45.174464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3e64d-56c2-4dc3-b801-4e3292e7e0ac admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:45.174559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34d216-846b-4fb3-92c2-f6cae104b606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:45.174559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34d216-846b-4fb3-92c2-f6cae104b606 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:45.174559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34d216-846b-4fb3-92c2-f6cae104b606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:45.174778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34d216-846b-4fb3-92c2-f6cae104b606 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:45.181179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3e64d-56c2-4dc3-b801-4e3292e7e0ac admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:45.185869 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24d428-2e6e-4b45-9487-7316d5c858d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:45.186501 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24d428-2e6e-4b45-9487-7316d5c858d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:45.186785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24d428-2e6e-4b45-9487-7316d5c858d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:45.187062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24d428-2e6e-4b45-9487-7316d5c858d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:45.187782 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24d428-2e6e-4b45-9487-7316d5c858d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:58:45.188092 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24d428-2e6e-4b45-9487-7316d5c858d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:45.189705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24d428-2e6e-4b45-9487-7316d5c858d1 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:45.202102 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 778/1567] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:58:45.202882 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24d428-2e6e-4b45-9487-7316d5c858d1 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:45.212679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24d428-2e6e-4b45-9487-7316d5c858d1 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:45.217255 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf4b05-506a-40cf-a95d-49e23e691291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:45.217929 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf4b05-506a-40cf-a95d-49e23e691291 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:45.218211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf4b05-506a-40cf-a95d-49e23e691291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:45.218509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf4b05-506a-40cf-a95d-49e23e691291 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:45.219197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf4b05-506a-40cf-a95d-49e23e691291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:45.221228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf4b05-506a-40cf-a95d-49e23e691291 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:45.271643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 790/1568] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:58:45 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:45.272486 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34d216-846b-4fb3-92c2-f6cae104b606 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:45.296478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 779/1569] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:58:45 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:45.296478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf4b05-506a-40cf-a95d-49e23e691291 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:45.337730 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34d216-846b-4fb3-92c2-f6cae104b606 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:45.357322 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf4b05-506a-40cf-a95d-49e23e691291 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:45.362016 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef00be-bfc8-4c89-ba95-aea3b7ebcb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:45.362675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef00be-bfc8-4c89-ba95-aea3b7ebcb16 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:45.362959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef00be-bfc8-4c89-ba95-aea3b7ebcb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:45.363235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef00be-bfc8-4c89-ba95-aea3b7ebcb16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:45.363928 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef00be-bfc8-4c89-ba95-aea3b7ebcb16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:45.365911 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef00be-bfc8-4c89-ba95-aea3b7ebcb16 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:45.391058 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687e40c-d065-4877-9084-70cacb918ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:45.392032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687e40c-d065-4877-9084-70cacb918ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:45.392032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687e40c-d065-4877-9084-70cacb918ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:45.392296 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0687e40c-d065-4877-9084-70cacb918ba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:45.392996 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687e40c-d065-4877-9084-70cacb918ba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:58:45.393308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687e40c-d065-4877-9084-70cacb918ba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:45.394921 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0687e40c-d065-4877-9084-70cacb918ba3 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:45.413611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 791/1570] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:58:45.413611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687e40c-d065-4877-9084-70cacb918ba3 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:45.417399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0687e40c-d065-4877-9084-70cacb918ba3 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:45.422021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47f2ec-1dc7-4049-8fb1-ef6f7c503718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:45.422662 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47f2ec-1dc7-4049-8fb1-ef6f7c503718 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:45.422927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47f2ec-1dc7-4049-8fb1-ef6f7c503718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:45.423207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47f2ec-1dc7-4049-8fb1-ef6f7c503718 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:45.423873 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47f2ec-1dc7-4049-8fb1-ef6f7c503718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:45.424951 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: WARNING py.warnings [None req-cc47f2ec-1dc7-4049-8fb1-ef6f7c503718 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:58:45.424951 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: warnings.warn(msg) Jun 22 16:58:45.424951 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: Jun 22 16:58:45.426123 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47f2ec-1dc7-4049-8fb1-ef6f7c503718 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:45.441207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 780/1571] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:58:45 2022] POST /identity/v3/projects => generated 393 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:45.441207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef00be-bfc8-4c89-ba95-aea3b7ebcb16 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:45.498743 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef00be-bfc8-4c89-ba95-aea3b7ebcb16 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:45.503243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49690b83-8a35-4369-808d-7b2398869c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:45.503879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49690b83-8a35-4369-808d-7b2398869c84 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:45.504292 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49690b83-8a35-4369-808d-7b2398869c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:45.504568 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49690b83-8a35-4369-808d-7b2398869c84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:45.505246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49690b83-8a35-4369-808d-7b2398869c84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:45.507148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49690b83-8a35-4369-808d-7b2398869c84 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:45.531012 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 792/1572] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:58:45 2022] POST /identity/v3/users => generated 282 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:45.531443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47f2ec-1dc7-4049-8fb1-ef6f7c503718 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:45.540845 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47f2ec-1dc7-4049-8fb1-ef6f7c503718 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:45.545606 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7121165-9113-4d8d-89a0-15ad2cab9ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:45.546466 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7121165-9113-4d8d-89a0-15ad2cab9ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:45.546750 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7121165-9113-4d8d-89a0-15ad2cab9ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:45.547027 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7121165-9113-4d8d-89a0-15ad2cab9ee7 admin admin] PATH_INFO: `/v3/projects/f50acc4ac39b4ca79a57dd26b61b4b09/users/1007c1456cea4882aa4e6bd90ca1d89c/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:45.561973 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7121165-9113-4d8d-89a0-15ad2cab9ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f50acc4ac39b4ca79a57dd26b61b4b09, user_id=1007c1456cea4882aa4e6bd90ca1d89c, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:45.564658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7121165-9113-4d8d-89a0-15ad2cab9ee7 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:45.581706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 781/1573] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:58:45 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:45.582751 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49690b83-8a35-4369-808d-7b2398869c84 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:45.607327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:45.631883 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 793/1574] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:58:45 2022] PUT /identity/v3/projects/f50acc4ac39b4ca79a57dd26b61b4b09/users/1007c1456cea4882aa4e6bd90ca1d89c/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:45.633428 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7121165-9113-4d8d-89a0-15ad2cab9ee7 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:45.646196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49690b83-8a35-4369-808d-7b2398869c84 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:45.652588 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:45.701578 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7121165-9113-4d8d-89a0-15ad2cab9ee7 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:45.703116 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1e7f9-7774-417f-870b-cbb0e1f5334c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:45.703773 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1e7f9-7774-417f-870b-cbb0e1f5334c admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:45.704056 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1e7f9-7774-417f-870b-cbb0e1f5334c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:45.704364 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1e7f9-7774-417f-870b-cbb0e1f5334c admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:45.705048 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1e7f9-7774-417f-870b-cbb0e1f5334c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:45.706176 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd5d88-6d8d-4cb3-bdda-53194ce6e41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:45.706840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd5d88-6d8d-4cb3-bdda-53194ce6e41e admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:45.707047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1e7f9-7774-417f-870b-cbb0e1f5334c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:45.707156 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd5d88-6d8d-4cb3-bdda-53194ce6e41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:45.707396 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd5d88-6d8d-4cb3-bdda-53194ce6e41e admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:45.708091 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd5d88-6d8d-4cb3-bdda-53194ce6e41e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:45.710054 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd5d88-6d8d-4cb3-bdda-53194ce6e41e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:45.808763 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 794/1575] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:58:45 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:45.809500 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd5d88-6d8d-4cb3-bdda-53194ce6e41e admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:45.819282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd5d88-6d8d-4cb3-bdda-53194ce6e41e admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:45.824636 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe2451-242e-4a69-a123-2cec9156eb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:45.825271 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe2451-242e-4a69-a123-2cec9156eb0d admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:45.825557 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe2451-242e-4a69-a123-2cec9156eb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:45.825829 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe2451-242e-4a69-a123-2cec9156eb0d admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:45.826501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe2451-242e-4a69-a123-2cec9156eb0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:45.828464 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe2451-242e-4a69-a123-2cec9156eb0d admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:45.839262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 782/1576] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:58:45 2022] POST /identity/v3/projects => generated 379 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:45.839262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1e7f9-7774-417f-870b-cbb0e1f5334c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:45.900653 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1e7f9-7774-417f-870b-cbb0e1f5334c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:45.906273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae3a95-dd1f-4690-bf22-d73f8e9f9c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:45.906934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae3a95-dd1f-4690-bf22-d73f8e9f9c21 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:45.907216 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae3a95-dd1f-4690-bf22-d73f8e9f9c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:45.907489 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae3a95-dd1f-4690-bf22-d73f8e9f9c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:45.908216 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae3a95-dd1f-4690-bf22-d73f8e9f9c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:45.910250 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae3a95-dd1f-4690-bf22-d73f8e9f9c21 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:45.922476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 795/1577] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:58:45 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:45.923294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe2451-242e-4a69-a123-2cec9156eb0d admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:45.933191 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe2451-242e-4a69-a123-2cec9156eb0d admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:45.937691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033847a9-de06-448c-a970-433787fc374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:45.938331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033847a9-de06-448c-a970-433787fc374b admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:45.938617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033847a9-de06-448c-a970-433787fc374b admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:45.938896 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033847a9-de06-448c-a970-433787fc374b admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:45.939576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033847a9-de06-448c-a970-433787fc374b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:45.941507 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033847a9-de06-448c-a970-433787fc374b admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.003717 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 783/1578] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:58:45 2022] POST /identity/v3/projects => generated 363 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:46.004756 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae3a95-dd1f-4690-bf22-d73f8e9f9c21 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.031341 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 796/1579] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:58:45 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:46.032792 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033847a9-de06-448c-a970-433787fc374b admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.042161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033847a9-de06-448c-a970-433787fc374b admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.049708 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:46.068812 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae3a95-dd1f-4690-bf22-d73f8e9f9c21 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.073553 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3ff1a-493f-4eb4-926f-5369dff5e70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.074225 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3ff1a-493f-4eb4-926f-5369dff5e70a admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.074512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3ff1a-493f-4eb4-926f-5369dff5e70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.074792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3ff1a-493f-4eb4-926f-5369dff5e70a admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.075565 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3ff1a-493f-4eb4-926f-5369dff5e70a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.077239 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af3ff1a-493f-4eb4-926f-5369dff5e70a admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.087354 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 784/1580] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:46.092239 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeb98f-cec6-4846-b1d1-518bc2b8b068 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.092532 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeb98f-cec6-4846-b1d1-518bc2b8b068 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.093664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeb98f-cec6-4846-b1d1-518bc2b8b068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.101142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb43bff-08a5-4e5f-86b7-6e1e8cd74c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.102370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43bff-08a5-4e5f-86b7-6e1e8cd74c67 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.102656 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43bff-08a5-4e5f-86b7-6e1e8cd74c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.102936 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43bff-08a5-4e5f-86b7-6e1e8cd74c67 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.103634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb43bff-08a5-4e5f-86b7-6e1e8cd74c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.105615 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb43bff-08a5-4e5f-86b7-6e1e8cd74c67 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.121216 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-eabeb98f-cec6-4846-b1d1-518bc2b8b068 None None] MFA Rules not processed for user `1007c1456cea4882aa4e6bd90ca1d89c`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:46.122479 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-eabeb98f-cec6-4846-b1d1-518bc2b8b068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:46.157783 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 797/1581] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:58:46 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:46.158778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb43bff-08a5-4e5f-86b7-6e1e8cd74c67 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.169008 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb43bff-08a5-4e5f-86b7-6e1e8cd74c67 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.173799 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa71f0c-392d-4311-8ec1-d39e8fce1bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.174441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa71f0c-392d-4311-8ec1-d39e8fce1bbe admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.174732 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa71f0c-392d-4311-8ec1-d39e8fce1bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.175015 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa71f0c-392d-4311-8ec1-d39e8fce1bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.175745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa71f0c-392d-4311-8ec1-d39e8fce1bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.177457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa71f0c-392d-4311-8ec1-d39e8fce1bbe admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.187821 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 798/1582] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:46.188399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 785/1583] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:46.189242 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabeb98f-cec6-4846-b1d1-518bc2b8b068 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.191845 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa71f0c-392d-4311-8ec1-d39e8fce1bbe admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.199677 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabeb98f-cec6-4846-b1d1-518bc2b8b068 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.201632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa71f0c-392d-4311-8ec1-d39e8fce1bbe admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.204195 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c854a-0938-447f-8f07-6ca9015de20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.204853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c854a-0938-447f-8f07-6ca9015de20f admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.205145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c854a-0938-447f-8f07-6ca9015de20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.205426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c854a-0938-447f-8f07-6ca9015de20f admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.206159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c854a-0938-447f-8f07-6ca9015de20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.206828 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a5717-eec8-41ac-a8b9-346f7a4d18d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.207660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a5717-eec8-41ac-a8b9-346f7a4d18d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.207792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c854a-0938-447f-8f07-6ca9015de20f admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.208341 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a5717-eec8-41ac-a8b9-346f7a4d18d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.208771 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a5717-eec8-41ac-a8b9-346f7a4d18d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.209626 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a5717-eec8-41ac-a8b9-346f7a4d18d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.212320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a5717-eec8-41ac-a8b9-346f7a4d18d5 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.220066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 786/1584] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:46.221783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c854a-0938-447f-8f07-6ca9015de20f admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.233310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c854a-0938-447f-8f07-6ca9015de20f admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.238020 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a0b74-8070-4266-b3db-aa1ea1fa3fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.238693 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a0b74-8070-4266-b3db-aa1ea1fa3fac admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.238982 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a0b74-8070-4266-b3db-aa1ea1fa3fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.239272 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a0b74-8070-4266-b3db-aa1ea1fa3fac admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.240036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a0b74-8070-4266-b3db-aa1ea1fa3fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.242029 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a0b74-8070-4266-b3db-aa1ea1fa3fac admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.334412 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 799/1585] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:58:46 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:46.335416 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a5717-eec8-41ac-a8b9-346f7a4d18d5 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.345597 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a5717-eec8-41ac-a8b9-346f7a4d18d5 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.350176 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1b396-035f-4773-96d6-7c5ba1183cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.354083 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 787/1586] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:58:46 2022] POST /identity/v3/users => generated 282 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:46.354213 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1b396-035f-4773-96d6-7c5ba1183cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.354213 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1b396-035f-4773-96d6-7c5ba1183cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.354213 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1b396-035f-4773-96d6-7c5ba1183cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.354484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a0b74-8070-4266-b3db-aa1ea1fa3fac admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.354590 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1b396-035f-4773-96d6-7c5ba1183cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.354590 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1b396-035f-4773-96d6-7c5ba1183cf5 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.361828 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a0b74-8070-4266-b3db-aa1ea1fa3fac admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.367659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 800/1587] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:46.367659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1b396-035f-4773-96d6-7c5ba1183cf5 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.369521 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366b55d-465a-43bb-9054-389f13a12a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.370170 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366b55d-465a-43bb-9054-389f13a12a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.370455 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366b55d-465a-43bb-9054-389f13a12a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.370731 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366b55d-465a-43bb-9054-389f13a12a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.371543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366b55d-465a-43bb-9054-389f13a12a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.373146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366b55d-465a-43bb-9054-389f13a12a27 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.375065 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1b396-035f-4773-96d6-7c5ba1183cf5 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.380211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e2723-8ed6-41c0-b727-9a15285b3048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.380851 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e2723-8ed6-41c0-b727-9a15285b3048 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.381148 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e2723-8ed6-41c0-b727-9a15285b3048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.381427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e2723-8ed6-41c0-b727-9a15285b3048 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.382150 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e2723-8ed6-41c0-b727-9a15285b3048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.384019 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e2723-8ed6-41c0-b727-9a15285b3048 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.384157 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 788/1588] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:46.384682 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366b55d-465a-43bb-9054-389f13a12a27 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.394363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366b55d-465a-43bb-9054-389f13a12a27 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.399294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 801/1589] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:46.399294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43051e97-e144-48fe-b7fb-aad649a835b6 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.399294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43051e97-e144-48fe-b7fb-aad649a835b6 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.399294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43051e97-e144-48fe-b7fb-aad649a835b6 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.399932 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 802/1590] 10.222.0.18 () {54 vars in 961 bytes} [Wed Jun 22 16:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:58:46.400647 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43051e97-e144-48fe-b7fb-aad649a835b6 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.405885 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf0017-ba5f-4ac9-ad2e-025d6127ca7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.406576 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf0017-ba5f-4ac9-ad2e-025d6127ca7c admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.410138 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf0017-ba5f-4ac9-ad2e-025d6127ca7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.410138 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf0017-ba5f-4ac9-ad2e-025d6127ca7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.410138 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf0017-ba5f-4ac9-ad2e-025d6127ca7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.410444 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=85,keystone:INSERT=15 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:46.410547 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf0017-ba5f-4ac9-ad2e-025d6127ca7c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.414606 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43051e97-e144-48fe-b7fb-aad649a835b6 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.420319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a56a64-e29b-4c11-9374-9148a83955b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.420721 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 789/1591] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:46.421159 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a56a64-e29b-4c11-9374-9148a83955b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.421501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a56a64-e29b-4c11-9374-9148a83955b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.421604 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf0017-ba5f-4ac9-ad2e-025d6127ca7c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.421892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a56a64-e29b-4c11-9374-9148a83955b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.422676 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a56a64-e29b-4c11-9374-9148a83955b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.424513 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a56a64-e29b-4c11-9374-9148a83955b7 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.431150 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf0017-ba5f-4ac9-ad2e-025d6127ca7c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.437981 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 803/1592] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:46.437981 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a56a64-e29b-4c11-9374-9148a83955b7 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.438216 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d53cb1-d9d1-43ce-8d2a-8b17b2b8db91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.438216 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d53cb1-d9d1-43ce-8d2a-8b17b2b8db91 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.438216 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d53cb1-d9d1-43ce-8d2a-8b17b2b8db91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.438216 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d53cb1-d9d1-43ce-8d2a-8b17b2b8db91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.438588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d53cb1-d9d1-43ce-8d2a-8b17b2b8db91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.439717 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d53cb1-d9d1-43ce-8d2a-8b17b2b8db91 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.445886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a56a64-e29b-4c11-9374-9148a83955b7 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.452799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 790/1593] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:46.452939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205bb56-6571-43d6-a8bc-fd3d107e8a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.453151 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d53cb1-d9d1-43ce-8d2a-8b17b2b8db91 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.453249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205bb56-6571-43d6-a8bc-fd3d107e8a95 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.453249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205bb56-6571-43d6-a8bc-fd3d107e8a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.453249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205bb56-6571-43d6-a8bc-fd3d107e8a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.453249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205bb56-6571-43d6-a8bc-fd3d107e8a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.454659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205bb56-6571-43d6-a8bc-fd3d107e8a95 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.461581 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d53cb1-d9d1-43ce-8d2a-8b17b2b8db91 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.465929 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 804/1594] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:46.466453 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92f9d6-d929-4fef-b90c-179fd60958c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.466657 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205bb56-6571-43d6-a8bc-fd3d107e8a95 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.467102 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92f9d6-d929-4fef-b90c-179fd60958c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.467476 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92f9d6-d929-4fef-b90c-179fd60958c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.467764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92f9d6-d929-4fef-b90c-179fd60958c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.468540 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92f9d6-d929-4fef-b90c-179fd60958c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.470129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92f9d6-d929-4fef-b90c-179fd60958c4 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.476084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205bb56-6571-43d6-a8bc-fd3d107e8a95 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.481196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 791/1595] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:46.481411 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989f00e-6da5-43bc-aaca-0833e8c70e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.482036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92f9d6-d929-4fef-b90c-179fd60958c4 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.482907 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989f00e-6da5-43bc-aaca-0833e8c70e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.483206 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989f00e-6da5-43bc-aaca-0833e8c70e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.484007 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989f00e-6da5-43bc-aaca-0833e8c70e4e admin admin] PATH_INFO: `/v3/projects/06dbfffc486a457fbc97309f3e658c40/users/fa7932aa3e864bb481a5f5d3f26d0322/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.491365 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92f9d6-d929-4fef-b90c-179fd60958c4 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.495857 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb2791-e885-417d-ab0f-d561128e37d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.496529 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb2791-e885-417d-ab0f-d561128e37d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.496816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb2791-e885-417d-ab0f-d561128e37d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.497093 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb2791-e885-417d-ab0f-d561128e37d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.497805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb2791-e885-417d-ab0f-d561128e37d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.498665 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989f00e-6da5-43bc-aaca-0833e8c70e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=06dbfffc486a457fbc97309f3e658c40, user_id=fa7932aa3e864bb481a5f5d3f26d0322, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.499414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb2791-e885-417d-ab0f-d561128e37d5 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.501334 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989f00e-6da5-43bc-aaca-0833e8c70e4e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.509133 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 792/1596] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:46.510303 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f00fad-551c-43eb-9722-97d1892abed9 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.510589 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f00fad-551c-43eb-9722-97d1892abed9 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.510870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f00fad-551c-43eb-9722-97d1892abed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.528170 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-68f00fad-551c-43eb-9722-97d1892abed9 None None] MFA Rules not processed for user `78e7bdfffdc84465a570d135d1d86380`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:46.529361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-68f00fad-551c-43eb-9722-97d1892abed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:46.566090 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:46.592544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 805/1597] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:58:46 2022] PUT /identity/v3/projects/06dbfffc486a457fbc97309f3e658c40/users/fa7932aa3e864bb481a5f5d3f26d0322/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:46.593402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989f00e-6da5-43bc-aaca-0833e8c70e4e admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.600677 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 793/1598] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Jun 22 16:58:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:46.601502 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f00fad-551c-43eb-9722-97d1892abed9 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.611640 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f00fad-551c-43eb-9722-97d1892abed9 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.663855 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989f00e-6da5-43bc-aaca-0833e8c70e4e admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.668429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632a5dc-1700-4325-9343-0fdf5d5fc1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.669351 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cefedc-ed14-4c80-84b2-2164d2cfa6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.669480 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632a5dc-1700-4325-9343-0fdf5d5fc1dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.669645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632a5dc-1700-4325-9343-0fdf5d5fc1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.669941 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632a5dc-1700-4325-9343-0fdf5d5fc1dd admin admin] PATH_INFO: `/v3/projects/85dd6bf936e34faf84e53d142768a560/users/575996511c464f37a8ab2c4369b29699/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.670238 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cefedc-ed14-4c80-84b2-2164d2cfa6b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.670518 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cefedc-ed14-4c80-84b2-2164d2cfa6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.670793 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cefedc-ed14-4c80-84b2-2164d2cfa6b2 admin admin] PATH_INFO: `/v3/projects/99922f0daf4149d7b7de8c025b0a87a4/users/647a2374cc434c289563881347578a1f/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.683702 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632a5dc-1700-4325-9343-0fdf5d5fc1dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=85dd6bf936e34faf84e53d142768a560, user_id=575996511c464f37a8ab2c4369b29699, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.685999 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cefedc-ed14-4c80-84b2-2164d2cfa6b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99922f0daf4149d7b7de8c025b0a87a4, user_id=647a2374cc434c289563881347578a1f, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.686362 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632a5dc-1700-4325-9343-0fdf5d5fc1dd admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.687022 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: WARNING py.warnings [None req-e0cefedc-ed14-4c80-84b2-2164d2cfa6b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:58:46.687022 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: warnings.warn(msg) Jun 22 16:58:46.687022 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: Jun 22 16:58:46.688958 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cefedc-ed14-4c80-84b2-2164d2cfa6b2 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.767409 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 806/1599] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:58:46 2022] PUT /identity/v3/projects/85dd6bf936e34faf84e53d142768a560/users/575996511c464f37a8ab2c4369b29699/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:46.768281 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632a5dc-1700-4325-9343-0fdf5d5fc1dd admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.790866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 794/1600] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:58:46 2022] PUT /identity/v3/projects/99922f0daf4149d7b7de8c025b0a87a4/users/647a2374cc434c289563881347578a1f/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:46.802589 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cefedc-ed14-4c80-84b2-2164d2cfa6b2 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.829079 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632a5dc-1700-4325-9343-0fdf5d5fc1dd admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.860438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cefedc-ed14-4c80-84b2-2164d2cfa6b2 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.865207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f58b7d-4b6a-4c7e-a4f3-a8a719560d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.868446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f58b7d-4b6a-4c7e-a4f3-a8a719560d5b admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.868446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f58b7d-4b6a-4c7e-a4f3-a8a719560d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.868446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f58b7d-4b6a-4c7e-a4f3-a8a719560d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.868446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f58b7d-4b6a-4c7e-a4f3-a8a719560d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.868798 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f58b7d-4b6a-4c7e-a4f3-a8a719560d5b admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.873269 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:46.879070 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 795/1601] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:46.879705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f58b7d-4b6a-4c7e-a4f3-a8a719560d5b admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.885659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c64669-7eaf-4079-bb33-93d1816614dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.886484 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c64669-7eaf-4079-bb33-93d1816614dd admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.886773 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c64669-7eaf-4079-bb33-93d1816614dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.887279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c64669-7eaf-4079-bb33-93d1816614dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.888001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c64669-7eaf-4079-bb33-93d1816614dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.890243 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c64669-7eaf-4079-bb33-93d1816614dd admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.891744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f58b7d-4b6a-4c7e-a4f3-a8a719560d5b admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.896361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0fd5f-2084-4709-a4a0-557911549d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.897223 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0fd5f-2084-4709-a4a0-557911549d61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.897508 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0fd5f-2084-4709-a4a0-557911549d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.897782 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0fd5f-2084-4709-a4a0-557911549d61 admin admin] PATH_INFO: `/v3/projects/47bd5d8cddc94945b967b114d49f086c/users/276147f205ae43da9df678dcd572115a/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.904491 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 807/1602] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:46.904491 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c64669-7eaf-4079-bb33-93d1816614dd admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:46.912247 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c64669-7eaf-4079-bb33-93d1816614dd admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:46.917387 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5872a21-ca59-47ad-8fb9-6a8424939e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:46.917558 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0fd5f-2084-4709-a4a0-557911549d61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47bd5d8cddc94945b967b114d49f086c, user_id=276147f205ae43da9df678dcd572115a, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.918608 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5872a21-ca59-47ad-8fb9-6a8424939e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:46.918937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5872a21-ca59-47ad-8fb9-6a8424939e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:46.919223 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5872a21-ca59-47ad-8fb9-6a8424939e2f admin admin] PATH_INFO: `/v3/projects/3f421ea852dd45819e64fb070a612739/users/40f071637428488e81f2343719f7963a/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:46.920061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0fd5f-2084-4709-a4a0-557911549d61 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:46.935202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5872a21-ca59-47ad-8fb9-6a8424939e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f421ea852dd45819e64fb070a612739, user_id=40f071637428488e81f2343719f7963a, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:46.937946 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5872a21-ca59-47ad-8fb9-6a8424939e2f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:47.008915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 796/1603] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:58:46 2022] PUT /identity/v3/projects/47bd5d8cddc94945b967b114d49f086c/users/276147f205ae43da9df678dcd572115a/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:47.010205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f3fbc-19cc-4768-b548-1b1113dc57cf None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:47.010494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f3fbc-19cc-4768-b548-1b1113dc57cf None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:47.010768 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f3fbc-19cc-4768-b548-1b1113dc57cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:47.011127 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 808/1604] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:58:46 2022] PUT /identity/v3/projects/3f421ea852dd45819e64fb070a612739/users/40f071637428488e81f2343719f7963a/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:47.020947 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5872a21-ca59-47ad-8fb9-6a8424939e2f admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:47.042165 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-743f3fbc-19cc-4768-b548-1b1113dc57cf None None] MFA Rules not processed for user `fa7932aa3e864bb481a5f5d3f26d0322`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:47.043372 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-743f3fbc-19cc-4768-b548-1b1113dc57cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:47.060603 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:47.086269 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5872a21-ca59-47ad-8fb9-6a8424939e2f admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:47.106673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 797/1605] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:47 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:47.111412 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cf66d-a56d-45a7-bd6b-903a96c96fc5 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:47.111642 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cf66d-a56d-45a7-bd6b-903a96c96fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:47.111928 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cf66d-a56d-45a7-bd6b-903a96c96fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:47.130363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-445cf66d-a56d-45a7-bd6b-903a96c96fc5 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:47.131645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-445cf66d-a56d-45a7-bd6b-903a96c96fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:47.149441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372dd91-0d11-4504-962c-7e024ac642a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:47.150322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372dd91-0d11-4504-962c-7e024ac642a5 service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:47.153568 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372dd91-0d11-4504-962c-7e024ac642a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:47.153568 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372dd91-0d11-4504-962c-7e024ac642a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:47.189343 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 798/1606] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:47.190630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da4722-3766-4976-915f-90a1ffc8be27 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:47.190919 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da4722-3766-4976-915f-90a1ffc8be27 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:47.191199 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da4722-3766-4976-915f-90a1ffc8be27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:47.205795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:47.208074 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372dd91-0d11-4504-962c-7e024ac642a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:47.209700 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372dd91-0d11-4504-962c-7e024ac642a5 service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:47.217421 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-10da4722-3766-4976-915f-90a1ffc8be27 None None] MFA Rules not processed for user `647a2374cc434c289563881347578a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:47.221692 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 809/1607] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:47.221819 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-10da4722-3766-4976-915f-90a1ffc8be27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:47.222418 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372dd91-0d11-4504-962c-7e024ac642a5 service nova] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:47.229015 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372dd91-0d11-4504-962c-7e024ac642a5 service nova] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:47.233671 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f034db-95b6-4411-b3e9-2a1220c41386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:47.234539 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f034db-95b6-4411-b3e9-2a1220c41386 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:47.234828 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f034db-95b6-4411-b3e9-2a1220c41386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:47.235112 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f034db-95b6-4411-b3e9-2a1220c41386 admin admin] PATH_INFO: `/v3/projects/5c7efddffde545549e99aa0496ac0ff9/users/553480be08414756b718794eed20a765/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:47.250820 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f034db-95b6-4411-b3e9-2a1220c41386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7efddffde545549e99aa0496ac0ff9, user_id=553480be08414756b718794eed20a765, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:47.256287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f034db-95b6-4411-b3e9-2a1220c41386 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:47.284313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 799/1608] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:47.285118 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da4722-3766-4976-915f-90a1ffc8be27 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:47.295857 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da4722-3766-4976-915f-90a1ffc8be27 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:47.300464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a72e1-1343-4a7d-9068-ac59c0bc4779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:47.301324 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a72e1-1343-4a7d-9068-ac59c0bc4779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:47.302586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a72e1-1343-4a7d-9068-ac59c0bc4779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:47.302586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a72e1-1343-4a7d-9068-ac59c0bc4779 admin admin] PATH_INFO: `/v3/projects/1cb626ec1cb344d6bdae2fa7cf3740e4/users/3117f68f5bb641d98a1ea758629570e6/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:47.323879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a72e1-1343-4a7d-9068-ac59c0bc4779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb626ec1cb344d6bdae2fa7cf3740e4, user_id=3117f68f5bb641d98a1ea758629570e6, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:47.326663 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a72e1-1343-4a7d-9068-ac59c0bc4779 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:47.350820 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 810/1609] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:58:47 2022] PUT /identity/v3/projects/5c7efddffde545549e99aa0496ac0ff9/users/553480be08414756b718794eed20a765/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:47.352811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48c24c-b134-435e-8f20-55193061567d None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:47.353169 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48c24c-b134-435e-8f20-55193061567d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:47.353517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48c24c-b134-435e-8f20-55193061567d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:47.387294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-ea48c24c-b134-435e-8f20-55193061567d None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:47.387294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-ea48c24c-b134-435e-8f20-55193061567d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:47.438927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 811/1610] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:47.438927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9f825-a713-4c20-a549-8057478497b3 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:47.438927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9f825-a713-4c20-a549-8057478497b3 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:47.438927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9f825-a713-4c20-a549-8057478497b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:47.441902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 800/1611] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:58:47 2022] PUT /identity/v3/projects/1cb626ec1cb344d6bdae2fa7cf3740e4/users/3117f68f5bb641d98a1ea758629570e6/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:47.443784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a72e1-1343-4a7d-9068-ac59c0bc4779 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:47.464950 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-5da9f825-a713-4c20-a549-8057478497b3 None None] MFA Rules not processed for user `40f071637428488e81f2343719f7963a`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:47.473826 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-5da9f825-a713-4c20-a549-8057478497b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:47.483103 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:47.528461 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a72e1-1343-4a7d-9068-ac59c0bc4779 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:47.533081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce8b7f-b044-4ad9-bbcf-c0f9f514438d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:47.533743 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce8b7f-b044-4ad9-bbcf-c0f9f514438d admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:47.534010 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce8b7f-b044-4ad9-bbcf-c0f9f514438d admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:47.534290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce8b7f-b044-4ad9-bbcf-c0f9f514438d admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:47.534989 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce8b7f-b044-4ad9-bbcf-c0f9f514438d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:47.536920 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce8b7f-b044-4ad9-bbcf-c0f9f514438d admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:47.545943 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 812/1612] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:47.547161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9f825-a713-4c20-a549-8057478497b3 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:47.598850 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9f825-a713-4c20-a549-8057478497b3 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:47.602438 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5bb3f-107d-4f2e-aba7-3024d4ecb1ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:47.603071 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5bb3f-107d-4f2e-aba7-3024d4ecb1ec service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:47.603364 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5bb3f-107d-4f2e-aba7-3024d4ecb1ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:47.603645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5bb3f-107d-4f2e-aba7-3024d4ecb1ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:47.612438 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5bb3f-107d-4f2e-aba7-3024d4ecb1ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:47.613867 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5bb3f-107d-4f2e-aba7-3024d4ecb1ec service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:47.623167 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 813/1613] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:47.624544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1637e-b249-4f76-8032-12c18b73d575 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:47.624840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1637e-b249-4f76-8032-12c18b73d575 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:47.625116 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1637e-b249-4f76-8032-12c18b73d575 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:47.626525 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 814/1614] 10.222.0.18 () {54 vars in 961 bytes} [Wed Jun 22 16:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:58:47.627481 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f88697-7fa7-4f6b-9994-52e4b5fdd6b3 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:47.627838 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f88697-7fa7-4f6b-9994-52e4b5fdd6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:47.628147 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f88697-7fa7-4f6b-9994-52e4b5fdd6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:47.635160 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:47.646553 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 801/1615] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:58:47 2022] POST /identity/v3/projects => generated 365 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:47.646553 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce8b7f-b044-4ad9-bbcf-c0f9f514438d admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:47.658156 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-a1f88697-7fa7-4f6b-9994-52e4b5fdd6b3 None None] MFA Rules not processed for user `553480be08414756b718794eed20a765`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:47.659365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-a1f88697-7fa7-4f6b-9994-52e4b5fdd6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:47.702334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce8b7f-b044-4ad9-bbcf-c0f9f514438d admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:47.706062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e48e35-c77a-4167-a1b9-34e960a2b8d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:47.706712 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e48e35-c77a-4167-a1b9-34e960a2b8d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:47.706996 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e48e35-c77a-4167-a1b9-34e960a2b8d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:47.707430 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e48e35-c77a-4167-a1b9-34e960a2b8d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:47.725889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 815/1616] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:47 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:47.733175 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc231c-61e2-4171-aaaf-a5403c66bb44 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:47.733175 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc231c-61e2-4171-aaaf-a5403c66bb44 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:47.733175 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc231c-61e2-4171-aaaf-a5403c66bb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:47.754396 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-63fc231c-61e2-4171-aaaf-a5403c66bb44 None None] MFA Rules not processed for user `3117f68f5bb641d98a1ea758629570e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:47.755624 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-63fc231c-61e2-4171-aaaf-a5403c66bb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:47.770714 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e48e35-c77a-4167-a1b9-34e960a2b8d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:47.772257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e48e35-c77a-4167-a1b9-34e960a2b8d2 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:47.783839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 802/1617] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:47.785329 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec0cc6-38a2-4635-8da0-cd38dcc6e20f None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:47.785616 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec0cc6-38a2-4635-8da0-cd38dcc6e20f None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:47.785895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec0cc6-38a2-4635-8da0-cd38dcc6e20f None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:47.787332 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 803/1618] 10.222.0.18 () {54 vars in 912 bytes} [Wed Jun 22 16:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:58:47.787900 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec0cc6-38a2-4635-8da0-cd38dcc6e20f None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:47.801786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec0cc6-38a2-4635-8da0-cd38dcc6e20f None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:47.807638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b341074-69fe-4872-8d71-931c7faa303c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:47.808191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b341074-69fe-4872-8d71-931c7faa303c admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:47.808476 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b341074-69fe-4872-8d71-931c7faa303c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:47.808797 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b341074-69fe-4872-8d71-931c7faa303c admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:47.809494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b341074-69fe-4872-8d71-931c7faa303c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:47.811517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b341074-69fe-4872-8d71-931c7faa303c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:47.837723 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 816/1619] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:47.839005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70138912-fece-4022-8ba9-2b6a450c9dda None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:47.839298 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70138912-fece-4022-8ba9-2b6a450c9dda None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:47.839712 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70138912-fece-4022-8ba9-2b6a450c9dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:47.857727 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-70138912-fece-4022-8ba9-2b6a450c9dda None None] MFA Rules not processed for user `78e7bdfffdc84465a570d135d1d86380`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:47.858953 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-70138912-fece-4022-8ba9-2b6a450c9dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:47.933386 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 804/1620] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:58:47 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:47.934293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b341074-69fe-4872-8d71-931c7faa303c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:47.936545 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 817/1621] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Jun 22 16:58:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:47.937718 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70138912-fece-4022-8ba9-2b6a450c9dda None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:47.951373 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70138912-fece-4022-8ba9-2b6a450c9dda None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:47.964240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:47.986373 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:48.015915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b341074-69fe-4872-8d71-931c7faa303c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:48.023923 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b1fd4-e73a-4615-900b-3a6658812e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:48.023923 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b1fd4-e73a-4615-900b-3a6658812e5f admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:48.023923 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b1fd4-e73a-4615-900b-3a6658812e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:48.023923 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b1fd4-e73a-4615-900b-3a6658812e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:48.024393 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b1fd4-e73a-4615-900b-3a6658812e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:48.025775 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b1fd4-e73a-4615-900b-3a6658812e5f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:48.026237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23539b-815f-46b3-bd37-2fe72a8fcb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:48.028656 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23539b-815f-46b3-bd37-2fe72a8fcb47 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:48.028950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23539b-815f-46b3-bd37-2fe72a8fcb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:48.029264 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23539b-815f-46b3-bd37-2fe72a8fcb47 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:48.030132 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23539b-815f-46b3-bd37-2fe72a8fcb47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:48.032009 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23539b-815f-46b3-bd37-2fe72a8fcb47 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:48.097966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 805/1622] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:58:47 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:48.097966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04336992-d185-421b-9e25-01bd10233be8 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:48.097966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04336992-d185-421b-9e25-01bd10233be8 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:48.098353 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 818/1623] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:58:47 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:48.098438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04336992-d185-421b-9e25-01bd10233be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:48.099379 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b1fd4-e73a-4615-900b-3a6658812e5f admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:48.120900 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-04336992-d185-421b-9e25-01bd10233be8 None None] MFA Rules not processed for user `78e7bdfffdc84465a570d135d1d86380`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:48.120900 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-04336992-d185-421b-9e25-01bd10233be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:48.178670 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b1fd4-e73a-4615-900b-3a6658812e5f admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:48.183973 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a9e14-c6dc-438b-9cd6-5fa4416d6247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:48.185125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a9e14-c6dc-438b-9cd6-5fa4416d6247 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:48.185655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a9e14-c6dc-438b-9cd6-5fa4416d6247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:48.186084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a9e14-c6dc-438b-9cd6-5fa4416d6247 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:48.186945 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a9e14-c6dc-438b-9cd6-5fa4416d6247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:48.188922 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a9e14-c6dc-438b-9cd6-5fa4416d6247 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:48.196621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 806/1624] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 16:58:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:48.197409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04336992-d185-421b-9e25-01bd10233be8 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:48.208244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04336992-d185-421b-9e25-01bd10233be8 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:48.213743 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069c6b0-de04-42c1-ae6d-1fab13d2ad7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:48.215386 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069c6b0-de04-42c1-ae6d-1fab13d2ad7c admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:48.215386 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069c6b0-de04-42c1-ae6d-1fab13d2ad7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:48.215386 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069c6b0-de04-42c1-ae6d-1fab13d2ad7c admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:48.215774 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069c6b0-de04-42c1-ae6d-1fab13d2ad7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:48.217886 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069c6b0-de04-42c1-ae6d-1fab13d2ad7c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:48.287270 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 819/1625] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:58:48 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:48.288413 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a9e14-c6dc-438b-9cd6-5fa4416d6247 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:48.301540 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 807/1626] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:58:48 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:48.301540 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069c6b0-de04-42c1-ae6d-1fab13d2ad7c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:48.317057 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069c6b0-de04-42c1-ae6d-1fab13d2ad7c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:48.392323 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d8026-4e03-4092-9436-626c3b7bf06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:48.393003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d8026-4e03-4092-9436-626c3b7bf06c admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:48.393318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d8026-4e03-4092-9436-626c3b7bf06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:48.393596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d8026-4e03-4092-9436-626c3b7bf06c admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:48.393876 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a9e14-c6dc-438b-9cd6-5fa4416d6247 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:48.394359 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d8026-4e03-4092-9436-626c3b7bf06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:48.395998 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d8026-4e03-4092-9436-626c3b7bf06c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:48.400524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efb4d5-ecef-4571-bcac-aae87c9f380c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:48.401207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efb4d5-ecef-4571-bcac-aae87c9f380c service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:48.401792 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efb4d5-ecef-4571-bcac-aae87c9f380c service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:48.402082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efb4d5-ecef-4571-bcac-aae87c9f380c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:48.406903 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 808/1627] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:48.407691 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d8026-4e03-4092-9436-626c3b7bf06c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:48.423208 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d8026-4e03-4092-9436-626c3b7bf06c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:48.426634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:48.428435 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6397bb3-930e-4788-b4c4-7e7648fe6b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:48.429107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6397bb3-930e-4788-b4c4-7e7648fe6b32 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:48.429932 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6397bb3-930e-4788-b4c4-7e7648fe6b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:48.430215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6397bb3-930e-4788-b4c4-7e7648fe6b32 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:48.431004 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6397bb3-930e-4788-b4c4-7e7648fe6b32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:48.433005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6397bb3-930e-4788-b4c4-7e7648fe6b32 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:48.471511 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6efb4d5-ecef-4571-bcac-aae87c9f380c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:48.474510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6efb4d5-ecef-4571-bcac-aae87c9f380c service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:48.489112 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 820/1628] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:48.490085 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efb4d5-ecef-4571-bcac-aae87c9f380c service nova] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:48.537478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 809/1629] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:58:48 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:48.538960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6397bb3-930e-4788-b4c4-7e7648fe6b32 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:48.552597 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6397bb3-930e-4788-b4c4-7e7648fe6b32 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:48.569101 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe4647-064f-4ced-8803-853eefc0fdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:48.569101 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe4647-064f-4ced-8803-853eefc0fdbf admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:48.569318 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efb4d5-ecef-4571-bcac-aae87c9f380c service nova] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:48.569401 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe4647-064f-4ced-8803-853eefc0fdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:48.569401 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe4647-064f-4ced-8803-853eefc0fdbf admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:48.569401 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe4647-064f-4ced-8803-853eefc0fdbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:48.571343 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe4647-064f-4ced-8803-853eefc0fdbf admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:48.572891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584720a-9c42-4861-8673-fc5ec1214ac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:48.573557 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584720a-9c42-4861-8673-fc5ec1214ac4 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:48.573933 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584720a-9c42-4861-8673-fc5ec1214ac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:48.574472 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584720a-9c42-4861-8673-fc5ec1214ac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:48.588812 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584720a-9c42-4861-8673-fc5ec1214ac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:48.592355 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584720a-9c42-4861-8673-fc5ec1214ac4 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:48.606485 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 821/1630] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:48.607467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584720a-9c42-4861-8673-fc5ec1214ac4 service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:48.618437 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584720a-9c42-4861-8673-fc5ec1214ac4 service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:48.623289 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf6df1-299c-4cae-8cb7-516829394b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:48.624014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf6df1-299c-4cae-8cb7-516829394b2a admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:48.624447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf6df1-299c-4cae-8cb7-516829394b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:48.624796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf6df1-299c-4cae-8cb7-516829394b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:48.625596 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf6df1-299c-4cae-8cb7-516829394b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:48.627266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf6df1-299c-4cae-8cb7-516829394b2a admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:48.643163 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 822/1631] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:48.644187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf6df1-299c-4cae-8cb7-516829394b2a admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:48.659218 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf6df1-299c-4cae-8cb7-516829394b2a admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:48.675451 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 810/1632] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:58:48 2022] POST /identity/v3/users => generated 296 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:48.675652 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e421542-a564-4188-9e88-bc597dc9735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:48.675652 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e421542-a564-4188-9e88-bc597dc9735c admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:48.675925 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe4647-064f-4ced-8803-853eefc0fdbf admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:48.676086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e421542-a564-4188-9e88-bc597dc9735c admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:48.676086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e421542-a564-4188-9e88-bc597dc9735c admin admin] PATH_INFO: `/v3/projects/917e1cc7e3b74a6c9d910a0d1e06b0f9/users/75f0a7f105124e2ba414ab07c9f7a6e2/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:48.684443 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:48.704800 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e421542-a564-4188-9e88-bc597dc9735c admin admin] RBAC: Authorizing `identity:create_grant(project_id=917e1cc7e3b74a6c9d910a0d1e06b0f9, user_id=75f0a7f105124e2ba414ab07c9f7a6e2, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:48.712594 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e421542-a564-4188-9e88-bc597dc9735c admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:48.714524 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe4647-064f-4ced-8803-853eefc0fdbf admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:48.737391 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62930e42-4457-4dfc-a88a-670ba11618c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:48.738635 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62930e42-4457-4dfc-a88a-670ba11618c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:48.739755 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62930e42-4457-4dfc-a88a-670ba11618c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:48.746634 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62930e42-4457-4dfc-a88a-670ba11618c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:48.746634 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62930e42-4457-4dfc-a88a-670ba11618c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:48.747306 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62930e42-4457-4dfc-a88a-670ba11618c7 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:48.777659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 811/1633] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:48.777659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62930e42-4457-4dfc-a88a-670ba11618c7 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:48.821813 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62930e42-4457-4dfc-a88a-670ba11618c7 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:48.823766 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 823/1634] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:58:48 2022] PUT /identity/v3/projects/917e1cc7e3b74a6c9d910a0d1e06b0f9/users/75f0a7f105124e2ba414ab07c9f7a6e2/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:48.826787 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e421542-a564-4188-9e88-bc597dc9735c admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:48.939523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e421542-a564-4188-9e88-bc597dc9735c admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:48.948607 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40713a2-04a0-455c-b779-21f1484b6e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:48.948607 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40713a2-04a0-455c-b779-21f1484b6e8e admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:48.948966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40713a2-04a0-455c-b779-21f1484b6e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:48.950784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40713a2-04a0-455c-b779-21f1484b6e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:48.950784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40713a2-04a0-455c-b779-21f1484b6e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:48.953647 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40713a2-04a0-455c-b779-21f1484b6e8e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:48.963001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2cce0-03e6-47f9-8523-d02c11e397f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:48.964588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2cce0-03e6-47f9-8523-d02c11e397f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:48.965028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2cce0-03e6-47f9-8523-d02c11e397f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:48.965524 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2cce0-03e6-47f9-8523-d02c11e397f5 admin admin] PATH_INFO: `/v3/projects/b956e081c24c41199ec35469542aeeff/users/c8e7ba62ab5c4c438d0bdaa7e6f06345/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:48.974905 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 824/1635] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:48.976920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40713a2-04a0-455c-b779-21f1484b6e8e admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:48.993381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2cce0-03e6-47f9-8523-d02c11e397f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b956e081c24c41199ec35469542aeeff, user_id=c8e7ba62ab5c4c438d0bdaa7e6f06345, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:48.996844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2cce0-03e6-47f9-8523-d02c11e397f5 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:49.001317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40713a2-04a0-455c-b779-21f1484b6e8e admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:49.023838 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0cb74-4423-4c49-b41a-e5230c3f7204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:49.025057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0cb74-4423-4c49-b41a-e5230c3f7204 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:49.025350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0cb74-4423-4c49-b41a-e5230c3f7204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:49.025655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0cb74-4423-4c49-b41a-e5230c3f7204 admin admin] PATH_INFO: `/v3/projects/76ce9096e7314eb39044a0d8f0eef7bc/users/bb511ab2999645f2b22f4e343c44dc26/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:49.044596 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0cb74-4423-4c49-b41a-e5230c3f7204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ce9096e7314eb39044a0d8f0eef7bc, user_id=bb511ab2999645f2b22f4e343c44dc26, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:49.047243 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0cb74-4423-4c49-b41a-e5230c3f7204 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:49.083315 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 812/1636] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:58:48 2022] PUT /identity/v3/projects/b956e081c24c41199ec35469542aeeff/users/c8e7ba62ab5c4c438d0bdaa7e6f06345/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:49.084455 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2cce0-03e6-47f9-8523-d02c11e397f5 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:49.139665 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 825/1637] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:58:48 2022] PUT /identity/v3/projects/76ce9096e7314eb39044a0d8f0eef7bc/users/bb511ab2999645f2b22f4e343c44dc26/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:49.141054 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28e473-b971-4ffe-aa0d-4cd2432f7539 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:49.141421 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28e473-b971-4ffe-aa0d-4cd2432f7539 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:49.141831 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28e473-b971-4ffe-aa0d-4cd2432f7539 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:49.143394 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 826/1638] 10.222.0.18 () {54 vars in 912 bytes} [Wed Jun 22 16:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:58:49.148983 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28e473-b971-4ffe-aa0d-4cd2432f7539 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:49.153294 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2cce0-03e6-47f9-8523-d02c11e397f5 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:49.156372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:49.218877 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1063f-8fa6-4638-a663-bd5dd50548fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:49.219579 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1063f-8fa6-4638-a663-bd5dd50548fe admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:49.219867 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1063f-8fa6-4638-a663-bd5dd50548fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:49.220172 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1063f-8fa6-4638-a663-bd5dd50548fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:49.220913 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1063f-8fa6-4638-a663-bd5dd50548fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:49.222621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c1063f-8fa6-4638-a663-bd5dd50548fe admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:49.243923 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28e473-b971-4ffe-aa0d-4cd2432f7539 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:49.250524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded9a39-87c6-4692-8549-d5280b78b785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:49.252351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded9a39-87c6-4692-8549-d5280b78b785 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:49.252735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded9a39-87c6-4692-8549-d5280b78b785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:49.253101 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded9a39-87c6-4692-8549-d5280b78b785 admin admin] PATH_INFO: `/v3/projects/87786558138146b7b2b5a490a5273e45/users/10aa43ecf2d64dd68f88bb88b0541e3e/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:49.255603 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 813/1639] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:49.260457 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1063f-8fa6-4638-a663-bd5dd50548fe admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:49.274194 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded9a39-87c6-4692-8549-d5280b78b785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87786558138146b7b2b5a490a5273e45, user_id=10aa43ecf2d64dd68f88bb88b0541e3e, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:49.274404 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1063f-8fa6-4638-a663-bd5dd50548fe admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:49.277619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded9a39-87c6-4692-8549-d5280b78b785 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:49.279785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbfcd5-c93e-4812-8412-59b1dfbd8579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:49.280704 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbfcd5-c93e-4812-8412-59b1dfbd8579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:49.280989 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbfcd5-c93e-4812-8412-59b1dfbd8579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:49.281272 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbfcd5-c93e-4812-8412-59b1dfbd8579 admin admin] PATH_INFO: `/v3/users/1007c1456cea4882aa4e6bd90ca1d89c` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:49.282520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbfcd5-c93e-4812-8412-59b1dfbd8579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1007c1456cea4882aa4e6bd90ca1d89c)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:49.283533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: WARNING py.warnings [None req-98fbfcd5-c93e-4812-8412-59b1dfbd8579 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:58:49.283533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: warnings.warn(msg) Jun 22 16:58:49.283533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: Jun 22 16:58:49.284928 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbfcd5-c93e-4812-8412-59b1dfbd8579 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:49.299376 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:49.371829 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 827/1640] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:58:49 2022] PUT /identity/v3/projects/87786558138146b7b2b5a490a5273e45/users/10aa43ecf2d64dd68f88bb88b0541e3e/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:49.373004 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded9a39-87c6-4692-8549-d5280b78b785 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:49.453633 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded9a39-87c6-4692-8549-d5280b78b785 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:49.465440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b54ad-5a2e-40d4-a579-8827e3c15a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:49.465933 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b54ad-5a2e-40d4-a579-8827e3c15a49 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:49.466230 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b54ad-5a2e-40d4-a579-8827e3c15a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:49.466514 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b54ad-5a2e-40d4-a579-8827e3c15a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:49.467259 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b54ad-5a2e-40d4-a579-8827e3c15a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:49.468983 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b54ad-5a2e-40d4-a579-8827e3c15a49 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:49.480173 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 828/1641] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:49.481642 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b54ad-5a2e-40d4-a579-8827e3c15a49 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:49.491033 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b54ad-5a2e-40d4-a579-8827e3c15a49 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:49.495847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0ce69-7d34-415f-9281-5713d4f98607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:49.497530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0ce69-7d34-415f-9281-5713d4f98607 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:49.497849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0ce69-7d34-415f-9281-5713d4f98607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:49.498122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0ce69-7d34-415f-9281-5713d4f98607 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:49.498930 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0ce69-7d34-415f-9281-5713d4f98607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:49.508261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0ce69-7d34-415f-9281-5713d4f98607 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:49.521993 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 829/1642] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:49.524051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8398e97-595a-4418-819b-bee1c793e7cc None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:49.524366 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8398e97-595a-4418-819b-bee1c793e7cc None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:49.524654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8398e97-595a-4418-819b-bee1c793e7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:49.524756 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-98fbfcd5-c93e-4812-8412-59b1dfbd8579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1007c1456cea4882aa4e6bd90ca1d89c'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:49.525685 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-98fbfcd5-c93e-4812-8412-59b1dfbd8579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1007c1456cea4882aa4e6bd90ca1d89c'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:49.545027 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-d8398e97-595a-4418-819b-bee1c793e7cc None None] MFA Rules not processed for user `78e7bdfffdc84465a570d135d1d86380`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:49.546351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d8398e97-595a-4418-819b-bee1c793e7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:49.615105 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 830/1643] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 16:58:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:49.616154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8398e97-595a-4418-819b-bee1c793e7cc None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:49.617471 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d8398e97-595a-4418-819b-bee1c793e7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:49.628302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:49.633080 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8398e97-595a-4418-819b-bee1c793e7cc None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:49.638281 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1f40a-6eb7-4f7a-a16f-2a1efe90e585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:49.638558 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1f40a-6eb7-4f7a-a16f-2a1efe90e585 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:49.638780 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1f40a-6eb7-4f7a-a16f-2a1efe90e585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:49.639214 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1f40a-6eb7-4f7a-a16f-2a1efe90e585 admin admin] PATH_INFO: `/v3/projects/917e1cc7e3b74a6c9d910a0d1e06b0f9/users/75f0a7f105124e2ba414ab07c9f7a6e2/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:49.641477 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1f40a-6eb7-4f7a-a16f-2a1efe90e585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=917e1cc7e3b74a6c9d910a0d1e06b0f9, user_id=75f0a7f105124e2ba414ab07c9f7a6e2, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:49.644346 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1f40a-6eb7-4f7a-a16f-2a1efe90e585 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:49.644825 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-98fbfcd5-c93e-4812-8412-59b1dfbd8579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1007c1456cea4882aa4e6bd90ca1d89c'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:49.646153 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-98fbfcd5-c93e-4812-8412-59b1dfbd8579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1007c1456cea4882aa4e6bd90ca1d89c'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:49.656684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 831/1644] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:58:49 2022] PUT /identity/v3/projects/917e1cc7e3b74a6c9d910a0d1e06b0f9/users/75f0a7f105124e2ba414ab07c9f7a6e2/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:49.657707 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1f40a-6eb7-4f7a-a16f-2a1efe90e585 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:49.659741 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-92f1f40a-6eb7-4f7a-a16f-2a1efe90e585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:49.671513 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-98fbfcd5-c93e-4812-8412-59b1dfbd8579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1007c1456cea4882aa4e6bd90ca1d89c'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:49.690323 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 814/1645] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:58:49 2022] DELETE /identity/v3/users/1007c1456cea4882aa4e6bd90ca1d89c => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:49.691306 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbfcd5-c93e-4812-8412-59b1dfbd8579 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:49.692926 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-98fbfcd5-c93e-4812-8412-59b1dfbd8579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:49.744945 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1f40a-6eb7-4f7a-a16f-2a1efe90e585 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:49.805434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbfcd5-c93e-4812-8412-59b1dfbd8579 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:49.815757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9df641-2106-4c67-a304-a788a40028a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:49.816835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9df641-2106-4c67-a304-a788a40028a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:49.817127 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9df641-2106-4c67-a304-a788a40028a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:49.817439 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9df641-2106-4c67-a304-a788a40028a3 admin admin] PATH_INFO: `/v3/projects/b956e081c24c41199ec35469542aeeff/users/c8e7ba62ab5c4c438d0bdaa7e6f06345/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:49.821538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9df641-2106-4c67-a304-a788a40028a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b956e081c24c41199ec35469542aeeff, user_id=c8e7ba62ab5c4c438d0bdaa7e6f06345, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:49.825369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9df641-2106-4c67-a304-a788a40028a3 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:49.843850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 815/1646] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:58:49 2022] PUT /identity/v3/projects/b956e081c24c41199ec35469542aeeff/users/c8e7ba62ab5c4c438d0bdaa7e6f06345/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:49.845297 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9df641-2106-4c67-a304-a788a40028a3 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:49.861857 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-ea9df641-2106-4c67-a304-a788a40028a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:49.862862 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee60066-854b-4454-b799-22261001fdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:49.863719 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee60066-854b-4454-b799-22261001fdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:49.864027 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee60066-854b-4454-b799-22261001fdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:49.864333 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee60066-854b-4454-b799-22261001fdc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:49.865544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee60066-854b-4454-b799-22261001fdc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:49.867343 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee60066-854b-4454-b799-22261001fdc3 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:49.885225 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 832/1647] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:49.887288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee60066-854b-4454-b799-22261001fdc3 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:49.889646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3ee60066-854b-4454-b799-22261001fdc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:49.960035 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9df641-2106-4c67-a304-a788a40028a3 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:49.965794 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13832e0f-cd38-402e-ad2b-3e6ff2828acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:49.966698 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13832e0f-cd38-402e-ad2b-3e6ff2828acd admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:49.967123 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13832e0f-cd38-402e-ad2b-3e6ff2828acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:49.967644 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13832e0f-cd38-402e-ad2b-3e6ff2828acd admin admin] PATH_INFO: `/v3/projects/76ce9096e7314eb39044a0d8f0eef7bc/users/bb511ab2999645f2b22f4e343c44dc26/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:49.970772 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13832e0f-cd38-402e-ad2b-3e6ff2828acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ce9096e7314eb39044a0d8f0eef7bc, user_id=bb511ab2999645f2b22f4e343c44dc26, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:49.973930 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13832e0f-cd38-402e-ad2b-3e6ff2828acd admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:49.975812 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee60066-854b-4454-b799-22261001fdc3 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:49.997137 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 816/1648] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:58:49 2022] PUT /identity/v3/projects/76ce9096e7314eb39044a0d8f0eef7bc/users/bb511ab2999645f2b22f4e343c44dc26/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:49.999832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681a342-6b14-479f-bb31-c773e59865ad None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:49.999832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681a342-6b14-479f-bb31-c773e59865ad None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:49.999832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681a342-6b14-479f-bb31-c773e59865ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:50.045957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-f681a342-6b14-479f-bb31-c773e59865ad None None] MFA Rules not processed for user `75f0a7f105124e2ba414ab07c9f7a6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:50.047992 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-f681a342-6b14-479f-bb31-c773e59865ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:50.060202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:50.083686 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:50.088999 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2a181-03c8-4e68-93fe-091e2d77b2fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:50.089945 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2a181-03c8-4e68-93fe-091e2d77b2fc service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:50.090484 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2a181-03c8-4e68-93fe-091e2d77b2fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:50.090988 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2a181-03c8-4e68-93fe-091e2d77b2fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:50.166361 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2a181-03c8-4e68-93fe-091e2d77b2fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:50.168446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2a181-03c8-4e68-93fe-091e2d77b2fc service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:50.173175 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 817/1649] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:49 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:50.174539 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bc0b1-44d7-4523-a6db-42760e8365b0 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:50.174885 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bc0b1-44d7-4523-a6db-42760e8365b0 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:50.175174 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bc0b1-44d7-4523-a6db-42760e8365b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:50.191701 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 833/1650] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:50.192357 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c7c1c-aa35-4297-8c1e-f362229a2623 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:50.192749 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c7c1c-aa35-4297-8c1e-f362229a2623 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:50.193130 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c7c1c-aa35-4297-8c1e-f362229a2623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:50.199384 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-5e7bc0b1-44d7-4523-a6db-42760e8365b0 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:50.201210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-5e7bc0b1-44d7-4523-a6db-42760e8365b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:50.224734 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-6a5c7c1c-aa35-4297-8c1e-f362229a2623 None None] MFA Rules not processed for user `c8e7ba62ab5c4c438d0bdaa7e6f06345`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:50.226969 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-6a5c7c1c-aa35-4297-8c1e-f362229a2623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:50.309330 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 818/1651] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:50.309330 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bc0b1-44d7-4523-a6db-42760e8365b0 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:50.318887 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7bc0b1-44d7-4523-a6db-42760e8365b0 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:50.332489 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5be6ad-f8e4-43f3-80eb-731386cb013a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:50.332999 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5be6ad-f8e4-43f3-80eb-731386cb013a admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:50.333289 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5be6ad-f8e4-43f3-80eb-731386cb013a admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:50.333563 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5be6ad-f8e4-43f3-80eb-731386cb013a admin admin] PATH_INFO: `/v3/projects/87786558138146b7b2b5a490a5273e45/users/10aa43ecf2d64dd68f88bb88b0541e3e/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:50.337018 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 834/1652] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:50 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:50.338058 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5be6ad-f8e4-43f3-80eb-731386cb013a admin admin] RBAC: Authorizing `identity:create_grant(project_id=87786558138146b7b2b5a490a5273e45, user_id=10aa43ecf2d64dd68f88bb88b0541e3e, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:50.338765 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d683e-7762-428d-87e5-7e910c153c7f None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:50.339356 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d683e-7762-428d-87e5-7e910c153c7f None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:50.339647 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d683e-7762-428d-87e5-7e910c153c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:50.344333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5be6ad-f8e4-43f3-80eb-731386cb013a admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:50.359903 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 819/1653] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:58:50 2022] PUT /identity/v3/projects/87786558138146b7b2b5a490a5273e45/users/10aa43ecf2d64dd68f88bb88b0541e3e/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:50.361110 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5be6ad-f8e4-43f3-80eb-731386cb013a admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:50.363174 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6d5be6ad-f8e4-43f3-80eb-731386cb013a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:50.406064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-c23d683e-7762-428d-87e5-7e910c153c7f None None] MFA Rules not processed for user `bb511ab2999645f2b22f4e343c44dc26`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:50.407280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c23d683e-7762-428d-87e5-7e910c153c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:50.510987 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5be6ad-f8e4-43f3-80eb-731386cb013a admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:50.516333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b0378-a46c-48f0-892d-d9c02b8ad1cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:50.517003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b0378-a46c-48f0-892d-d9c02b8ad1cd service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:50.517290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b0378-a46c-48f0-892d-d9c02b8ad1cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:50.517569 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b0378-a46c-48f0-892d-d9c02b8ad1cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:50.571712 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:50.582040 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 835/1654] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:50.582040 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d683e-7762-428d-87e5-7e910c153c7f None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:50.582040 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c23d683e-7762-428d-87e5-7e910c153c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:50.641688 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:50.693630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b0378-a46c-48f0-892d-d9c02b8ad1cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:50.695649 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b0378-a46c-48f0-892d-d9c02b8ad1cd service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:50.702883 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d683e-7762-428d-87e5-7e910c153c7f None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:50.709504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67849ef4-fc84-4675-bc91-f0ea81326924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:50.710172 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67849ef4-fc84-4675-bc91-f0ea81326924 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:50.710479 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67849ef4-fc84-4675-bc91-f0ea81326924 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:50.710771 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67849ef4-fc84-4675-bc91-f0ea81326924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:50.717832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 820/1655] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:50 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:50.719251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6b7c9-af8d-43fb-9bc7-806e99f763bb None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:50.719677 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6b7c9-af8d-43fb-9bc7-806e99f763bb None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:50.720024 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6b7c9-af8d-43fb-9bc7-806e99f763bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:50.758372 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-27a6b7c9-af8d-43fb-9bc7-806e99f763bb None None] MFA Rules not processed for user `10aa43ecf2d64dd68f88bb88b0541e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:50.760050 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-27a6b7c9-af8d-43fb-9bc7-806e99f763bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:50.821927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67849ef4-fc84-4675-bc91-f0ea81326924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:50.823838 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67849ef4-fc84-4675-bc91-f0ea81326924 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:50.995463 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 836/1656] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:51.002122 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 821/1657] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:51.002938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67849ef4-fc84-4675-bc91-f0ea81326924 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:51.002938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67849ef4-fc84-4675-bc91-f0ea81326924 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:51.002938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3aaeb1-82e4-4fa9-a6f6-98bd4a972c10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:51.002938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aaeb1-82e4-4fa9-a6f6-98bd4a972c10 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:51.003598 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aaeb1-82e4-4fa9-a6f6-98bd4a972c10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:51.003598 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aaeb1-82e4-4fa9-a6f6-98bd4a972c10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:51.110813 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3aaeb1-82e4-4fa9-a6f6-98bd4a972c10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:51.112832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3aaeb1-82e4-4fa9-a6f6-98bd4a972c10 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:51.142274 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 837/1658] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:50 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:51.232354 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6b7c9-af8d-43fb-9bc7-806e99f763bb None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:51.250739 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6b7c9-af8d-43fb-9bc7-806e99f763bb None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:51.255682 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5159ae-5fa7-4f5f-ab1d-d4166c792ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:51.256657 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5159ae-5fa7-4f5f-ab1d-d4166c792ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:51.257094 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5159ae-5fa7-4f5f-ab1d-d4166c792ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:51.258156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5159ae-5fa7-4f5f-ab1d-d4166c792ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:51.269660 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5159ae-5fa7-4f5f-ab1d-d4166c792ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:51.271170 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5159ae-5fa7-4f5f-ab1d-d4166c792ca4 service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:51.719074 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 822/1659] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:51.722249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3aaeb1-82e4-4fa9-a6f6-98bd4a972c10 service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:51.722249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3aaeb1-82e4-4fa9-a6f6-98bd4a972c10 service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:51.722249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9a617-48ec-4b72-ad25-924e167b5e96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:51.722249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9a617-48ec-4b72-ad25-924e167b5e96 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:51.723976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9a617-48ec-4b72-ad25-924e167b5e96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:51.723976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9a617-48ec-4b72-ad25-924e167b5e96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:51.723976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9a617-48ec-4b72-ad25-924e167b5e96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:51.723976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9a617-48ec-4b72-ad25-924e167b5e96 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:51.723976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 838/1660] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:51.745537 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5159ae-5fa7-4f5f-ab1d-d4166c792ca4 service cinder] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:51.745537 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-bf5159ae-5fa7-4f5f-ab1d-d4166c792ca4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:51.763486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5159ae-5fa7-4f5f-ab1d-d4166c792ca4 service cinder] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:51.773653 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae5696-d3ac-45a2-aca2-43f98acce08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:51.774682 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae5696-d3ac-45a2-aca2-43f98acce08a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:51.774866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae5696-d3ac-45a2-aca2-43f98acce08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:51.775146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae5696-d3ac-45a2-aca2-43f98acce08a admin admin] PATH_INFO: `/v3/projects/f50acc4ac39b4ca79a57dd26b61b4b09` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:51.777063 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae5696-d3ac-45a2-aca2-43f98acce08a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f50acc4ac39b4ca79a57dd26b61b4b09)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:51.779729 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae5696-d3ac-45a2-aca2-43f98acce08a admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:51.982486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-31ae5696-d3ac-45a2-aca2-43f98acce08a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f50acc4ac39b4ca79a57dd26b61b4b09', 'request_id': 'req-31ae5696-d3ac-45a2-aca2-43f98acce08a'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:52.100489 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-31ae5696-d3ac-45a2-aca2-43f98acce08a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f50acc4ac39b4ca79a57dd26b61b4b09', 'request_id': 'req-31ae5696-d3ac-45a2-aca2-43f98acce08a'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:52.112677 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-31ae5696-d3ac-45a2-aca2-43f98acce08a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f50acc4ac39b4ca79a57dd26b61b4b09', 'request_id': 'req-31ae5696-d3ac-45a2-aca2-43f98acce08a'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:52.119314 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9a617-48ec-4b72-ad25-924e167b5e96 service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:52.129535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9a617-48ec-4b72-ad25-924e167b5e96 service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:52.155326 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-31ae5696-d3ac-45a2-aca2-43f98acce08a admin admin] The token cache is being invalidate because project f50acc4ac39b4ca79a57dd26b61b4b09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:58:52.155664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-31ae5696-d3ac-45a2-aca2-43f98acce08a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:52.156392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-31ae5696-d3ac-45a2-aca2-43f98acce08a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:52.161879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 823/1661] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:58:51 2022] DELETE /identity/v3/projects/f50acc4ac39b4ca79a57dd26b61b4b09 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:52.166274 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e93823-2d31-41ae-a474-8e09a7780c89 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:52.166409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e93823-2d31-41ae-a474-8e09a7780c89 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:52.166696 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e93823-2d31-41ae-a474-8e09a7780c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:52.182979 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:52.208845 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-76e93823-2d31-41ae-a474-8e09a7780c89 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:52.208845 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-76e93823-2d31-41ae-a474-8e09a7780c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:52.226812 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5b98e-5c99-4029-af56-a90430effc69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:52.227537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5b98e-5c99-4029-af56-a90430effc69 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:52.227810 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5b98e-5c99-4029-af56-a90430effc69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:52.228114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5b98e-5c99-4029-af56-a90430effc69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:52.230454 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-04a5b98e-5c99-4029-af56-a90430effc69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:52.277900 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:52.314097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 824/1662] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:58:52.315382 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e93823-2d31-41ae-a474-8e09a7780c89 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:52.318068 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-76e93823-2d31-41ae-a474-8e09a7780c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:52.347653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5b98e-5c99-4029-af56-a90430effc69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:52.349313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5b98e-5c99-4029-af56-a90430effc69 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:52.349758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e93823-2d31-41ae-a474-8e09a7780c89 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:52.362622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8c2f3-b5d8-4217-872d-740f0051d196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:52.363296 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8c2f3-b5d8-4217-872d-740f0051d196 service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:52.363582 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8c2f3-b5d8-4217-872d-740f0051d196 service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:52.363856 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8c2f3-b5d8-4217-872d-740f0051d196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:52.364370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 839/1663] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:52.365831 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-77f8c2f3-b5d8-4217-872d-740f0051d196 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:52.366029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab3726-80c2-45fa-961a-632ad15b4589 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:52.366436 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab3726-80c2-45fa-961a-632ad15b4589 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:52.367356 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab3726-80c2-45fa-961a-632ad15b4589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:52.389425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-e5ab3726-80c2-45fa-961a-632ad15b4589 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:52.390869 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e5ab3726-80c2-45fa-961a-632ad15b4589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:52.401110 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 840/1664] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:52.405686 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab3726-80c2-45fa-961a-632ad15b4589 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:52.423467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab3726-80c2-45fa-961a-632ad15b4589 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:52.429730 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a04d3d-55a0-4c6a-85d4-d31e85e2aee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:52.431642 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a04d3d-55a0-4c6a-85d4-d31e85e2aee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:52.432023 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a04d3d-55a0-4c6a-85d4-d31e85e2aee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:52.432453 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a04d3d-55a0-4c6a-85d4-d31e85e2aee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:52.433304 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a04d3d-55a0-4c6a-85d4-d31e85e2aee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:58:52.433711 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a04d3d-55a0-4c6a-85d4-d31e85e2aee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:52.436555 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a04d3d-55a0-4c6a-85d4-d31e85e2aee1 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:52.457501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 841/1665] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:58:52.458632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a04d3d-55a0-4c6a-85d4-d31e85e2aee1 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:52.479847 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8c2f3-b5d8-4217-872d-740f0051d196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:52.482259 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8c2f3-b5d8-4217-872d-740f0051d196 service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:52.487350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a04d3d-55a0-4c6a-85d4-d31e85e2aee1 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:52.495683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93dee6-7a86-4ccb-be0c-dbd9d41860a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:52.497349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93dee6-7a86-4ccb-be0c-dbd9d41860a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:52.498284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93dee6-7a86-4ccb-be0c-dbd9d41860a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:52.498284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93dee6-7a86-4ccb-be0c-dbd9d41860a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:52.499056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93dee6-7a86-4ccb-be0c-dbd9d41860a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:52.502571 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93dee6-7a86-4ccb-be0c-dbd9d41860a2 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:52.507942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 825/1666] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:52 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:52.625472 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 842/1667] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:58:52 2022] POST /identity/v3/projects => generated 401 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:52.629200 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8c2f3-b5d8-4217-872d-740f0051d196 service cinder] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:52.642935 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8c2f3-b5d8-4217-872d-740f0051d196 service cinder] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:52.754015 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef233bd-36db-4b59-acd6-0d4acc46d9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:52.755015 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef233bd-36db-4b59-acd6-0d4acc46d9a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:52.755372 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef233bd-36db-4b59-acd6-0d4acc46d9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:52.755728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef233bd-36db-4b59-acd6-0d4acc46d9a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:52.756931 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef233bd-36db-4b59-acd6-0d4acc46d9a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:52.759320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef233bd-36db-4b59-acd6-0d4acc46d9a4 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:52.900966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93dee6-7a86-4ccb-be0c-dbd9d41860a2 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:52.908229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 826/1668] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:58:52 2022] POST /identity/v3/users => generated 301 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:58:52.912410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93dee6-7a86-4ccb-be0c-dbd9d41860a2 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:52.918270 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb0d41-50b3-49e0-9087-c8de4b7036d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:52.918790 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb0d41-50b3-49e0-9087-c8de4b7036d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:52.919080 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb0d41-50b3-49e0-9087-c8de4b7036d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:52.919420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb0d41-50b3-49e0-9087-c8de4b7036d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:52.920095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb0d41-50b3-49e0-9087-c8de4b7036d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:52.921757 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb0d41-50b3-49e0-9087-c8de4b7036d9 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:52.936781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 843/1669] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:52.938793 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef233bd-36db-4b59-acd6-0d4acc46d9a4 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:52.967079 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef233bd-36db-4b59-acd6-0d4acc46d9a4 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:52.984749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d39166-e7ed-4b39-b326-90743edf573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:52.985494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d39166-e7ed-4b39-b326-90743edf573b admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:52.985712 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d39166-e7ed-4b39-b326-90743edf573b admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:52.990227 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d39166-e7ed-4b39-b326-90743edf573b admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:52.991062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d39166-e7ed-4b39-b326-90743edf573b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:52.995617 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d39166-e7ed-4b39-b326-90743edf573b admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:53.021398 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 827/1670] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 16:58:53.025579 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb0d41-50b3-49e0-9087-c8de4b7036d9 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:53.027826 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d39166-e7ed-4b39-b326-90743edf573b admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:53.027903 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-babb0d41-50b3-49e0-9087-c8de4b7036d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:53.046272 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d39166-e7ed-4b39-b326-90743edf573b admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:53.052145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5016d-7f8d-42d8-acf1-d74fb0ec8797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:53.052857 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5016d-7f8d-42d8-acf1-d74fb0ec8797 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:53.053277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5016d-7f8d-42d8-acf1-d74fb0ec8797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:53.053459 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5016d-7f8d-42d8-acf1-d74fb0ec8797 admin admin] PATH_INFO: `/v3/projects/51d5cae9464349419c71fed6e935f823/users/86a08a024c634cd2afc91b931103d68c/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:53.072154 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5016d-7f8d-42d8-acf1-d74fb0ec8797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d5cae9464349419c71fed6e935f823, user_id=86a08a024c634cd2afc91b931103d68c, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:53.074859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5016d-7f8d-42d8-acf1-d74fb0ec8797 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:53.102700 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb0d41-50b3-49e0-9087-c8de4b7036d9 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:53.107034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e729f0-cce0-40b9-9381-c6edcf57ec75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:53.107700 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e729f0-cce0-40b9-9381-c6edcf57ec75 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:53.107986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e729f0-cce0-40b9-9381-c6edcf57ec75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:53.108302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e729f0-cce0-40b9-9381-c6edcf57ec75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:53.110208 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-93e729f0-cce0-40b9-9381-c6edcf57ec75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:53.160332 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 828/1671] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:58:53 2022] PUT /identity/v3/projects/51d5cae9464349419c71fed6e935f823/users/86a08a024c634cd2afc91b931103d68c/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:53.173426 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:53.176999 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d1053-307e-4484-a7e7-903eec1c6ba9 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:53.177288 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d1053-307e-4484-a7e7-903eec1c6ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:53.177622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d1053-307e-4484-a7e7-903eec1c6ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:53.217457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e729f0-cce0-40b9-9381-c6edcf57ec75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:53.219606 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e729f0-cce0-40b9-9381-c6edcf57ec75 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:53.232942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-1e5d1053-307e-4484-a7e7-903eec1c6ba9 None None] MFA Rules not processed for user `86a08a024c634cd2afc91b931103d68c`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:53.234846 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-1e5d1053-307e-4484-a7e7-903eec1c6ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:53.248828 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 844/1672] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:53.279031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:53.344277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 829/1673] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:53.346327 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e729f0-cce0-40b9-9381-c6edcf57ec75 service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:53.358472 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e729f0-cce0-40b9-9381-c6edcf57ec75 service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:53.450135 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49e185-f175-4a87-929b-1e09c9a4f067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:53.450961 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49e185-f175-4a87-929b-1e09c9a4f067 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:53.451251 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49e185-f175-4a87-929b-1e09c9a4f067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:53.451696 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49e185-f175-4a87-929b-1e09c9a4f067 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:53.452654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49e185-f175-4a87-929b-1e09c9a4f067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:53.459709 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c49e185-f175-4a87-929b-1e09c9a4f067 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:53.629116 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 845/1674] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:58:53 2022] POST /identity/v3/projects => generated 401 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 16:58:53.633907 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d1053-307e-4484-a7e7-903eec1c6ba9 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:53.646028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d1053-307e-4484-a7e7-903eec1c6ba9 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:53.780965 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fad156-84f8-4643-b141-a28a85acde83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:53.781768 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fad156-84f8-4643-b141-a28a85acde83 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:53.783757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fad156-84f8-4643-b141-a28a85acde83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:53.783757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fad156-84f8-4643-b141-a28a85acde83 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:53.783757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fad156-84f8-4643-b141-a28a85acde83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:53.785685 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fad156-84f8-4643-b141-a28a85acde83 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:53.872678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 830/1675] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:58:53 2022] POST /identity/v3/users => generated 307 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 16:58:53.874639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49e185-f175-4a87-929b-1e09c9a4f067 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:53.893196 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49e185-f175-4a87-929b-1e09c9a4f067 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:53.914616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e4090-3582-415d-b170-50f82cb3583f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:53.915585 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e4090-3582-415d-b170-50f82cb3583f admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:53.915873 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e4090-3582-415d-b170-50f82cb3583f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:53.916172 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e4090-3582-415d-b170-50f82cb3583f admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:53.916936 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e4090-3582-415d-b170-50f82cb3583f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:53.918605 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e4090-3582-415d-b170-50f82cb3583f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:53.965773 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 846/1676] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:53.970189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fad156-84f8-4643-b141-a28a85acde83 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:53.984351 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fad156-84f8-4643-b141-a28a85acde83 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:53.995709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ede966-b55c-47a6-8d2b-a6da257f896b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:53.997169 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ede966-b55c-47a6-8d2b-a6da257f896b admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:53.997678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ede966-b55c-47a6-8d2b-a6da257f896b admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:53.998342 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ede966-b55c-47a6-8d2b-a6da257f896b admin admin] PATH_INFO: `/v3/projects/207ee2da0b784375be0b172dff172537/users/bf031267a1a14fcba3cbbbec1dd136a7/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:54.027113 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ede966-b55c-47a6-8d2b-a6da257f896b admin admin] RBAC: Authorizing `identity:create_grant(project_id=207ee2da0b784375be0b172dff172537, user_id=bf031267a1a14fcba3cbbbec1dd136a7, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:54.030802 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ede966-b55c-47a6-8d2b-a6da257f896b admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:54.125248 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 831/1677] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:58:53 2022] PUT /identity/v3/projects/207ee2da0b784375be0b172dff172537/users/bf031267a1a14fcba3cbbbec1dd136a7/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 16:58:54.129485 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e4090-3582-415d-b170-50f82cb3583f admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:54.144995 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e4090-3582-415d-b170-50f82cb3583f admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:54.329207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e58ef-f47f-4ada-ba90-327cd9ba3d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:54.332131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e58ef-f47f-4ada-ba90-327cd9ba3d5c admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:54.332131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e58ef-f47f-4ada-ba90-327cd9ba3d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:54.332131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e58ef-f47f-4ada-ba90-327cd9ba3d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:54.332131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e58ef-f47f-4ada-ba90-327cd9ba3d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:54.332907 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e58ef-f47f-4ada-ba90-327cd9ba3d5c admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:54.361346 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 847/1678] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:58:54.365190 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ede966-b55c-47a6-8d2b-a6da257f896b admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:54.384922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ede966-b55c-47a6-8d2b-a6da257f896b admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:54.403922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bdafc-c438-4162-b4cc-e14162d3df9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:54.405235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bdafc-c438-4162-b4cc-e14162d3df9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:54.405713 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bdafc-c438-4162-b4cc-e14162d3df9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:54.406226 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bdafc-c438-4162-b4cc-e14162d3df9b admin admin] PATH_INFO: `/v3/projects/207ee2da0b784375be0b172dff172537/users/bf031267a1a14fcba3cbbbec1dd136a7/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:54.410469 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bdafc-c438-4162-b4cc-e14162d3df9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=207ee2da0b784375be0b172dff172537, user_id=bf031267a1a14fcba3cbbbec1dd136a7, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:54.414100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bdafc-c438-4162-b4cc-e14162d3df9b admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:54.430829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 832/1679] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:58:54 2022] PUT /identity/v3/projects/207ee2da0b784375be0b172dff172537/users/bf031267a1a14fcba3cbbbec1dd136a7/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:54.440668 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7d231-1f7c-4e16-a62d-5e46c7a7e444 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:54.441204 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7d231-1f7c-4e16-a62d-5e46c7a7e444 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:54.441848 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7d231-1f7c-4e16-a62d-5e46c7a7e444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:54.535420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-24c7d231-1f7c-4e16-a62d-5e46c7a7e444 None None] MFA Rules not processed for user `bf031267a1a14fcba3cbbbec1dd136a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:54.537412 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-24c7d231-1f7c-4e16-a62d-5e46c7a7e444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:54.645759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:54.693073 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 848/1680] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:54 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:55.583917 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bdafc-c438-4162-b4cc-e14162d3df9b admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:55.729448 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bdafc-c438-4162-b4cc-e14162d3df9b admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:55.742056 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634e587-2b3e-4da3-851c-57d6682994eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:55.742992 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634e587-2b3e-4da3-851c-57d6682994eb service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:55.743500 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634e587-2b3e-4da3-851c-57d6682994eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:55.743973 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634e587-2b3e-4da3-851c-57d6682994eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:55.766871 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634e587-2b3e-4da3-851c-57d6682994eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:55.768817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634e587-2b3e-4da3-851c-57d6682994eb service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:55.793939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 833/1681] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:55 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:56.083568 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7d231-1f7c-4e16-a62d-5e46c7a7e444 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:56.083568 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-24c7d231-1f7c-4e16-a62d-5e46c7a7e444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:56.227212 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634e587-2b3e-4da3-851c-57d6682994eb service cinder] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:56.228714 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e634e587-2b3e-4da3-851c-57d6682994eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:56.258000 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:56.298756 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7d231-1f7c-4e16-a62d-5e46c7a7e444 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:56.310672 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d23020-c57d-43ad-876c-5ce75588ea7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:56.311806 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d23020-c57d-43ad-876c-5ce75588ea7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:56.312168 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d23020-c57d-43ad-876c-5ce75588ea7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:56.312455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d23020-c57d-43ad-876c-5ce75588ea7f admin admin] PATH_INFO: `/v3/users/647a2374cc434c289563881347578a1f` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:56.327417 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d23020-c57d-43ad-876c-5ce75588ea7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=647a2374cc434c289563881347578a1f)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:56.334694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d23020-c57d-43ad-876c-5ce75588ea7f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:56.692369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-26d23020-c57d-43ad-876c-5ce75588ea7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '647a2374cc434c289563881347578a1f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:56.703531 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634e587-2b3e-4da3-851c-57d6682994eb service cinder] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:56.715909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-26d23020-c57d-43ad-876c-5ce75588ea7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '647a2374cc434c289563881347578a1f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:56.717313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-26d23020-c57d-43ad-876c-5ce75588ea7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '647a2374cc434c289563881347578a1f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:56.720574 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d961c-1999-49c0-ac21-7f821b4606c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:56.722005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d961c-1999-49c0-ac21-7f821b4606c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:56.722443 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d961c-1999-49c0-ac21-7f821b4606c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:56.723008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d961c-1999-49c0-ac21-7f821b4606c1 admin admin] PATH_INFO: `/v3/users/fa7932aa3e864bb481a5f5d3f26d0322` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:56.724765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d961c-1999-49c0-ac21-7f821b4606c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa7932aa3e864bb481a5f5d3f26d0322)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:56.729932 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d961c-1999-49c0-ac21-7f821b4606c1 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:56.761516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-26d23020-c57d-43ad-876c-5ce75588ea7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '647a2374cc434c289563881347578a1f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:56.762179 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-26d23020-c57d-43ad-876c-5ce75588ea7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '647a2374cc434c289563881347578a1f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:56.864093 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 849/1682] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:58:56 2022] DELETE /identity/v3/users/647a2374cc434c289563881347578a1f => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:56.865408 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d23020-c57d-43ad-876c-5ce75588ea7f admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:56.869960 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-26d23020-c57d-43ad-876c-5ce75588ea7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:57.029263 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d23020-c57d-43ad-876c-5ce75588ea7f admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:57.034329 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feca8d5-f232-44e7-8e3d-d0b858053204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:57.035019 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feca8d5-f232-44e7-8e3d-d0b858053204 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:57.035414 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feca8d5-f232-44e7-8e3d-d0b858053204 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:57.035805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feca8d5-f232-44e7-8e3d-d0b858053204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:57.037830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-0feca8d5-f232-44e7-8e3d-d0b858053204 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:57.082218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3a9d961c-1999-49c0-ac21-7f821b4606c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa7932aa3e864bb481a5f5d3f26d0322'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:57.086505 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3a9d961c-1999-49c0-ac21-7f821b4606c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa7932aa3e864bb481a5f5d3f26d0322'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:57.095360 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:57.168254 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feca8d5-f232-44e7-8e3d-d0b858053204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:57.170659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feca8d5-f232-44e7-8e3d-d0b858053204 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:57.186546 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 850/1683] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:56 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:57.188285 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d3219-a1c7-4acb-b07b-6d8452f5c15e None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:57.188590 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d3219-a1c7-4acb-b07b-6d8452f5c15e None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:57.188880 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d3219-a1c7-4acb-b07b-6d8452f5c15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:57.205694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3a9d961c-1999-49c0-ac21-7f821b4606c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa7932aa3e864bb481a5f5d3f26d0322'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:57.206862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3a9d961c-1999-49c0-ac21-7f821b4606c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa7932aa3e864bb481a5f5d3f26d0322'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:57.220502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-578d3219-a1c7-4acb-b07b-6d8452f5c15e None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:57.221924 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-578d3219-a1c7-4acb-b07b-6d8452f5c15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:57.232322 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3a9d961c-1999-49c0-ac21-7f821b4606c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa7932aa3e864bb481a5f5d3f26d0322'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:57.266594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 834/1684] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:58:56 2022] DELETE /identity/v3/users/fa7932aa3e864bb481a5f5d3f26d0322 => generated 0 bytes in 1040 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:57.268785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00fe56-8f61-4fab-8f12-61b349ef88f2 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:57.269685 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00fe56-8f61-4fab-8f12-61b349ef88f2 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:57.270349 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00fe56-8f61-4fab-8f12-61b349ef88f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:57.361596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-6a00fe56-8f61-4fab-8f12-61b349ef88f2 None None] MFA Rules not processed for user `575996511c464f37a8ab2c4369b29699`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:57.361596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6a00fe56-8f61-4fab-8f12-61b349ef88f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:57.387018 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 851/1685] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:57.391101 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cbc25-172b-410e-84b3-70898b037fb5 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:57.391407 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cbc25-172b-410e-84b3-70898b037fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:57.391692 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cbc25-172b-410e-84b3-70898b037fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:57.434456 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-507cbc25-172b-410e-84b3-70898b037fb5 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:57.439405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-507cbc25-172b-410e-84b3-70898b037fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:57.501099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 835/1686] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:57.501099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00fe56-8f61-4fab-8f12-61b349ef88f2 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:57.501099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6a00fe56-8f61-4fab-8f12-61b349ef88f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:57.615378 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:57.681845 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00fe56-8f61-4fab-8f12-61b349ef88f2 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:57.692542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b59b61-eb51-4395-ba9e-ac7c65664dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:57.694134 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b59b61-eb51-4395-ba9e-ac7c65664dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:57.694874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 852/1687] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:57.695639 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b59b61-eb51-4395-ba9e-ac7c65664dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:57.696438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b59b61-eb51-4395-ba9e-ac7c65664dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:57.696612 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97485e76-168a-43e8-bdd9-3bd6a607fdf1 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:57.697003 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97485e76-168a-43e8-bdd9-3bd6a607fdf1 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:57.697520 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97485e76-168a-43e8-bdd9-3bd6a607fdf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:57.724724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-97485e76-168a-43e8-bdd9-3bd6a607fdf1 None None] MFA Rules not processed for user `575996511c464f37a8ab2c4369b29699`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:57.728183 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-97485e76-168a-43e8-bdd9-3bd6a607fdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:57.735507 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b59b61-eb51-4395-ba9e-ac7c65664dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:57.736940 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b59b61-eb51-4395-ba9e-ac7c65664dc3 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:57.777971 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 853/1688] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:57.779658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7a68e-c201-4ecb-b598-d88d05f43ee6 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:57.780229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7a68e-c201-4ecb-b598-d88d05f43ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:57.786257 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7a68e-c201-4ecb-b598-d88d05f43ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:57.804508 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 836/1689] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:57.805410 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b59b61-eb51-4395-ba9e-ac7c65664dc3 service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:57.809478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-20b59b61-eb51-4395-ba9e-ac7c65664dc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:57.831479 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-c5b7a68e-c201-4ecb-b598-d88d05f43ee6 None None] MFA Rules not processed for user `276147f205ae43da9df678dcd572115a`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:57.835682 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b59b61-eb51-4395-ba9e-ac7c65664dc3 service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:57.838384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c5b7a68e-c201-4ecb-b598-d88d05f43ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:57.844357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944fb08-f44c-465c-9431-d16534705ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:57.845437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944fb08-f44c-465c-9431-d16534705ccd service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:57.863070 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944fb08-f44c-465c-9431-d16534705ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:57.864658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944fb08-f44c-465c-9431-d16534705ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:57.896309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944fb08-f44c-465c-9431-d16534705ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:57.898186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944fb08-f44c-465c-9431-d16534705ccd service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:57.933470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 837/1690] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:57.934706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944fb08-f44c-465c-9431-d16534705ccd service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:57.940360 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6944fb08-f44c-465c-9431-d16534705ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:58.074947 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944fb08-f44c-465c-9431-d16534705ccd service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:58.084455 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe653d6e-00ea-48b8-b813-a7f09e21d81b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:58.085247 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe653d6e-00ea-48b8-b813-a7f09e21d81b service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:58.086257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe653d6e-00ea-48b8-b813-a7f09e21d81b service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:58.086634 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe653d6e-00ea-48b8-b813-a7f09e21d81b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:58.099663 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 854/1691] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:58.101804 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe653d6e-00ea-48b8-b813-a7f09e21d81b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:58.108322 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe653d6e-00ea-48b8-b813-a7f09e21d81b service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:58.118628 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017c4d8-acfc-4e12-af9f-a8e5c8cbce1d None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:58.118922 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017c4d8-acfc-4e12-af9f-a8e5c8cbce1d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:58.119094 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 838/1692] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:58.119211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017c4d8-acfc-4e12-af9f-a8e5c8cbce1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:58.157681 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-6017c4d8-acfc-4e12-af9f-a8e5c8cbce1d None None] MFA Rules not processed for user `276147f205ae43da9df678dcd572115a`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:58.159476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-6017c4d8-acfc-4e12-af9f-a8e5c8cbce1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:58.189332 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 855/1693] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:58:58.202509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe653d6e-00ea-48b8-b813-a7f09e21d81b service nova] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:58.206374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-fe653d6e-00ea-48b8-b813-a7f09e21d81b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:58.252527 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe653d6e-00ea-48b8-b813-a7f09e21d81b service nova] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:58.271455 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642429b2-14bc-4ec1-90cf-ce026e6dfb33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:58.277658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642429b2-14bc-4ec1-90cf-ce026e6dfb33 service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:58.278328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642429b2-14bc-4ec1-90cf-ce026e6dfb33 service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:58.279041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642429b2-14bc-4ec1-90cf-ce026e6dfb33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:58.291535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642429b2-14bc-4ec1-90cf-ce026e6dfb33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:58.293459 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642429b2-14bc-4ec1-90cf-ce026e6dfb33 service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:58.305724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 839/1694] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:59.006936 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017c4d8-acfc-4e12-af9f-a8e5c8cbce1d None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:59.008970 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-6017c4d8-acfc-4e12-af9f-a8e5c8cbce1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:59.040794 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017c4d8-acfc-4e12-af9f-a8e5c8cbce1d None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:59.046153 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030a44b-3ece-4569-8122-f6ca4a384c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:59.047765 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030a44b-3ece-4569-8122-f6ca4a384c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:59.048295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030a44b-3ece-4569-8122-f6ca4a384c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:59.048718 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030a44b-3ece-4569-8122-f6ca4a384c15 admin admin] PATH_INFO: `/v3/projects/99922f0daf4149d7b7de8c025b0a87a4` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:59.057999 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030a44b-3ece-4569-8122-f6ca4a384c15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99922f0daf4149d7b7de8c025b0a87a4)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:59.066770 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: WARNING py.warnings [None req-c030a44b-3ece-4569-8122-f6ca4a384c15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 22 16:58:59.066770 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: warnings.warn(msg) Jun 22 16:58:59.066770 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: Jun 22 16:58:59.066770 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030a44b-3ece-4569-8122-f6ca4a384c15 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:59.112064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c924b45-a3f0-4002-bc4f-daecd52fc043 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:59.112900 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c924b45-a3f0-4002-bc4f-daecd52fc043 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:59.113185 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c924b45-a3f0-4002-bc4f-daecd52fc043 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:59.114604 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 840/1695] 10.222.0.18 () {54 vars in 912 bytes} [Wed Jun 22 16:58:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:58:59.122302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96840289-ae69-4f03-9ba7-a019990fa364 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:59.122747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96840289-ae69-4f03-9ba7-a019990fa364 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:59.123179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96840289-ae69-4f03-9ba7-a019990fa364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:59.220153 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-96840289-ae69-4f03-9ba7-a019990fa364 None None] MFA Rules not processed for user `9090c22ba9f041e2a8d00750d853435a`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:59.221383 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-96840289-ae69-4f03-9ba7-a019990fa364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:59.229627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 841/1696] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 16:58:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:58:59.231142 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c52e99-20e5-455b-8bb8-c721df2f5b10 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:59.231597 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c52e99-20e5-455b-8bb8-c721df2f5b10 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:59.232045 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c52e99-20e5-455b-8bb8-c721df2f5b10 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:59.233521 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 842/1697] 10.222.0.18 () {54 vars in 912 bytes} [Wed Jun 22 16:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:58:59.240520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd4b68-5b10-4c83-b669-5a201a5cab84 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:59.241037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd4b68-5b10-4c83-b669-5a201a5cab84 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:59.241318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd4b68-5b10-4c83-b669-5a201a5cab84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:59.259730 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-b3bd4b68-5b10-4c83-b669-5a201a5cab84 None None] MFA Rules not processed for user `9090c22ba9f041e2a8d00750d853435a`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:59.260984 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b3bd4b68-5b10-4c83-b669-5a201a5cab84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:59.263814 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c030a44b-3ece-4569-8122-f6ca4a384c15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99922f0daf4149d7b7de8c025b0a87a4', 'request_id': 'req-c030a44b-3ece-4569-8122-f6ca4a384c15'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:59.314751 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 843/1698] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 16:58:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:59.315608 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd4b68-5b10-4c83-b669-5a201a5cab84 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:59.324479 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd4b68-5b10-4c83-b669-5a201a5cab84 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:59.328431 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e12a3-08c4-4a2e-9eae-bec55aa5bfcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:59.336201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e12a3-08c4-4a2e-9eae-bec55aa5bfcc service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:59.336201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e12a3-08c4-4a2e-9eae-bec55aa5bfcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:59.336201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e12a3-08c4-4a2e-9eae-bec55aa5bfcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:59.338196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e12a3-08c4-4a2e-9eae-bec55aa5bfcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:59.340206 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e12a3-08c4-4a2e-9eae-bec55aa5bfcc service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:59.348027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 844/1699] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:59.348835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e12a3-08c4-4a2e-9eae-bec55aa5bfcc service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:59.350718 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-c83e12a3-08c4-4a2e-9eae-bec55aa5bfcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:59.385753 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c030a44b-3ece-4569-8122-f6ca4a384c15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99922f0daf4149d7b7de8c025b0a87a4', 'request_id': 'req-c030a44b-3ece-4569-8122-f6ca4a384c15'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:59.429055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c030a44b-3ece-4569-8122-f6ca4a384c15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99922f0daf4149d7b7de8c025b0a87a4', 'request_id': 'req-c030a44b-3ece-4569-8122-f6ca4a384c15'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:59.438755 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e12a3-08c4-4a2e-9eae-bec55aa5bfcc service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:59.445909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef957be4-0236-4d2a-8ade-6a48c2cb6504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:59.446498 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef957be4-0236-4d2a-8ade-6a48c2cb6504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:59.450199 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef957be4-0236-4d2a-8ade-6a48c2cb6504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:59.450199 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef957be4-0236-4d2a-8ade-6a48c2cb6504 admin admin] PATH_INFO: `/v3/projects/06dbfffc486a457fbc97309f3e658c40` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:59.450199 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef957be4-0236-4d2a-8ade-6a48c2cb6504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06dbfffc486a457fbc97309f3e658c40)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:59.450199 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef957be4-0236-4d2a-8ade-6a48c2cb6504 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:59.457479 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c030a44b-3ece-4569-8122-f6ca4a384c15 admin admin] The token cache is being invalidate because project 99922f0daf4149d7b7de8c025b0a87a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:58:59.457777 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c030a44b-3ece-4569-8122-f6ca4a384c15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:59.462631 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c030a44b-3ece-4569-8122-f6ca4a384c15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:59.469341 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 856/1700] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:58:59 2022] DELETE /identity/v3/projects/99922f0daf4149d7b7de8c025b0a87a4 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:59.471198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030a44b-3ece-4569-8122-f6ca4a384c15 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:59.473256 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c030a44b-3ece-4569-8122-f6ca4a384c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:59.490499 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:58:59.511979 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030a44b-3ece-4569-8122-f6ca4a384c15 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:59.517827 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01abe0-be5c-4807-94cd-445097af074f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:59.518643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01abe0-be5c-4807-94cd-445097af074f service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:59.518938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01abe0-be5c-4807-94cd-445097af074f service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:59.519271 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01abe0-be5c-4807-94cd-445097af074f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:59.521438 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-cb01abe0-be5c-4807-94cd-445097af074f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:59.532590 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01abe0-be5c-4807-94cd-445097af074f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:59.534247 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01abe0-be5c-4807-94cd-445097af074f service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:59.542659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 857/1701] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:58:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:58:59.544406 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585a026-8c9e-40e0-91a8-5ed02d83ce90 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:59.544930 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585a026-8c9e-40e0-91a8-5ed02d83ce90 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:59.545350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585a026-8c9e-40e0-91a8-5ed02d83ce90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:59.589288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-2585a026-8c9e-40e0-91a8-5ed02d83ce90 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:59.591175 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2585a026-8c9e-40e0-91a8-5ed02d83ce90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:59.602753 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ef957be4-0236-4d2a-8ade-6a48c2cb6504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06dbfffc486a457fbc97309f3e658c40', 'request_id': 'req-ef957be4-0236-4d2a-8ade-6a48c2cb6504'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:59.704674 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ef957be4-0236-4d2a-8ade-6a48c2cb6504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06dbfffc486a457fbc97309f3e658c40', 'request_id': 'req-ef957be4-0236-4d2a-8ade-6a48c2cb6504'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:59.711651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ef957be4-0236-4d2a-8ade-6a48c2cb6504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06dbfffc486a457fbc97309f3e658c40', 'request_id': 'req-ef957be4-0236-4d2a-8ade-6a48c2cb6504'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:59.727309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 858/1702] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:59.737374 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e6dae-580a-4479-ab55-e66f52609e5c None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:59.737813 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e6dae-580a-4479-ab55-e66f52609e5c None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:59.738338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e6dae-580a-4479-ab55-e66f52609e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:59.743667 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ef957be4-0236-4d2a-8ade-6a48c2cb6504 admin admin] The token cache is being invalidate because project 06dbfffc486a457fbc97309f3e658c40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:58:59.743971 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ef957be4-0236-4d2a-8ade-6a48c2cb6504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:59.746730 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ef957be4-0236-4d2a-8ade-6a48c2cb6504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:58:59.754854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 845/1703] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:58:59 2022] DELETE /identity/v3/projects/06dbfffc486a457fbc97309f3e658c40 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:58:59.755840 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef957be4-0236-4d2a-8ade-6a48c2cb6504 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:59.759154 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-ef957be4-0236-4d2a-8ade-6a48c2cb6504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:59.772029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-654e6dae-580a-4479-ab55-e66f52609e5c None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:58:59.773421 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-654e6dae-580a-4479-ab55-e66f52609e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:58:59.791481 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 859/1704] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:58:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:58:59.792910 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e6dae-580a-4479-ab55-e66f52609e5c None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:59.806239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e6dae-580a-4479-ab55-e66f52609e5c None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:59.812062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef957be4-0236-4d2a-8ade-6a48c2cb6504 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:59.820632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fa0ec-d72f-4aa7-9eb6-2f265ec93f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:59.821430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fa0ec-d72f-4aa7-9eb6-2f265ec93f76 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:59.823817 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fa0ec-d72f-4aa7-9eb6-2f265ec93f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:59.823817 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fa0ec-d72f-4aa7-9eb6-2f265ec93f76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:59.823817 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fa0ec-d72f-4aa7-9eb6-2f265ec93f76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:58:59.823817 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fa0ec-d72f-4aa7-9eb6-2f265ec93f76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:59.824466 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b20c3-d254-4861-b891-021273b6fcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:59.825569 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b20c3-d254-4861-b891-021273b6fcca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:59.825970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b20c3-d254-4861-b891-021273b6fcca admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:59.826322 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b20c3-d254-4861-b891-021273b6fcca admin admin] PATH_INFO: `/v3/users/75f0a7f105124e2ba414ab07c9f7a6e2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:59.827653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fa0ec-d72f-4aa7-9eb6-2f265ec93f76 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:59.828036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b20c3-d254-4861-b891-021273b6fcca admin admin] RBAC: Authorizing `identity:delete_user(user_id=75f0a7f105124e2ba414ab07c9f7a6e2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:59.830581 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b20c3-d254-4861-b891-021273b6fcca admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:59.860160 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 860/1705] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:58:59.861687 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fa0ec-d72f-4aa7-9eb6-2f265ec93f76 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:58:59.880554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fa0ec-d72f-4aa7-9eb6-2f265ec93f76 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:58:59.894316 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbf4f9-eb17-4e87-8d5c-5812fc6e48ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:58:59.895663 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbf4f9-eb17-4e87-8d5c-5812fc6e48ae admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:58:59.896049 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbf4f9-eb17-4e87-8d5c-5812fc6e48ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:58:59.898001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbf4f9-eb17-4e87-8d5c-5812fc6e48ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:58:59.898992 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbf4f9-eb17-4e87-8d5c-5812fc6e48ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:58:59.901577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbf4f9-eb17-4e87-8d5c-5812fc6e48ae admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:58:59.907658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:00.074665 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 861/1706] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:58:59 2022] POST /identity/v3/projects => generated 403 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 16:59:00.078580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbf4f9-eb17-4e87-8d5c-5812fc6e48ae admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:00.102922 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:00.120813 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-a07b20c3-d254-4861-b891-021273b6fcca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75f0a7f105124e2ba414ab07c9f7a6e2'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:00.126498 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-a07b20c3-d254-4861-b891-021273b6fcca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75f0a7f105124e2ba414ab07c9f7a6e2'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:00.204442 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-a07b20c3-d254-4861-b891-021273b6fcca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75f0a7f105124e2ba414ab07c9f7a6e2'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:00.205952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-a07b20c3-d254-4861-b891-021273b6fcca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75f0a7f105124e2ba414ab07c9f7a6e2'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:00.244422 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbf4f9-eb17-4e87-8d5c-5812fc6e48ae admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:00.249042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-a07b20c3-d254-4861-b891-021273b6fcca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75f0a7f105124e2ba414ab07c9f7a6e2'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:00.251963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf2029-c04f-44e0-bf02-dbad6dc05f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:00.253754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf2029-c04f-44e0-bf02-dbad6dc05f48 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:00.254480 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf2029-c04f-44e0-bf02-dbad6dc05f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:00.254900 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf2029-c04f-44e0-bf02-dbad6dc05f48 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:00.255894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf2029-c04f-44e0-bf02-dbad6dc05f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:00.259199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf2029-c04f-44e0-bf02-dbad6dc05f48 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:00.267332 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 846/1707] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:58:59 2022] DELETE /identity/v3/users/75f0a7f105124e2ba414ab07c9f7a6e2 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:00.270163 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c478f-a720-4556-ac03-73be8f6a3bd6 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:00.270163 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c478f-a720-4556-ac03-73be8f6a3bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:00.270163 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c478f-a720-4556-ac03-73be8f6a3bd6 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:00.270860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 847/1708] 10.222.0.18 () {54 vars in 960 bytes} [Wed Jun 22 16:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:59:00.277214 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2088e-b5ab-4e8f-adf4-8da1d36088e9 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:00.277891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2088e-b5ab-4e8f-adf4-8da1d36088e9 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:00.278674 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2088e-b5ab-4e8f-adf4-8da1d36088e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:00.317403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-68a2088e-b5ab-4e8f-adf4-8da1d36088e9 None None] MFA Rules not processed for user `5a79a71fa89446c3abbb4fdbf2c93aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:00.318072 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-68a2088e-b5ab-4e8f-adf4-8da1d36088e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:00.415819 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 862/1709] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:00 2022] POST /identity/v3/users => generated 302 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:00.417187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf2029-c04f-44e0-bf02-dbad6dc05f48 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:00.423192 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3dbf2029-c04f-44e0-bf02-dbad6dc05f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:00.456367 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf2029-c04f-44e0-bf02-dbad6dc05f48 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:00.513244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 848/1710] 10.222.0.18 () {58 vars in 1057 bytes} [Wed Jun 22 16:59:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:59:00.529431 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2088e-b5ab-4e8f-adf4-8da1d36088e9 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:00.546344 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:00.575422 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2088e-b5ab-4e8f-adf4-8da1d36088e9 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:00.596880 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9effae-1b64-4c0d-9d99-6ac0e44f173f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79a71fa89446c3abbb4fdbf2c93aac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:00.597552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9effae-1b64-4c0d-9d99-6ac0e44f173f service placement] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:00.597836 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9effae-1b64-4c0d-9d99-6ac0e44f173f service placement] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:00.601926 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9effae-1b64-4c0d-9d99-6ac0e44f173f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:00.602050 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-1f9effae-1b64-4c0d-9d99-6ac0e44f173f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:00.615150 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9effae-1b64-4c0d-9d99-6ac0e44f173f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:00.615757 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb3327-7d2b-404e-bbdc-cd0e6c2a830e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:00.616543 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb3327-7d2b-404e-bbdc-cd0e6c2a830e admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:00.616935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb3327-7d2b-404e-bbdc-cd0e6c2a830e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:00.617286 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb3327-7d2b-404e-bbdc-cd0e6c2a830e admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:00.617649 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9effae-1b64-4c0d-9d99-6ac0e44f173f service placement] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:00.618224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb3327-7d2b-404e-bbdc-cd0e6c2a830e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:00.619951 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb3327-7d2b-404e-bbdc-cd0e6c2a830e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:00.635378 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 849/1711] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:00.642631 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 863/1712] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:00.645004 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb3327-7d2b-404e-bbdc-cd0e6c2a830e admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:00.648830 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315aaa7-466f-4848-a075-49b25c459c43 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:00.649128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315aaa7-466f-4848-a075-49b25c459c43 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:00.649410 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315aaa7-466f-4848-a075-49b25c459c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:00.651293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-0fdb3327-7d2b-404e-bbdc-cd0e6c2a830e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:00.688873 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb3327-7d2b-404e-bbdc-cd0e6c2a830e admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:00.695544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f22938-58c6-4bc1-89f4-c17c70e26618 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79a71fa89446c3abbb4fdbf2c93aac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:00.696492 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f22938-58c6-4bc1-89f4-c17c70e26618 service placement] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:00.696979 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f22938-58c6-4bc1-89f4-c17c70e26618 service placement] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:00.697455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f22938-58c6-4bc1-89f4-c17c70e26618 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:00.702801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-4315aaa7-466f-4848-a075-49b25c459c43 None None] MFA Rules not processed for user `276147f205ae43da9df678dcd572115a`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:00.704090 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-4315aaa7-466f-4848-a075-49b25c459c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:00.710199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f22938-58c6-4bc1-89f4-c17c70e26618 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:00.712708 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f22938-58c6-4bc1-89f4-c17c70e26618 service placement] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:00.724382 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 864/1713] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:00.725968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f22938-58c6-4bc1-89f4-c17c70e26618 service placement] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:00.738352 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f22938-58c6-4bc1-89f4-c17c70e26618 service placement] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:00.745839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a334a-8cd8-49ee-ab9e-00704ce7c0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:00.747884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a334a-8cd8-49ee-ab9e-00704ce7c0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:00.748409 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a334a-8cd8-49ee-ab9e-00704ce7c0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:00.751129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a334a-8cd8-49ee-ab9e-00704ce7c0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:00.751129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a334a-8cd8-49ee-ab9e-00704ce7c0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:00.752035 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a334a-8cd8-49ee-ab9e-00704ce7c0c2 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:00.764620 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 865/1714] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:00.765747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a334a-8cd8-49ee-ab9e-00704ce7c0c2 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:00.775096 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-7e9a334a-8cd8-49ee-ab9e-00704ce7c0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:00.810265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a334a-8cd8-49ee-ab9e-00704ce7c0c2 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:00.827360 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 850/1715] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:00.828584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315aaa7-466f-4848-a075-49b25c459c43 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:00.829119 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cb738-734d-43aa-942a-1208c2b36dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:00.830026 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cb738-734d-43aa-942a-1208c2b36dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:00.830317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cb738-734d-43aa-942a-1208c2b36dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:00.830604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7cb738-734d-43aa-942a-1208c2b36dab admin admin] PATH_INFO: `/v3/users/553480be08414756b718794eed20a765` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:00.836606 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7cb738-734d-43aa-942a-1208c2b36dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=553480be08414756b718794eed20a765)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:00.842450 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315aaa7-466f-4848-a075-49b25c459c43 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:00.842593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7cb738-734d-43aa-942a-1208c2b36dab admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:00.849289 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85fc954-32c2-4883-a6fd-195ccf86f882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:00.850639 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fc954-32c2-4883-a6fd-195ccf86f882 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:00.851179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fc954-32c2-4883-a6fd-195ccf86f882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:00.851661 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85fc954-32c2-4883-a6fd-195ccf86f882 admin admin] PATH_INFO: `/v3/projects/8520a20d5d6b462baf8f86f2ebc483ee/users/9b0170f956734e9d9b688b5491c95ec7/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:00.907057 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85fc954-32c2-4883-a6fd-195ccf86f882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8520a20d5d6b462baf8f86f2ebc483ee, user_id=9b0170f956734e9d9b688b5491c95ec7, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:00.909938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85fc954-32c2-4883-a6fd-195ccf86f882 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:01.003671 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 851/1716] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:00 2022] PUT /identity/v3/projects/8520a20d5d6b462baf8f86f2ebc483ee/users/9b0170f956734e9d9b688b5491c95ec7/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:01.015960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17e622-7ba1-4dcc-9bef-f41bf4ca4139 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:01.016378 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17e622-7ba1-4dcc-9bef-f41bf4ca4139 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:01.016727 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17e622-7ba1-4dcc-9bef-f41bf4ca4139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:01.062542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-2d17e622-7ba1-4dcc-9bef-f41bf4ca4139 None None] MFA Rules not processed for user `9b0170f956734e9d9b688b5491c95ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:01.068467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-2d17e622-7ba1-4dcc-9bef-f41bf4ca4139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:01.160686 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fd7cb738-734d-43aa-942a-1208c2b36dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '553480be08414756b718794eed20a765'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:01.181510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fd7cb738-734d-43aa-942a-1208c2b36dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '553480be08414756b718794eed20a765'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:01.183734 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fd7cb738-734d-43aa-942a-1208c2b36dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '553480be08414756b718794eed20a765'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:01.230779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fd7cb738-734d-43aa-942a-1208c2b36dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '553480be08414756b718794eed20a765'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:01.231822 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fd7cb738-734d-43aa-942a-1208c2b36dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '553480be08414756b718794eed20a765'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:01.256446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 852/1717] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:59:01.258504 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17e622-7ba1-4dcc-9bef-f41bf4ca4139 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:01.261805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-2d17e622-7ba1-4dcc-9bef-f41bf4ca4139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:01.277193 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:01.362485 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 866/1718] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:00 2022] DELETE /identity/v3/users/553480be08414756b718794eed20a765 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:01.363562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cb738-734d-43aa-942a-1208c2b36dab admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:01.367233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-fd7cb738-734d-43aa-942a-1208c2b36dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:01.391644 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17e622-7ba1-4dcc-9bef-f41bf4ca4139 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:01.478672 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7cb738-734d-43aa-942a-1208c2b36dab admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:01.484205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375a26f-06ef-4ef2-854e-4760ed78d88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:01.484795 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375a26f-06ef-4ef2-854e-4760ed78d88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:01.485151 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375a26f-06ef-4ef2-854e-4760ed78d88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:01.485525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375a26f-06ef-4ef2-854e-4760ed78d88d admin admin] PATH_INFO: `/v3/projects/917e1cc7e3b74a6c9d910a0d1e06b0f9` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:01.486878 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375a26f-06ef-4ef2-854e-4760ed78d88d admin admin] RBAC: Authorizing `identity:delete_project(project_id=917e1cc7e3b74a6c9d910a0d1e06b0f9)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:01.489057 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375a26f-06ef-4ef2-854e-4760ed78d88d admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:01.493007 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0b339-6c76-46da-93c5-293398b1b286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:01.493730 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0b339-6c76-46da-93c5-293398b1b286 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:01.494020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0b339-6c76-46da-93c5-293398b1b286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:01.494299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0b339-6c76-46da-93c5-293398b1b286 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:01.495069 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0b339-6c76-46da-93c5-293398b1b286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:01.497078 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0b339-6c76-46da-93c5-293398b1b286 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:01.498276 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:01.688747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 867/1719] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:01 2022] POST /identity/v3/projects => generated 405 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:01.690553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaeb5a-8ea5-4d2c-9c6d-8d45cd331740 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:01.691042 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaeb5a-8ea5-4d2c-9c6d-8d45cd331740 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:01.691334 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaaeb5a-8ea5-4d2c-9c6d-8d45cd331740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:01.710787 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e375a26f-06ef-4ef2-854e-4760ed78d88d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '917e1cc7e3b74a6c9d910a0d1e06b0f9', 'request_id': 'req-e375a26f-06ef-4ef2-854e-4760ed78d88d'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:01.724867 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-0aaaeb5a-8ea5-4d2c-9c6d-8d45cd331740 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:01.726858 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-0aaaeb5a-8ea5-4d2c-9c6d-8d45cd331740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:01.820404 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e375a26f-06ef-4ef2-854e-4760ed78d88d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '917e1cc7e3b74a6c9d910a0d1e06b0f9', 'request_id': 'req-e375a26f-06ef-4ef2-854e-4760ed78d88d'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:01.827916 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e375a26f-06ef-4ef2-854e-4760ed78d88d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '917e1cc7e3b74a6c9d910a0d1e06b0f9', 'request_id': 'req-e375a26f-06ef-4ef2-854e-4760ed78d88d'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:01.850722 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e375a26f-06ef-4ef2-854e-4760ed78d88d admin admin] The token cache is being invalidate because project 917e1cc7e3b74a6c9d910a0d1e06b0f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:01.851608 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e375a26f-06ef-4ef2-854e-4760ed78d88d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:01.857310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e375a26f-06ef-4ef2-854e-4760ed78d88d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:01.859683 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 853/1720] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:01 2022] DELETE /identity/v3/projects/917e1cc7e3b74a6c9d910a0d1e06b0f9 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:01.860505 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375a26f-06ef-4ef2-854e-4760ed78d88d admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:01.863115 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e375a26f-06ef-4ef2-854e-4760ed78d88d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:01.942064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 868/1721] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:01.942064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dccb3-adc3-4223-8a84-07f478884fe5 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:01.942064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dccb3-adc3-4223-8a84-07f478884fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:01.942425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038dccb3-adc3-4223-8a84-07f478884fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:01.987917 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-038dccb3-adc3-4223-8a84-07f478884fe5 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:01.990432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-038dccb3-adc3-4223-8a84-07f478884fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:02.034811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 869/1722] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:02.039471 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038dccb3-adc3-4223-8a84-07f478884fe5 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:02.039471 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-038dccb3-adc3-4223-8a84-07f478884fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:02.116790 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375a26f-06ef-4ef2-854e-4760ed78d88d admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:02.122397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63a993-399f-43c5-9b2f-ed47b4617ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:02.123210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63a993-399f-43c5-9b2f-ed47b4617ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:02.124211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63a993-399f-43c5-9b2f-ed47b4617ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:02.124499 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63a993-399f-43c5-9b2f-ed47b4617ab7 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:02.125279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63a993-399f-43c5-9b2f-ed47b4617ab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:02.127318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63a993-399f-43c5-9b2f-ed47b4617ab7 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:02.187901 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038dccb3-adc3-4223-8a84-07f478884fe5 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:02.196726 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1096dc4-b47c-48e1-b8ad-765b24c0bd70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:02.199187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1096dc4-b47c-48e1-b8ad-765b24c0bd70 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:02.199187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1096dc4-b47c-48e1-b8ad-765b24c0bd70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:02.199187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1096dc4-b47c-48e1-b8ad-765b24c0bd70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:02.213501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1096dc4-b47c-48e1-b8ad-765b24c0bd70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:02.215043 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1096dc4-b47c-48e1-b8ad-765b24c0bd70 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:02.227484 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 870/1723] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:02.229378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de304f09-b8c1-4c86-bf41-071479d86b04 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:02.241315 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de304f09-b8c1-4c86-bf41-071479d86b04 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:02.241315 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de304f09-b8c1-4c86-bf41-071479d86b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:02.262236 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-de304f09-b8c1-4c86-bf41-071479d86b04 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:02.270053 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-de304f09-b8c1-4c86-bf41-071479d86b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:02.291861 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:02.299032 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 854/1724] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:01 2022] POST /identity/v3/users => generated 309 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:02.303225 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63a993-399f-43c5-9b2f-ed47b4617ab7 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:02.309237 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 871/1725] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:02.313670 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de304f09-b8c1-4c86-bf41-071479d86b04 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:02.329200 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de304f09-b8c1-4c86-bf41-071479d86b04 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:02.335013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63a993-399f-43c5-9b2f-ed47b4617ab7 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:02.337201 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4323d5f-d654-47c3-a32b-d35493ff775b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:02.341742 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4323d5f-d654-47c3-a32b-d35493ff775b admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:02.342238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4323d5f-d654-47c3-a32b-d35493ff775b admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:02.343234 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4323d5f-d654-47c3-a32b-d35493ff775b admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:02.344406 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4323d5f-d654-47c3-a32b-d35493ff775b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:59:02.344970 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4323d5f-d654-47c3-a32b-d35493ff775b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:02.347102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4323d5f-d654-47c3-a32b-d35493ff775b admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:02.350424 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9a237-62cd-450a-bb78-c486e4c09867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:02.351379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9a237-62cd-450a-bb78-c486e4c09867 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:02.351841 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9a237-62cd-450a-bb78-c486e4c09867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:02.352337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9a237-62cd-450a-bb78-c486e4c09867 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:02.353286 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9a237-62cd-450a-bb78-c486e4c09867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:02.357735 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9a237-62cd-450a-bb78-c486e4c09867 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:02.363530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 872/1726] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:59:02.376875 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4323d5f-d654-47c3-a32b-d35493ff775b admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:02.390453 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 855/1727] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 16:59:02.394568 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4323d5f-d654-47c3-a32b-d35493ff775b admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:02.397416 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9a237-62cd-450a-bb78-c486e4c09867 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:02.407835 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145a9db-84b5-4abb-b9dd-60ed1c3fc107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:02.408744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145a9db-84b5-4abb-b9dd-60ed1c3fc107 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:02.409046 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145a9db-84b5-4abb-b9dd-60ed1c3fc107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:02.410488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145a9db-84b5-4abb-b9dd-60ed1c3fc107 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:02.412703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145a9db-84b5-4abb-b9dd-60ed1c3fc107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:02.430231 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145a9db-84b5-4abb-b9dd-60ed1c3fc107 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:02.436975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9a237-62cd-450a-bb78-c486e4c09867 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:02.457268 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0360114-c0bd-44e9-b58a-427403e7169c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:02.463356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0360114-c0bd-44e9-b58a-427403e7169c admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:02.463653 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0360114-c0bd-44e9-b58a-427403e7169c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:02.463942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0360114-c0bd-44e9-b58a-427403e7169c admin admin] PATH_INFO: `/v3/projects/4538a5d4460243b5b50308f875aefa2d/users/d69caf253f4244b1bf68cc1680e4a155/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:02.526301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0360114-c0bd-44e9-b58a-427403e7169c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4538a5d4460243b5b50308f875aefa2d, user_id=d69caf253f4244b1bf68cc1680e4a155, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:02.531751 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0360114-c0bd-44e9-b58a-427403e7169c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:02.585402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 873/1728] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:02 2022] POST /identity/v3/projects => generated 365 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:02.593204 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145a9db-84b5-4abb-b9dd-60ed1c3fc107 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:02.675970 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:02.683318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 856/1729] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:02 2022] PUT /identity/v3/projects/4538a5d4460243b5b50308f875aefa2d/users/d69caf253f4244b1bf68cc1680e4a155/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 16:59:02.698322 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0360114-c0bd-44e9-b58a-427403e7169c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:02.844558 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145a9db-84b5-4abb-b9dd-60ed1c3fc107 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:02.875875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0360114-c0bd-44e9-b58a-427403e7169c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:02.894859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d87d8-9500-4807-a232-fb938b191337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:02.895666 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d87d8-9500-4807-a232-fb938b191337 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:02.896124 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d87d8-9500-4807-a232-fb938b191337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:02.896622 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d87d8-9500-4807-a232-fb938b191337 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:02.898232 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d87d8-9500-4807-a232-fb938b191337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:02.900249 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d87d8-9500-4807-a232-fb938b191337 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:02.926194 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 857/1730] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 16:59:02.931060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d87d8-9500-4807-a232-fb938b191337 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:02.955842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d87d8-9500-4807-a232-fb938b191337 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:02.969859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90c90b-8c8f-445a-bc7f-d53d81356044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:02.972381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90c90b-8c8f-445a-bc7f-d53d81356044 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:02.972381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90c90b-8c8f-445a-bc7f-d53d81356044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:02.972381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90c90b-8c8f-445a-bc7f-d53d81356044 admin admin] PATH_INFO: `/v3/projects/4538a5d4460243b5b50308f875aefa2d/users/d69caf253f4244b1bf68cc1680e4a155/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:02.975245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90c90b-8c8f-445a-bc7f-d53d81356044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4538a5d4460243b5b50308f875aefa2d, user_id=d69caf253f4244b1bf68cc1680e4a155, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:02.985276 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90c90b-8c8f-445a-bc7f-d53d81356044 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:02.996739 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccfc75-c332-4090-873a-fe2cf3610814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:03.000940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccfc75-c332-4090-873a-fe2cf3610814 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:03.000940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccfc75-c332-4090-873a-fe2cf3610814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:03.000940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccfc75-c332-4090-873a-fe2cf3610814 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:03.002012 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeccfc75-c332-4090-873a-fe2cf3610814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:03.011135 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeccfc75-c332-4090-873a-fe2cf3610814 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:03.018457 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 858/1731] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:02 2022] PUT /identity/v3/projects/4538a5d4460243b5b50308f875aefa2d/users/d69caf253f4244b1bf68cc1680e4a155/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:03.038396 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35c27d-2058-4ee8-8f23-df30c124abc4 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:03.038396 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35c27d-2058-4ee8-8f23-df30c124abc4 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:03.038396 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35c27d-2058-4ee8-8f23-df30c124abc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:03.096209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-1e35c27d-2058-4ee8-8f23-df30c124abc4 None None] MFA Rules not processed for user `d69caf253f4244b1bf68cc1680e4a155`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:03.096993 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-1e35c27d-2058-4ee8-8f23-df30c124abc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:03.166036 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 874/1732] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:02 2022] POST /identity/v3/users => generated 283 bytes in 573 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:03.167009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccfc75-c332-4090-873a-fe2cf3610814 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:03.173256 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-eeccfc75-c332-4090-873a-fe2cf3610814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:03.215510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccfc75-c332-4090-873a-fe2cf3610814 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:03.272550 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 859/1733] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:03 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:03.274212 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35c27d-2058-4ee8-8f23-df30c124abc4 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:03.311263 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a1277-b014-4bc4-9e60-9d2bd65982fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:03.317547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a1277-b014-4bc4-9e60-9d2bd65982fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:03.317547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a1277-b014-4bc4-9e60-9d2bd65982fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:03.317547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a1277-b014-4bc4-9e60-9d2bd65982fc admin admin] PATH_INFO: `/v3/projects/5c7efddffde545549e99aa0496ac0ff9` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:03.317547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a1277-b014-4bc4-9e60-9d2bd65982fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7efddffde545549e99aa0496ac0ff9)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:03.317547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a1277-b014-4bc4-9e60-9d2bd65982fc admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:03.381092 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35c27d-2058-4ee8-8f23-df30c124abc4 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:03.386462 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db904a-8e77-45b8-98a6-7d2b91d84b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:03.387332 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db904a-8e77-45b8-98a6-7d2b91d84b0d admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:03.387779 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db904a-8e77-45b8-98a6-7d2b91d84b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:03.388255 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db904a-8e77-45b8-98a6-7d2b91d84b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:03.388960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db904a-8e77-45b8-98a6-7d2b91d84b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:03.390639 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db904a-8e77-45b8-98a6-7d2b91d84b0d admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:03.406198 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 860/1734] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:03.406198 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db904a-8e77-45b8-98a6-7d2b91d84b0d admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:03.409024 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-c5db904a-8e77-45b8-98a6-7d2b91d84b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:03.463085 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-2b5a1277-b014-4bc4-9e60-9d2bd65982fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7efddffde545549e99aa0496ac0ff9', 'request_id': 'req-2b5a1277-b014-4bc4-9e60-9d2bd65982fc'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:03.539896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db904a-8e77-45b8-98a6-7d2b91d84b0d admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:03.579916 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-2b5a1277-b014-4bc4-9e60-9d2bd65982fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7efddffde545549e99aa0496ac0ff9', 'request_id': 'req-2b5a1277-b014-4bc4-9e60-9d2bd65982fc'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:03.589374 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-2b5a1277-b014-4bc4-9e60-9d2bd65982fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7efddffde545549e99aa0496ac0ff9', 'request_id': 'req-2b5a1277-b014-4bc4-9e60-9d2bd65982fc'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:03.603803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-2b5a1277-b014-4bc4-9e60-9d2bd65982fc admin admin] The token cache is being invalidate because project 5c7efddffde545549e99aa0496ac0ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:03.604199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-2b5a1277-b014-4bc4-9e60-9d2bd65982fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:03.605556 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-2b5a1277-b014-4bc4-9e60-9d2bd65982fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:03.607522 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 875/1735] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:03 2022] DELETE /identity/v3/projects/5c7efddffde545549e99aa0496ac0ff9 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:03.611572 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a1277-b014-4bc4-9e60-9d2bd65982fc admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:03.613080 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2b5a1277-b014-4bc4-9e60-9d2bd65982fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:03.617453 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669191f9-c007-412c-ae63-6336f1da1def service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:03.618147 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669191f9-c007-412c-ae63-6336f1da1def service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:03.619062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669191f9-c007-412c-ae63-6336f1da1def service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:03.619357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669191f9-c007-412c-ae63-6336f1da1def service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:03.622907 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-669191f9-c007-412c-ae63-6336f1da1def service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:03.743387 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a1277-b014-4bc4-9e60-9d2bd65982fc admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:03.744835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669191f9-c007-412c-ae63-6336f1da1def service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:03.746306 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669191f9-c007-412c-ae63-6336f1da1def service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:03.757065 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edae5f9-a400-4d27-a315-a1cd1e3bfc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:03.757966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edae5f9-a400-4d27-a315-a1cd1e3bfc89 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:03.758767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edae5f9-a400-4d27-a315-a1cd1e3bfc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:03.758767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edae5f9-a400-4d27-a315-a1cd1e3bfc89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:03.759704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edae5f9-a400-4d27-a315-a1cd1e3bfc89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:03.760857 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 861/1736] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:03 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:03.761615 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edae5f9-a400-4d27-a315-a1cd1e3bfc89 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:03.774634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 876/1737] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:03.778636 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669191f9-c007-412c-ae63-6336f1da1def service cinder] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:03.779222 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edae5f9-a400-4d27-a315-a1cd1e3bfc89 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:03.781333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-669191f9-c007-412c-ae63-6336f1da1def service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:03.808118 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669191f9-c007-412c-ae63-6336f1da1def service cinder] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:03.809918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edae5f9-a400-4d27-a315-a1cd1e3bfc89 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:03.813432 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:03.824521 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b99f2-b2d4-4cf2-b88f-ae8fb01e25c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:03.824742 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc37cb-432f-4204-856e-08e5563cf22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:03.825423 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b99f2-b2d4-4cf2-b88f-ae8fb01e25c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:03.825597 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc37cb-432f-4204-856e-08e5563cf22b admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:03.825689 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b99f2-b2d4-4cf2-b88f-ae8fb01e25c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:03.825974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b99f2-b2d4-4cf2-b88f-ae8fb01e25c4 admin admin] PATH_INFO: `/v3/users/bb511ab2999645f2b22f4e343c44dc26` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:03.826083 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc37cb-432f-4204-856e-08e5563cf22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:03.826549 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc37cb-432f-4204-856e-08e5563cf22b admin admin] PATH_INFO: `/v3/projects/0f694ceb03d147f2b5408b5d21ae8e75/users/11f34180981e447bbc0318aa8f1e8cfd/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:03.827822 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b99f2-b2d4-4cf2-b88f-ae8fb01e25c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb511ab2999645f2b22f4e343c44dc26)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:03.836297 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b99f2-b2d4-4cf2-b88f-ae8fb01e25c4 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:03.851781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc37cb-432f-4204-856e-08e5563cf22b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f694ceb03d147f2b5408b5d21ae8e75, user_id=11f34180981e447bbc0318aa8f1e8cfd, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:03.890866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc37cb-432f-4204-856e-08e5563cf22b admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:03.911936 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:04.023969 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 877/1738] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:03 2022] PUT /identity/v3/projects/0f694ceb03d147f2b5408b5d21ae8e75/users/11f34180981e447bbc0318aa8f1e8cfd/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 16:59:04.036741 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743f1cf-7e3a-4991-ad97-784900333084 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:04.037037 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743f1cf-7e3a-4991-ad97-784900333084 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:04.037319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743f1cf-7e3a-4991-ad97-784900333084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:04.074119 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-6743f1cf-7e3a-4991-ad97-784900333084 None None] MFA Rules not processed for user `11f34180981e447bbc0318aa8f1e8cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:04.076053 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-6743f1cf-7e3a-4991-ad97-784900333084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:04.147304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-cf7b99f2-b2d4-4cf2-b88f-ae8fb01e25c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb511ab2999645f2b22f4e343c44dc26'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:04.149503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-cf7b99f2-b2d4-4cf2-b88f-ae8fb01e25c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb511ab2999645f2b22f4e343c44dc26'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:04.175934 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 878/1739] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:04.181027 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743f1cf-7e3a-4991-ad97-784900333084 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:04.184299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-6743f1cf-7e3a-4991-ad97-784900333084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:04.259100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743f1cf-7e3a-4991-ad97-784900333084 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:04.264367 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf367a9-eb14-4daf-b075-0ad2c9f6a31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:04.265897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-cf7b99f2-b2d4-4cf2-b88f-ae8fb01e25c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb511ab2999645f2b22f4e343c44dc26'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:04.266590 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-cf7b99f2-b2d4-4cf2-b88f-ae8fb01e25c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb511ab2999645f2b22f4e343c44dc26'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:04.270500 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf367a9-eb14-4daf-b075-0ad2c9f6a31b admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:04.272878 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf367a9-eb14-4daf-b075-0ad2c9f6a31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:04.273646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf367a9-eb14-4daf-b075-0ad2c9f6a31b admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:04.274378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf367a9-eb14-4daf-b075-0ad2c9f6a31b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:04.279615 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf367a9-eb14-4daf-b075-0ad2c9f6a31b admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:04.286557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-cf7b99f2-b2d4-4cf2-b88f-ae8fb01e25c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb511ab2999645f2b22f4e343c44dc26'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:04.297371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:04.308854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 862/1740] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:03 2022] DELETE /identity/v3/users/bb511ab2999645f2b22f4e343c44dc26 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:04.394601 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:04.404927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 879/1741] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:04 2022] POST /identity/v3/projects => generated 365 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 16:59:04.405957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b99f2-b2d4-4cf2-b88f-ae8fb01e25c4 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:04.469876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b99f2-b2d4-4cf2-b88f-ae8fb01e25c4 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:04.539991 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b972a-9a13-4299-9b2e-988701e5127d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:04.540720 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b972a-9a13-4299-9b2e-988701e5127d admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:04.541001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b972a-9a13-4299-9b2e-988701e5127d admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:04.541278 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b972a-9a13-4299-9b2e-988701e5127d admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:04.541988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b972a-9a13-4299-9b2e-988701e5127d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:04.543945 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b972a-9a13-4299-9b2e-988701e5127d admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:04.632066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 863/1742] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:04 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 16:59:04.633930 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf367a9-eb14-4daf-b075-0ad2c9f6a31b admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:04.645201 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf367a9-eb14-4daf-b075-0ad2c9f6a31b admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:04.650261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdee842-3590-4977-b469-3131d85b1cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:04.651299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdee842-3590-4977-b469-3131d85b1cfd admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:04.651299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdee842-3590-4977-b469-3131d85b1cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:04.651968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdee842-3590-4977-b469-3131d85b1cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:04.652815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdee842-3590-4977-b469-3131d85b1cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:04.654648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdee842-3590-4977-b469-3131d85b1cfd admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:04.668172 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 880/1743] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 16:59:04.670794 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b972a-9a13-4299-9b2e-988701e5127d admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:04.683054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b972a-9a13-4299-9b2e-988701e5127d admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:04.688611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86591c77-9fbb-454d-bd10-609a2cd03cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:04.689966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86591c77-9fbb-454d-bd10-609a2cd03cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:04.689966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86591c77-9fbb-454d-bd10-609a2cd03cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:04.690150 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86591c77-9fbb-454d-bd10-609a2cd03cfd admin admin] PATH_INFO: `/v3/projects/3a749a13893042e794d8f066fb7de02b/users/e749fe50d657492f84ad2b274b1d7088/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:04.696647 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:04.712757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86591c77-9fbb-454d-bd10-609a2cd03cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a749a13893042e794d8f066fb7de02b, user_id=e749fe50d657492f84ad2b274b1d7088, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:04.715424 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86591c77-9fbb-454d-bd10-609a2cd03cfd admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:04.789113 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdee842-3590-4977-b469-3131d85b1cfd admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:04.790459 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-efdee842-3590-4977-b469-3131d85b1cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:04.798015 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 864/1744] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:04 2022] PUT /identity/v3/projects/3a749a13893042e794d8f066fb7de02b/users/e749fe50d657492f84ad2b274b1d7088/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:04.801579 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86591c77-9fbb-454d-bd10-609a2cd03cfd admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:04.806943 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdee842-3590-4977-b469-3131d85b1cfd admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:04.888750 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89f523-37bc-4592-9833-3a514a9d022c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:04.889893 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89f523-37bc-4592-9833-3a514a9d022c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:04.890250 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89f523-37bc-4592-9833-3a514a9d022c admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:04.890527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89f523-37bc-4592-9833-3a514a9d022c admin admin] PATH_INFO: `/v3/projects/76ce9096e7314eb39044a0d8f0eef7bc` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:04.893694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89f523-37bc-4592-9833-3a514a9d022c admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ce9096e7314eb39044a0d8f0eef7bc)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:04.895830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89f523-37bc-4592-9833-3a514a9d022c admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:04.903577 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86591c77-9fbb-454d-bd10-609a2cd03cfd admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:04.910751 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f746c-b034-4679-ab99-204e5a00f480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:04.911520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f746c-b034-4679-ab99-204e5a00f480 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:04.911876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f746c-b034-4679-ab99-204e5a00f480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:04.912266 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f746c-b034-4679-ab99-204e5a00f480 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:04.913081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f746c-b034-4679-ab99-204e5a00f480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:04.915326 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f746c-b034-4679-ab99-204e5a00f480 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:04.926215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 865/1745] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:04.931386 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f746c-b034-4679-ab99-204e5a00f480 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:04.935230 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-a86f746c-b034-4679-ab99-204e5a00f480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:04.956368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f746c-b034-4679-ab99-204e5a00f480 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:04.962440 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0d59f-8136-45aa-b5d9-17ca632d7bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:04.963314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0d59f-8136-45aa-b5d9-17ca632d7bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:04.963592 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0d59f-8136-45aa-b5d9-17ca632d7bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:04.963861 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0d59f-8136-45aa-b5d9-17ca632d7bf2 admin admin] PATH_INFO: `/v3/users/9b0170f956734e9d9b688b5491c95ec7` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:04.968724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0d59f-8136-45aa-b5d9-17ca632d7bf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b0170f956734e9d9b688b5491c95ec7)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:04.970759 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0d59f-8136-45aa-b5d9-17ca632d7bf2 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:05.028079 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-dc89f523-37bc-4592-9833-3a514a9d022c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ce9096e7314eb39044a0d8f0eef7bc', 'request_id': 'req-dc89f523-37bc-4592-9833-3a514a9d022c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:05.118035 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-dc89f523-37bc-4592-9833-3a514a9d022c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ce9096e7314eb39044a0d8f0eef7bc', 'request_id': 'req-dc89f523-37bc-4592-9833-3a514a9d022c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:05.128409 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-dc89f523-37bc-4592-9833-3a514a9d022c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ce9096e7314eb39044a0d8f0eef7bc', 'request_id': 'req-dc89f523-37bc-4592-9833-3a514a9d022c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:05.130137 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:05.154615 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-dc89f523-37bc-4592-9833-3a514a9d022c admin admin] The token cache is being invalidate because project 76ce9096e7314eb39044a0d8f0eef7bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:05.155097 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-dc89f523-37bc-4592-9833-3a514a9d022c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:05.155673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-dc89f523-37bc-4592-9833-3a514a9d022c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:05.160615 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 881/1746] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:04 2022] DELETE /identity/v3/projects/76ce9096e7314eb39044a0d8f0eef7bc => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 16:59:05.160615 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89f523-37bc-4592-9833-3a514a9d022c admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:05.166670 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-dc89f523-37bc-4592-9833-3a514a9d022c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:05.257392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6ff0d59f-8136-45aa-b5d9-17ca632d7bf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b0170f956734e9d9b688b5491c95ec7'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:05.258598 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6ff0d59f-8136-45aa-b5d9-17ca632d7bf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b0170f956734e9d9b688b5491c95ec7'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:05.281756 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89f523-37bc-4592-9833-3a514a9d022c admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:05.289662 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a816a0-531a-4757-bc31-f6dd08d161eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:05.291055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a816a0-531a-4757-bc31-f6dd08d161eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:05.291491 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a816a0-531a-4757-bc31-f6dd08d161eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:05.291782 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a816a0-531a-4757-bc31-f6dd08d161eb admin admin] PATH_INFO: `/v3/projects/3a749a13893042e794d8f066fb7de02b/users/e749fe50d657492f84ad2b274b1d7088/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:05.295434 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a816a0-531a-4757-bc31-f6dd08d161eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a749a13893042e794d8f066fb7de02b, user_id=e749fe50d657492f84ad2b274b1d7088, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:05.299266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a816a0-531a-4757-bc31-f6dd08d161eb admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:05.330528 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 882/1747] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:05 2022] PUT /identity/v3/projects/3a749a13893042e794d8f066fb7de02b/users/e749fe50d657492f84ad2b274b1d7088/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:05.342989 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c225115-3495-4da7-a9d4-21697553bf5b None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:05.343490 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c225115-3495-4da7-a9d4-21697553bf5b None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:05.343752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c225115-3495-4da7-a9d4-21697553bf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:05.366429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-2c225115-3495-4da7-a9d4-21697553bf5b None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:05.367677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2c225115-3495-4da7-a9d4-21697553bf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:05.380441 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6ff0d59f-8136-45aa-b5d9-17ca632d7bf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b0170f956734e9d9b688b5491c95ec7'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:05.381304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6ff0d59f-8136-45aa-b5d9-17ca632d7bf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b0170f956734e9d9b688b5491c95ec7'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:05.403623 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6ff0d59f-8136-45aa-b5d9-17ca632d7bf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b0170f956734e9d9b688b5491c95ec7'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:05.421257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 866/1748] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:04 2022] DELETE /identity/v3/users/9b0170f956734e9d9b688b5491c95ec7 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:05.423431 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be1f65-363a-48f5-aaa1-b13ab4e60ba7 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:05.424282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be1f65-363a-48f5-aaa1-b13ab4e60ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:05.424703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be1f65-363a-48f5-aaa1-b13ab4e60ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:05.455678 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 883/1749] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:05.455678 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b066b4-cb35-4162-93ee-76d0d96a3ce0 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:05.455678 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b066b4-cb35-4162-93ee-76d0d96a3ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:05.455678 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b066b4-cb35-4162-93ee-76d0d96a3ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:05.465658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-95be1f65-363a-48f5-aaa1-b13ab4e60ba7 None None] MFA Rules not processed for user `e749fe50d657492f84ad2b274b1d7088`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:05.475192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-95be1f65-363a-48f5-aaa1-b13ab4e60ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:05.483797 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-55b066b4-cb35-4162-93ee-76d0d96a3ce0 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:05.485424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-55b066b4-cb35-4162-93ee-76d0d96a3ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:05.537917 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:05.557434 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 884/1750] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:05.558899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114676a7-99a3-4266-a1df-c5e515125a22 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:05.559250 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114676a7-99a3-4266-a1df-c5e515125a22 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:05.559499 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114676a7-99a3-4266-a1df-c5e515125a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:05.572801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 867/1751] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:05.573731 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be1f65-363a-48f5-aaa1-b13ab4e60ba7 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:05.575216 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-95be1f65-363a-48f5-aaa1-b13ab4e60ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:05.583081 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-114676a7-99a3-4266-a1df-c5e515125a22 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:05.584456 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-114676a7-99a3-4266-a1df-c5e515125a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:05.595391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 885/1752] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:05.599418 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114676a7-99a3-4266-a1df-c5e515125a22 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:05.599418 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-114676a7-99a3-4266-a1df-c5e515125a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:05.667484 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114676a7-99a3-4266-a1df-c5e515125a22 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:05.672307 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4e959-5306-434a-be34-4e19172bfc84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:05.672995 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4e959-5306-434a-be34-4e19172bfc84 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:05.673266 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be1f65-363a-48f5-aaa1-b13ab4e60ba7 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:05.673428 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4e959-5306-434a-be34-4e19172bfc84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:05.673725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4e959-5306-434a-be34-4e19172bfc84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:05.677675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef3bdd-e9d3-4b02-914a-0bd43bd267ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:05.679977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef3bdd-e9d3-4b02-914a-0bd43bd267ce service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:05.679977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef3bdd-e9d3-4b02-914a-0bd43bd267ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:05.679977 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef3bdd-e9d3-4b02-914a-0bd43bd267ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:05.684315 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4e959-5306-434a-be34-4e19172bfc84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:05.685765 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4e959-5306-434a-be34-4e19172bfc84 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:05.691649 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef3bdd-e9d3-4b02-914a-0bd43bd267ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:05.693531 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef3bdd-e9d3-4b02-914a-0bd43bd267ce service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:05.700850 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 886/1753] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:05.705824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4e959-5306-434a-be34-4e19172bfc84 service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:05.706370 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 868/1754] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:05.719983 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4e959-5306-434a-be34-4e19172bfc84 service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:05.733323 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525ba9b-f9c9-4aeb-903f-69f87d6db563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:05.734439 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525ba9b-f9c9-4aeb-903f-69f87d6db563 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:05.734439 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525ba9b-f9c9-4aeb-903f-69f87d6db563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:05.734797 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525ba9b-f9c9-4aeb-903f-69f87d6db563 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:05.735439 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525ba9b-f9c9-4aeb-903f-69f87d6db563 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:59:05.735744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525ba9b-f9c9-4aeb-903f-69f87d6db563 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:05.737374 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525ba9b-f9c9-4aeb-903f-69f87d6db563 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:05.750847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 887/1755] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:59:05.755385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef3bdd-e9d3-4b02-914a-0bd43bd267ce service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:05.767017 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef3bdd-e9d3-4b02-914a-0bd43bd267ce service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:05.772047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fbb2f-6487-4dd1-8dfc-2bf10e0d2154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:05.774389 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fbb2f-6487-4dd1-8dfc-2bf10e0d2154 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:05.774389 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fbb2f-6487-4dd1-8dfc-2bf10e0d2154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:05.774389 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fbb2f-6487-4dd1-8dfc-2bf10e0d2154 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:05.774389 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3fbb2f-6487-4dd1-8dfc-2bf10e0d2154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:05.776682 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3fbb2f-6487-4dd1-8dfc-2bf10e0d2154 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:05.821317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:05.933472 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 869/1756] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:05 2022] POST /identity/v3/projects => generated 369 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:05.938277 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525ba9b-f9c9-4aeb-903f-69f87d6db563 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:05.949542 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525ba9b-f9c9-4aeb-903f-69f87d6db563 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:06.033585 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a72f6c-fdf6-4465-b18d-07be20515843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:06.034275 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a72f6c-fdf6-4465-b18d-07be20515843 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:06.035319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a72f6c-fdf6-4465-b18d-07be20515843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:06.036275 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a72f6c-fdf6-4465-b18d-07be20515843 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:06.039887 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a72f6c-fdf6-4465-b18d-07be20515843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:06.044211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a72f6c-fdf6-4465-b18d-07be20515843 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:06.053217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fbb2f-6487-4dd1-8dfc-2bf10e0d2154 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:06.056033 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-5e3fbb2f-6487-4dd1-8dfc-2bf10e0d2154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:06.131405 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fbb2f-6487-4dd1-8dfc-2bf10e0d2154 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:06.135723 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d742df-df35-4d48-befe-775a8754b298 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:06.136558 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d742df-df35-4d48-befe-775a8754b298 service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:06.136900 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d742df-df35-4d48-befe-775a8754b298 service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:06.137191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d742df-df35-4d48-befe-775a8754b298 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:06.140746 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-75d742df-df35-4d48-befe-775a8754b298 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:06.206610 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 888/1757] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:05 2022] POST /identity/v3/users => generated 285 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:06.207766 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a72f6c-fdf6-4465-b18d-07be20515843 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:06.225487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a72f6c-fdf6-4465-b18d-07be20515843 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:06.237257 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ad594-5e7e-491b-96ff-75bb3b6e203e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:06.238196 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ad594-5e7e-491b-96ff-75bb3b6e203e admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:06.238489 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ad594-5e7e-491b-96ff-75bb3b6e203e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:06.238775 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ad594-5e7e-491b-96ff-75bb3b6e203e admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:06.239516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ad594-5e7e-491b-96ff-75bb3b6e203e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:06.241388 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ad594-5e7e-491b-96ff-75bb3b6e203e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:06.255508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 889/1758] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 16:59:06.257782 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ad594-5e7e-491b-96ff-75bb3b6e203e admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:06.266681 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d742df-df35-4d48-befe-775a8754b298 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:06.268286 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d742df-df35-4d48-befe-775a8754b298 service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:06.273894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ad594-5e7e-491b-96ff-75bb3b6e203e admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:06.282258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195915e-1ceb-445a-953f-a8d06ab8bdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:06.284644 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 870/1759] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:06.284963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195915e-1ceb-445a-953f-a8d06ab8bdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:06.285341 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195915e-1ceb-445a-953f-a8d06ab8bdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:06.285930 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195915e-1ceb-445a-953f-a8d06ab8bdf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:06.286769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195915e-1ceb-445a-953f-a8d06ab8bdf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:06.288535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195915e-1ceb-445a-953f-a8d06ab8bdf3 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:06.302586 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 890/1760] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:06.305523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d742df-df35-4d48-befe-775a8754b298 service cinder] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:06.322766 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d742df-df35-4d48-befe-775a8754b298 service cinder] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:06.331317 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e5f70-81a8-498b-9df9-1f93086b7ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:06.334048 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e5f70-81a8-498b-9df9-1f93086b7ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:06.334343 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e5f70-81a8-498b-9df9-1f93086b7ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:06.334796 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e5f70-81a8-498b-9df9-1f93086b7ddf admin admin] PATH_INFO: `/v3/projects/6296985ef4d64312b2bd1d8de0a67c08/users/72cef5de005841e38e2c449c6d3d93ce/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:06.336830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195915e-1ceb-445a-953f-a8d06ab8bdf3 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:06.340721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-6195915e-1ceb-445a-953f-a8d06ab8bdf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:06.347201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:06.356944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195915e-1ceb-445a-953f-a8d06ab8bdf3 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:06.363353 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a5c3f-7f78-45ef-8dde-62f131ae6a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:06.363794 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e5f70-81a8-498b-9df9-1f93086b7ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6296985ef4d64312b2bd1d8de0a67c08, user_id=72cef5de005841e38e2c449c6d3d93ce, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:06.364569 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a5c3f-7f78-45ef-8dde-62f131ae6a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:06.364769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a5c3f-7f78-45ef-8dde-62f131ae6a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:06.365039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a5c3f-7f78-45ef-8dde-62f131ae6a79 admin admin] PATH_INFO: `/v3/projects/8520a20d5d6b462baf8f86f2ebc483ee` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:06.366289 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a5c3f-7f78-45ef-8dde-62f131ae6a79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8520a20d5d6b462baf8f86f2ebc483ee)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:06.366692 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e5f70-81a8-498b-9df9-1f93086b7ddf admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:06.368313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a5c3f-7f78-45ef-8dde-62f131ae6a79 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:06.451024 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 871/1761] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:06 2022] PUT /identity/v3/projects/6296985ef4d64312b2bd1d8de0a67c08/users/72cef5de005841e38e2c449c6d3d93ce/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 16:59:06.460964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c234c-0baf-45c6-81e7-bf7eb60dda12 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:06.461257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c234c-0baf-45c6-81e7-bf7eb60dda12 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:06.461535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c234c-0baf-45c6-81e7-bf7eb60dda12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:06.487571 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-487a5c3f-7f78-45ef-8dde-62f131ae6a79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8520a20d5d6b462baf8f86f2ebc483ee', 'request_id': 'req-487a5c3f-7f78-45ef-8dde-62f131ae6a79'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:06.489570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-5b5c234c-0baf-45c6-81e7-bf7eb60dda12 None None] MFA Rules not processed for user `72cef5de005841e38e2c449c6d3d93ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:06.491012 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-5b5c234c-0baf-45c6-81e7-bf7eb60dda12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:06.560980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 872/1762] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:59:06.568383 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c234c-0baf-45c6-81e7-bf7eb60dda12 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:06.568976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-487a5c3f-7f78-45ef-8dde-62f131ae6a79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8520a20d5d6b462baf8f86f2ebc483ee', 'request_id': 'req-487a5c3f-7f78-45ef-8dde-62f131ae6a79'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:06.577977 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-487a5c3f-7f78-45ef-8dde-62f131ae6a79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8520a20d5d6b462baf8f86f2ebc483ee', 'request_id': 'req-487a5c3f-7f78-45ef-8dde-62f131ae6a79'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:06.589030 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-487a5c3f-7f78-45ef-8dde-62f131ae6a79 admin admin] The token cache is being invalidate because project 8520a20d5d6b462baf8f86f2ebc483ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:06.589319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-487a5c3f-7f78-45ef-8dde-62f131ae6a79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:06.590016 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-487a5c3f-7f78-45ef-8dde-62f131ae6a79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:06.594582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 891/1763] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:06 2022] DELETE /identity/v3/projects/8520a20d5d6b462baf8f86f2ebc483ee => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:06.595373 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a5c3f-7f78-45ef-8dde-62f131ae6a79 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:06.596697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-487a5c3f-7f78-45ef-8dde-62f131ae6a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:06.650262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c234c-0baf-45c6-81e7-bf7eb60dda12 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:06.656256 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd8750-7976-4fd7-9568-c597115bf276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:06.656716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd8750-7976-4fd7-9568-c597115bf276 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:06.657001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd8750-7976-4fd7-9568-c597115bf276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:06.657274 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd8750-7976-4fd7-9568-c597115bf276 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:06.658014 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd8750-7976-4fd7-9568-c597115bf276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:06.659944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd8750-7976-4fd7-9568-c597115bf276 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:06.682066 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a5c3f-7f78-45ef-8dde-62f131ae6a79 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:06.686860 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d2c10-bdee-4645-80c8-808f0e47f35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:06.687732 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d2c10-bdee-4645-80c8-808f0e47f35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:06.688018 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d2c10-bdee-4645-80c8-808f0e47f35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:06.688325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d2c10-bdee-4645-80c8-808f0e47f35c admin admin] PATH_INFO: `/v3/users/d69caf253f4244b1bf68cc1680e4a155` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:06.689520 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d2c10-bdee-4645-80c8-808f0e47f35c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69caf253f4244b1bf68cc1680e4a155)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:06.691442 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d2c10-bdee-4645-80c8-808f0e47f35c admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:06.768638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 873/1764] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:06 2022] POST /identity/v3/projects => generated 369 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 16:59:06.773554 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd8750-7976-4fd7-9568-c597115bf276 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:06.775080 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-2dcd8750-7976-4fd7-9568-c597115bf276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:06.843554 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd8750-7976-4fd7-9568-c597115bf276 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:06.857076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cd9a1-bafd-4b6c-b819-ae8904640927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:06.857076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cd9a1-bafd-4b6c-b819-ae8904640927 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:06.857076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cd9a1-bafd-4b6c-b819-ae8904640927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:06.857076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cd9a1-bafd-4b6c-b819-ae8904640927 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:06.857660 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61cd9a1-bafd-4b6c-b819-ae8904640927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:06.857660 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61cd9a1-bafd-4b6c-b819-ae8904640927 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:06.906307 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:06.943741 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 874/1765] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:06 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 16:59:06.949128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cd9a1-bafd-4b6c-b819-ae8904640927 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:06.956266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-504d2c10-bdee-4645-80c8-808f0e47f35c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69caf253f4244b1bf68cc1680e4a155'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:06.960971 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cd9a1-bafd-4b6c-b819-ae8904640927 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:06.963420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-504d2c10-bdee-4645-80c8-808f0e47f35c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69caf253f4244b1bf68cc1680e4a155'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:06.964140 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-504d2c10-bdee-4645-80c8-808f0e47f35c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69caf253f4244b1bf68cc1680e4a155'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:06.967884 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5884cd8-18e4-4b17-b14a-a48d92db08c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:06.968608 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5884cd8-18e4-4b17-b14a-a48d92db08c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:06.968889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5884cd8-18e4-4b17-b14a-a48d92db08c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:06.969167 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5884cd8-18e4-4b17-b14a-a48d92db08c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:06.970508 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5884cd8-18e4-4b17-b14a-a48d92db08c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:06.972574 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5884cd8-18e4-4b17-b14a-a48d92db08c5 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:06.977306 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-504d2c10-bdee-4645-80c8-808f0e47f35c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69caf253f4244b1bf68cc1680e4a155'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:06.977993 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-504d2c10-bdee-4645-80c8-808f0e47f35c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69caf253f4244b1bf68cc1680e4a155'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:06.986119 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 875/1766] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:06.990210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5884cd8-18e4-4b17-b14a-a48d92db08c5 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:06.995271 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-c5884cd8-18e4-4b17-b14a-a48d92db08c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:07.004721 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5884cd8-18e4-4b17-b14a-a48d92db08c5 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:07.009288 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d54a69-fee6-4d8e-a8a7-f5afb32ee1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:07.010149 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d54a69-fee6-4d8e-a8a7-f5afb32ee1f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:07.010430 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d54a69-fee6-4d8e-a8a7-f5afb32ee1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:07.010705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d54a69-fee6-4d8e-a8a7-f5afb32ee1f1 admin admin] PATH_INFO: `/v3/projects/0d16b81c0b054c30a5167b77070122e0/users/2093fb6c993d466186e02f1e1a3d7308/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:07.025595 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d54a69-fee6-4d8e-a8a7-f5afb32ee1f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d16b81c0b054c30a5167b77070122e0, user_id=2093fb6c993d466186e02f1e1a3d7308, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:07.028516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d54a69-fee6-4d8e-a8a7-f5afb32ee1f1 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:07.076928 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 892/1767] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:06 2022] DELETE /identity/v3/users/d69caf253f4244b1bf68cc1680e4a155 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:07.121982 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 876/1768] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:06 2022] PUT /identity/v3/projects/0d16b81c0b054c30a5167b77070122e0/users/2093fb6c993d466186e02f1e1a3d7308/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 16:59:07.124526 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d2c10-bdee-4645-80c8-808f0e47f35c admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:07.142165 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:07.196727 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d2c10-bdee-4645-80c8-808f0e47f35c admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:07.251723 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741e4a9-7456-4355-891a-af26287f4498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:07.252458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741e4a9-7456-4355-891a-af26287f4498 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:07.252931 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741e4a9-7456-4355-891a-af26287f4498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:07.253553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741e4a9-7456-4355-891a-af26287f4498 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:07.254379 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741e4a9-7456-4355-891a-af26287f4498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:07.256330 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741e4a9-7456-4355-891a-af26287f4498 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:07.281812 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 893/1769] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:07.284413 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d54a69-fee6-4d8e-a8a7-f5afb32ee1f1 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:07.310824 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d54a69-fee6-4d8e-a8a7-f5afb32ee1f1 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:07.335090 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef28f1b-e21e-4b10-934c-e3f845bc3c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:07.337027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef28f1b-e21e-4b10-934c-e3f845bc3c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:07.337456 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef28f1b-e21e-4b10-934c-e3f845bc3c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:07.337740 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef28f1b-e21e-4b10-934c-e3f845bc3c3b admin admin] PATH_INFO: `/v3/projects/0d16b81c0b054c30a5167b77070122e0/users/2093fb6c993d466186e02f1e1a3d7308/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:07.340051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef28f1b-e21e-4b10-934c-e3f845bc3c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d16b81c0b054c30a5167b77070122e0, user_id=2093fb6c993d466186e02f1e1a3d7308, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:07.343016 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef28f1b-e21e-4b10-934c-e3f845bc3c3b admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:07.356801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 877/1770] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:07 2022] PUT /identity/v3/projects/0d16b81c0b054c30a5167b77070122e0/users/2093fb6c993d466186e02f1e1a3d7308/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:07.368074 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792b501-dc95-469c-9702-c4fd5bb306b1 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:07.368400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792b501-dc95-469c-9702-c4fd5bb306b1 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:07.368691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792b501-dc95-469c-9702-c4fd5bb306b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:07.396181 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-4792b501-dc95-469c-9702-c4fd5bb306b1 None None] MFA Rules not processed for user `2093fb6c993d466186e02f1e1a3d7308`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:07.397560 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-4792b501-dc95-469c-9702-c4fd5bb306b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:07.472377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 894/1771] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:07 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:07.483799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef28f1b-e21e-4b10-934c-e3f845bc3c3b admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:07.485544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-cef28f1b-e21e-4b10-934c-e3f845bc3c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:07.541769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792b501-dc95-469c-9702-c4fd5bb306b1 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:07.543231 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-4792b501-dc95-469c-9702-c4fd5bb306b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:07.555057 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef28f1b-e21e-4b10-934c-e3f845bc3c3b admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:07.558951 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f690de-43da-4472-9227-8f6c1d51289c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:07.559866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f690de-43da-4472-9227-8f6c1d51289c service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:07.560260 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f690de-43da-4472-9227-8f6c1d51289c service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:07.560616 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f690de-43da-4472-9227-8f6c1d51289c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:07.581129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f690de-43da-4472-9227-8f6c1d51289c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:07.582576 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f690de-43da-4472-9227-8f6c1d51289c service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:07.593417 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 878/1772] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:07 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:07.617149 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792b501-dc95-469c-9702-c4fd5bb306b1 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:07.621974 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915726a4-4c3d-425b-bc14-558d5bd30ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:07.622829 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915726a4-4c3d-425b-bc14-558d5bd30ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:07.623156 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915726a4-4c3d-425b-bc14-558d5bd30ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:07.623390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915726a4-4c3d-425b-bc14-558d5bd30ef7 admin admin] PATH_INFO: `/v3/projects/4538a5d4460243b5b50308f875aefa2d` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:07.624603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915726a4-4c3d-425b-bc14-558d5bd30ef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4538a5d4460243b5b50308f875aefa2d)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:07.626542 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915726a4-4c3d-425b-bc14-558d5bd30ef7 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:07.792644 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-915726a4-4c3d-425b-bc14-558d5bd30ef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4538a5d4460243b5b50308f875aefa2d', 'request_id': 'req-915726a4-4c3d-425b-bc14-558d5bd30ef7'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:07.859892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-915726a4-4c3d-425b-bc14-558d5bd30ef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4538a5d4460243b5b50308f875aefa2d', 'request_id': 'req-915726a4-4c3d-425b-bc14-558d5bd30ef7'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:07.867224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-915726a4-4c3d-425b-bc14-558d5bd30ef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4538a5d4460243b5b50308f875aefa2d', 'request_id': 'req-915726a4-4c3d-425b-bc14-558d5bd30ef7'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:07.885066 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-915726a4-4c3d-425b-bc14-558d5bd30ef7 admin admin] The token cache is being invalidate because project 4538a5d4460243b5b50308f875aefa2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:07.885066 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-915726a4-4c3d-425b-bc14-558d5bd30ef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:07.885066 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-915726a4-4c3d-425b-bc14-558d5bd30ef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:07.885066 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 895/1773] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:07 2022] DELETE /identity/v3/projects/4538a5d4460243b5b50308f875aefa2d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:07.886495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64b099-f215-400c-bb5a-d886bee8b9fb None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:07.886805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64b099-f215-400c-bb5a-d886bee8b9fb None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:07.887081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64b099-f215-400c-bb5a-d886bee8b9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:07.907486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-de64b099-f215-400c-bb5a-d886bee8b9fb None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:07.908634 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-de64b099-f215-400c-bb5a-d886bee8b9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:07.973060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 879/1774] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:07.982867 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6722e6-b5df-4633-b928-ac8f2328f63b None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:07.983009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6722e6-b5df-4633-b928-ac8f2328f63b None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:07.983219 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6722e6-b5df-4633-b928-ac8f2328f63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:08.010918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-2a6722e6-b5df-4633-b928-ac8f2328f63b None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:08.012732 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2a6722e6-b5df-4633-b928-ac8f2328f63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:08.022185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 896/1775] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:59:08.027619 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64b099-f215-400c-bb5a-d886bee8b9fb None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:08.039248 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64b099-f215-400c-bb5a-d886bee8b9fb None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:08.044212 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3976718-b8e2-49a7-a20a-48015fb76e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:08.044871 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3976718-b8e2-49a7-a20a-48015fb76e5a admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:08.045157 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3976718-b8e2-49a7-a20a-48015fb76e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:08.045448 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3976718-b8e2-49a7-a20a-48015fb76e5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:08.046185 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3976718-b8e2-49a7-a20a-48015fb76e5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:59:08.046489 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3976718-b8e2-49a7-a20a-48015fb76e5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:08.048190 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3976718-b8e2-49a7-a20a-48015fb76e5a admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:08.059955 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 880/1776] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:59:08.064563 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6722e6-b5df-4633-b928-ac8f2328f63b None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:08.073669 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6722e6-b5df-4633-b928-ac8f2328f63b None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:08.079215 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f1810-8eeb-48bb-ac4b-5e3e2309225c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:08.079865 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f1810-8eeb-48bb-ac4b-5e3e2309225c admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:08.080227 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f1810-8eeb-48bb-ac4b-5e3e2309225c admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:08.080512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f1810-8eeb-48bb-ac4b-5e3e2309225c admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:08.081204 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f1810-8eeb-48bb-ac4b-5e3e2309225c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:08.083099 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f1810-8eeb-48bb-ac4b-5e3e2309225c admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:08.111324 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:08.193273 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 897/1777] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:08 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:08.196848 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3976718-b8e2-49a7-a20a-48015fb76e5a admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:08.206673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3976718-b8e2-49a7-a20a-48015fb76e5a admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:08.237462 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:08.263991 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d9f33-1bec-4d87-8ac7-b1a565164b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:08.264691 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d9f33-1bec-4d87-8ac7-b1a565164b76 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:08.264976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d9f33-1bec-4d87-8ac7-b1a565164b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:08.265257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d9f33-1bec-4d87-8ac7-b1a565164b76 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:08.265959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d9f33-1bec-4d87-8ac7-b1a565164b76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:08.267867 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d9f33-1bec-4d87-8ac7-b1a565164b76 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:08.400263 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 881/1778] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:08 2022] POST /identity/v3/users => generated 303 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:08.401817 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f1810-8eeb-48bb-ac4b-5e3e2309225c admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:08.411859 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f1810-8eeb-48bb-ac4b-5e3e2309225c admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:08.416893 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ad745-5906-4a6a-9ec9-c960c924ba2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:08.417552 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ad745-5906-4a6a-9ec9-c960c924ba2c admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:08.417844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ad745-5906-4a6a-9ec9-c960c924ba2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:08.418159 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ad745-5906-4a6a-9ec9-c960c924ba2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:08.418901 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ad745-5906-4a6a-9ec9-c960c924ba2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:08.420813 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ad745-5906-4a6a-9ec9-c960c924ba2c admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:08.431610 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 898/1779] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 16:59:08.435569 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d9f33-1bec-4d87-8ac7-b1a565164b76 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:08.447616 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d9f33-1bec-4d87-8ac7-b1a565164b76 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:08.453218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1525a6-3278-43ec-a00b-2b4ff230280e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:08.453915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1525a6-3278-43ec-a00b-2b4ff230280e admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:08.454199 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1525a6-3278-43ec-a00b-2b4ff230280e admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:08.454481 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1525a6-3278-43ec-a00b-2b4ff230280e admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:08.455216 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1525a6-3278-43ec-a00b-2b4ff230280e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:08.456851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1525a6-3278-43ec-a00b-2b4ff230280e admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:08.467619 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 882/1780] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:08.471863 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ad745-5906-4a6a-9ec9-c960c924ba2c admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:08.482320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ad745-5906-4a6a-9ec9-c960c924ba2c admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:08.486871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12c967-0a6d-4eae-b856-48b91f2c76c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:08.487737 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12c967-0a6d-4eae-b856-48b91f2c76c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:08.488018 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12c967-0a6d-4eae-b856-48b91f2c76c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:08.488320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12c967-0a6d-4eae-b856-48b91f2c76c7 admin admin] PATH_INFO: `/v3/projects/5447eb2871cc4949ba911c8d481a4603/users/46c80a0e0a44454db55e269ba69f7ed3/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:08.504276 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12c967-0a6d-4eae-b856-48b91f2c76c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5447eb2871cc4949ba911c8d481a4603, user_id=46c80a0e0a44454db55e269ba69f7ed3, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:08.506212 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12c967-0a6d-4eae-b856-48b91f2c76c7 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:08.601072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 899/1781] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:08 2022] PUT /identity/v3/projects/5447eb2871cc4949ba911c8d481a4603/users/46c80a0e0a44454db55e269ba69f7ed3/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:08.606308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98179a-931d-4ddd-85eb-b679562c6977 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:08.606753 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98179a-931d-4ddd-85eb-b679562c6977 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:08.606863 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98179a-931d-4ddd-85eb-b679562c6977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:08.623888 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-cd98179a-931d-4ddd-85eb-b679562c6977 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:08.627198 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-cd98179a-931d-4ddd-85eb-b679562c6977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:08.691317 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 883/1782] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:59:08.707997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12c967-0a6d-4eae-b856-48b91f2c76c7 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:08.707997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-4b12c967-0a6d-4eae-b856-48b91f2c76c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:08.760119 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12c967-0a6d-4eae-b856-48b91f2c76c7 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:08.763956 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976a18d-46b7-4286-8afe-90d3e8c23528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:08.764640 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976a18d-46b7-4286-8afe-90d3e8c23528 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:08.765054 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976a18d-46b7-4286-8afe-90d3e8c23528 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:08.765265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976a18d-46b7-4286-8afe-90d3e8c23528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:08.774813 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976a18d-46b7-4286-8afe-90d3e8c23528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:08.776321 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976a18d-46b7-4286-8afe-90d3e8c23528 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:08.786054 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:08.788837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 900/1783] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:10.581618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30107bd4-a541-4e31-a617-1ea4d102bf96 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:10.582114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30107bd4-a541-4e31-a617-1ea4d102bf96 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:10.582239 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30107bd4-a541-4e31-a617-1ea4d102bf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:10.646210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-30107bd4-a541-4e31-a617-1ea4d102bf96 None None] MFA Rules not processed for user `46c80a0e0a44454db55e269ba69f7ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:10.649272 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-30107bd4-a541-4e31-a617-1ea4d102bf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:10.656946 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1489b2-60da-47cf-acef-05408dcdb138 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:10.657772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1489b2-60da-47cf-acef-05408dcdb138 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:10.658200 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1489b2-60da-47cf-acef-05408dcdb138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:10.720995 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-5d1489b2-60da-47cf-acef-05408dcdb138 None None] MFA Rules not processed for user `2a0a8cfb2482466a98340adab9980d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:10.726766 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-5d1489b2-60da-47cf-acef-05408dcdb138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:10.822112 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 884/1784] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:10.826470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30107bd4-a541-4e31-a617-1ea4d102bf96 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:10.866508 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30107bd4-a541-4e31-a617-1ea4d102bf96 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:10.866508 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23109fe4-3bb9-45e0-bb95-8e9a96aeb009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:10.866508 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23109fe4-3bb9-45e0-bb95-8e9a96aeb009 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:10.866508 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23109fe4-3bb9-45e0-bb95-8e9a96aeb009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:10.867345 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23109fe4-3bb9-45e0-bb95-8e9a96aeb009 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:10.867345 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23109fe4-3bb9-45e0-bb95-8e9a96aeb009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:10.871763 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23109fe4-3bb9-45e0-bb95-8e9a96aeb009 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:10.943073 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 901/1785] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 16:59:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 22 16:59:11.030759 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 885/1786] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:10 2022] POST /identity/v3/projects => generated 405 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 16:59:11.034827 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1489b2-60da-47cf-acef-05408dcdb138 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:11.049136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1489b2-60da-47cf-acef-05408dcdb138 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:11.067873 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:11.123732 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c83ce3-89eb-4989-9cc0-9c4be9197e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:11.127364 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c83ce3-89eb-4989-9cc0-9c4be9197e12 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:11.127364 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c83ce3-89eb-4989-9cc0-9c4be9197e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:11.127364 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c83ce3-89eb-4989-9cc0-9c4be9197e12 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:11.127364 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c83ce3-89eb-4989-9cc0-9c4be9197e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:11.128268 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c83ce3-89eb-4989-9cc0-9c4be9197e12 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:11.302696 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 902/1787] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:11 2022] POST /identity/v3/users => generated 309 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:11.307370 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23109fe4-3bb9-45e0-bb95-8e9a96aeb009 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:11.328056 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23109fe4-3bb9-45e0-bb95-8e9a96aeb009 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:11.335065 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83733b63-3394-4c59-9b90-4a576bb564bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:11.335779 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83733b63-3394-4c59-9b90-4a576bb564bc admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:11.336064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83733b63-3394-4c59-9b90-4a576bb564bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:11.336494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83733b63-3394-4c59-9b90-4a576bb564bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:11.337781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83733b63-3394-4c59-9b90-4a576bb564bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:11.355048 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83733b63-3394-4c59-9b90-4a576bb564bc admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:11.370021 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 886/1788] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:11.374136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c83ce3-89eb-4989-9cc0-9c4be9197e12 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:11.392905 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c83ce3-89eb-4989-9cc0-9c4be9197e12 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:11.400901 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ed7b1-c6bb-4ae7-98e5-16d4fafdcf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:11.401825 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ed7b1-c6bb-4ae7-98e5-16d4fafdcf2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:11.410726 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9765bf-64e1-46fc-a2f5-0f632ac1ad2f None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:11.411397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9765bf-64e1-46fc-a2f5-0f632ac1ad2f None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:11.411492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9765bf-64e1-46fc-a2f5-0f632ac1ad2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:11.420562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ed7b1-c6bb-4ae7-98e5-16d4fafdcf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:11.421330 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ed7b1-c6bb-4ae7-98e5-16d4fafdcf2c admin admin] PATH_INFO: `/v3/projects/f54a972b36fe4261a47152097c616dbe/users/55dcd289513b4b60bf28208f9c3d03f5/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:11.457286 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ed7b1-c6bb-4ae7-98e5-16d4fafdcf2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54a972b36fe4261a47152097c616dbe, user_id=55dcd289513b4b60bf28208f9c3d03f5, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:11.460309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ed7b1-c6bb-4ae7-98e5-16d4fafdcf2c admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:11.461178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-bb9765bf-64e1-46fc-a2f5-0f632ac1ad2f None None] MFA Rules not processed for user `9090c22ba9f041e2a8d00750d853435a`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:11.463000 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-bb9765bf-64e1-46fc-a2f5-0f632ac1ad2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:11.472041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:11.557190 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 887/1789] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Jun 22 16:59:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:11.558360 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9765bf-64e1-46fc-a2f5-0f632ac1ad2f None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:11.561157 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-bb9765bf-64e1-46fc-a2f5-0f632ac1ad2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:11.586448 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 903/1790] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:11 2022] PUT /identity/v3/projects/f54a972b36fe4261a47152097c616dbe/users/55dcd289513b4b60bf28208f9c3d03f5/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:11.587433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ed7b1-c6bb-4ae7-98e5-16d4fafdcf2c admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:11.662024 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9765bf-64e1-46fc-a2f5-0f632ac1ad2f None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:11.669837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ed7b1-c6bb-4ae7-98e5-16d4fafdcf2c admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:11.674604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8079667-5fcd-4e17-ae7c-b1a29fe672f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:11.675531 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8079667-5fcd-4e17-ae7c-b1a29fe672f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:11.675811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8079667-5fcd-4e17-ae7c-b1a29fe672f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:11.676265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8079667-5fcd-4e17-ae7c-b1a29fe672f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:11.685456 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8079667-5fcd-4e17-ae7c-b1a29fe672f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:11.687103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8079667-5fcd-4e17-ae7c-b1a29fe672f2 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:11.695764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 904/1791] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:11.696969 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8079667-5fcd-4e17-ae7c-b1a29fe672f2 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:11.733190 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1ba46-9ed3-42dd-bd1d-a024613628b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861452a1dc634bf69ce630d7dcd8a2d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:11.734246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1ba46-9ed3-42dd-bd1d-a024613628b6 service swift] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:11.734546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1ba46-9ed3-42dd-bd1d-a024613628b6 service swift] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:11.734863 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1ba46-9ed3-42dd-bd1d-a024613628b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:11.807824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8079667-5fcd-4e17-ae7c-b1a29fe672f2 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:11.811324 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f37c16-feb9-466e-ad92-792063149a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:11.811917 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f37c16-feb9-466e-ad92-792063149a7d admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:11.813233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f37c16-feb9-466e-ad92-792063149a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:11.813517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f37c16-feb9-466e-ad92-792063149a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:11.815295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f37c16-feb9-466e-ad92-792063149a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:11.819529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f37c16-feb9-466e-ad92-792063149a7d admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:11.832757 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 905/1792] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:11.833534 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f37c16-feb9-466e-ad92-792063149a7d admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:11.837771 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-94f37c16-feb9-466e-ad92-792063149a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:11.853602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f37c16-feb9-466e-ad92-792063149a7d admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:11.875478 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecce8be-82e2-4821-aa01-e4345b04aadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:11.875478 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecce8be-82e2-4821-aa01-e4345b04aadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:11.875478 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecce8be-82e2-4821-aa01-e4345b04aadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:11.875478 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecce8be-82e2-4821-aa01-e4345b04aadf admin admin] PATH_INFO: `/v3/users/86a08a024c634cd2afc91b931103d68c` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:11.875760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecce8be-82e2-4821-aa01-e4345b04aadf admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a08a024c634cd2afc91b931103d68c)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:11.875760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecce8be-82e2-4821-aa01-e4345b04aadf admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:11.921182 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1ba46-9ed3-42dd-bd1d-a024613628b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:11.928827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1ba46-9ed3-42dd-bd1d-a024613628b6 service swift] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:11.968826 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 888/1793] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 16:59:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 16:59:11.969878 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1ba46-9ed3-42dd-bd1d-a024613628b6 service swift] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:12.021510 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1ba46-9ed3-42dd-bd1d-a024613628b6 service swift] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:12.061261 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ac39b-cd79-4671-b03a-303f13453800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:12.062727 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ac39b-cd79-4671-b03a-303f13453800 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:12.065605 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ac39b-cd79-4671-b03a-303f13453800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:12.065952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ac39b-cd79-4671-b03a-303f13453800 admin admin] PATH_INFO: `/v3/projects/f54a972b36fe4261a47152097c616dbe/users/55dcd289513b4b60bf28208f9c3d03f5/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:12.073190 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ac39b-cd79-4671-b03a-303f13453800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f54a972b36fe4261a47152097c616dbe, user_id=55dcd289513b4b60bf28208f9c3d03f5, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:12.078471 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ac39b-cd79-4671-b03a-303f13453800 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:12.141588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 889/1794] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:11 2022] PUT /identity/v3/projects/f54a972b36fe4261a47152097c616dbe/users/55dcd289513b4b60bf28208f9c3d03f5/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:12.142739 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ac39b-cd79-4671-b03a-303f13453800 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:12.149541 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-838ac39b-cd79-4671-b03a-303f13453800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:12.247163 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-7ecce8be-82e2-4821-aa01-e4345b04aadf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a08a024c634cd2afc91b931103d68c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:12.264432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-7ecce8be-82e2-4821-aa01-e4345b04aadf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a08a024c634cd2afc91b931103d68c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:12.265453 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-7ecce8be-82e2-4821-aa01-e4345b04aadf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a08a024c634cd2afc91b931103d68c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:12.328990 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-7ecce8be-82e2-4821-aa01-e4345b04aadf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a08a024c634cd2afc91b931103d68c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:12.343940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-7ecce8be-82e2-4821-aa01-e4345b04aadf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a08a024c634cd2afc91b931103d68c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:12.356717 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ac39b-cd79-4671-b03a-303f13453800 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:12.401997 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37495643-ecde-49ae-9a8f-2227eb6e7426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:12.402909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37495643-ecde-49ae-9a8f-2227eb6e7426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:12.403595 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37495643-ecde-49ae-9a8f-2227eb6e7426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:12.403595 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37495643-ecde-49ae-9a8f-2227eb6e7426 admin admin] PATH_INFO: `/v3/users/72cef5de005841e38e2c449c6d3d93ce` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:12.410505 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37495643-ecde-49ae-9a8f-2227eb6e7426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72cef5de005841e38e2c449c6d3d93ce)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:12.425053 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37495643-ecde-49ae-9a8f-2227eb6e7426 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:12.463027 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 906/1795] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:11 2022] DELETE /identity/v3/users/86a08a024c634cd2afc91b931103d68c => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 16:59:12.469054 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7b05a-c68c-4c8f-9d13-9250b3eecc87 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:12.469415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7b05a-c68c-4c8f-9d13-9250b3eecc87 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:12.469701 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7b05a-c68c-4c8f-9d13-9250b3eecc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:12.503489 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-78a7b05a-c68c-4c8f-9d13-9250b3eecc87 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:12.510030 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-78a7b05a-c68c-4c8f-9d13-9250b3eecc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:12.702659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 907/1796] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:12.782530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7b05a-c68c-4c8f-9d13-9250b3eecc87 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:12.785479 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-78a7b05a-c68c-4c8f-9d13-9250b3eecc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:12.821683 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-37495643-ecde-49ae-9a8f-2227eb6e7426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72cef5de005841e38e2c449c6d3d93ce'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:12.824742 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-37495643-ecde-49ae-9a8f-2227eb6e7426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72cef5de005841e38e2c449c6d3d93ce'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:12.929286 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-37495643-ecde-49ae-9a8f-2227eb6e7426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72cef5de005841e38e2c449c6d3d93ce'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:12.929980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-37495643-ecde-49ae-9a8f-2227eb6e7426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72cef5de005841e38e2c449c6d3d93ce'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:12.953528 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-37495643-ecde-49ae-9a8f-2227eb6e7426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72cef5de005841e38e2c449c6d3d93ce'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:13.015140 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:13.027840 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 890/1797] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:12 2022] DELETE /identity/v3/users/72cef5de005841e38e2c449c6d3d93ce => generated 0 bytes in 885 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:13.034776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd9298-6c93-4c53-89f1-edaedbd4a1e6 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:13.035072 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd9298-6c93-4c53-89f1-edaedbd4a1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:13.037103 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd9298-6c93-4c53-89f1-edaedbd4a1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:13.038684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7b05a-c68c-4c8f-9d13-9250b3eecc87 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:13.107737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-33cd9298-6c93-4c53-89f1-edaedbd4a1e6 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:13.142520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-33cd9298-6c93-4c53-89f1-edaedbd4a1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:13.193536 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d507691-7859-4215-b76c-226c73b03ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:13.196140 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d507691-7859-4215-b76c-226c73b03ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:13.197094 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d507691-7859-4215-b76c-226c73b03ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:13.197094 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d507691-7859-4215-b76c-226c73b03ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:13.202617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-7d507691-7859-4215-b76c-226c73b03ec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:13.391476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d507691-7859-4215-b76c-226c73b03ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:13.416392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d507691-7859-4215-b76c-226c73b03ec5 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:13.442695 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 891/1798] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:13.494781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd9298-6c93-4c53-89f1-edaedbd4a1e6 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:13.500765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-33cd9298-6c93-4c53-89f1-edaedbd4a1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:13.513501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 908/1799] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 733 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:13.559152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd9298-6c93-4c53-89f1-edaedbd4a1e6 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:13.570050 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876dc0a-cf92-4400-829f-1dae1ad0fe38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:13.571834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876dc0a-cf92-4400-829f-1dae1ad0fe38 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:13.573507 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876dc0a-cf92-4400-829f-1dae1ad0fe38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:13.575118 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876dc0a-cf92-4400-829f-1dae1ad0fe38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:13.592253 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876dc0a-cf92-4400-829f-1dae1ad0fe38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:13.593764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876dc0a-cf92-4400-829f-1dae1ad0fe38 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:13.612591 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 892/1800] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:13.698700 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:13.765138 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b444c-8f98-46fd-9e4f-02aa4ff38ec6 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:13.766674 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b444c-8f98-46fd-9e4f-02aa4ff38ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:13.767225 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b444c-8f98-46fd-9e4f-02aa4ff38ec6 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:13.770978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 909/1801] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 16:59:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:59:13.823458 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c4fb8-50c3-47a6-9c9c-164a05ffc5e4 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:13.823996 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c4fb8-50c3-47a6-9c9c-164a05ffc5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:13.824078 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c4fb8-50c3-47a6-9c9c-164a05ffc5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:13.867503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-073c4fb8-50c3-47a6-9c9c-164a05ffc5e4 None None] MFA Rules not processed for user `78e7bdfffdc84465a570d135d1d86380`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:13.869237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-073c4fb8-50c3-47a6-9c9c-164a05ffc5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:14.065890 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 893/1802] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 16:59:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:14.096776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b444c-8f98-46fd-9e4f-02aa4ff38ec6 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:14.098798 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-8b4b444c-8f98-46fd-9e4f-02aa4ff38ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:14.101430 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:14.168573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b444c-8f98-46fd-9e4f-02aa4ff38ec6 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:14.179320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba95da-59a7-4882-8063-26dec0e60591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:14.180273 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba95da-59a7-4882-8063-26dec0e60591 service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:14.181193 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba95da-59a7-4882-8063-26dec0e60591 service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:14.181579 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba95da-59a7-4882-8063-26dec0e60591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:14.220956 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba95da-59a7-4882-8063-26dec0e60591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:14.226547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba95da-59a7-4882-8063-26dec0e60591 service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:14.254821 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 910/1803] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:15.231855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cbe20-5c16-4c7c-9c95-c4f5e611d398 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:15.232416 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cbe20-5c16-4c7c-9c95-c4f5e611d398 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:15.232512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cbe20-5c16-4c7c-9c95-c4f5e611d398 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:15.233996 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 894/1804] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 16:59:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:59:15.286271 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bdf0c-f951-481a-9908-0755dd6702eb None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:15.287161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bdf0c-f951-481a-9908-0755dd6702eb None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:15.287161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bdf0c-f951-481a-9908-0755dd6702eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:15.338392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-616bdf0c-f951-481a-9908-0755dd6702eb None None] MFA Rules not processed for user `78e7bdfffdc84465a570d135d1d86380`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:15.340090 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-616bdf0c-f951-481a-9908-0755dd6702eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:15.366501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 911/1805] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 16:59:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:15.421443 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cbe20-5c16-4c7c-9c95-c4f5e611d398 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:15.423499 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-f04cbe20-5c16-4c7c-9c95-c4f5e611d398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:15.463833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cbe20-5c16-4c7c-9c95-c4f5e611d398 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:15.478325 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7debd-c18d-437e-8b9d-af9e0cdf6785 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:15.479068 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7debd-c18d-437e-8b9d-af9e0cdf6785 service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:15.479422 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7debd-c18d-437e-8b9d-af9e0cdf6785 service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:15.479768 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7debd-c18d-437e-8b9d-af9e0cdf6785 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:15.501877 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7debd-c18d-437e-8b9d-af9e0cdf6785 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:15.504359 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7debd-c18d-437e-8b9d-af9e0cdf6785 service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:15.528802 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 895/1806] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:15.912066 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bdf0c-f951-481a-9908-0755dd6702eb None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:15.913980 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-616bdf0c-f951-481a-9908-0755dd6702eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:15.930253 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bdf0c-f951-481a-9908-0755dd6702eb None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:15.935685 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae369c-e81e-480a-982d-996cb03e169d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:15.939865 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae369c-e81e-480a-982d-996cb03e169d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:15.939865 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae369c-e81e-480a-982d-996cb03e169d admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:15.939865 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae369c-e81e-480a-982d-996cb03e169d admin admin] PATH_INFO: `/v3/projects/51d5cae9464349419c71fed6e935f823` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:15.939865 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae369c-e81e-480a-982d-996cb03e169d admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d5cae9464349419c71fed6e935f823)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:15.940292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae369c-e81e-480a-982d-996cb03e169d admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:15.968074 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7debd-c18d-437e-8b9d-af9e0cdf6785 service nova] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:15.969589 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-45d7debd-c18d-437e-8b9d-af9e0cdf6785 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:15.987012 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7debd-c18d-437e-8b9d-af9e0cdf6785 service nova] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:15.998979 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fd0ed-73f3-4c71-a213-974b4b578c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:15.998979 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fd0ed-73f3-4c71-a213-974b4b578c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:15.998979 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fd0ed-73f3-4c71-a213-974b4b578c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:15.999276 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fd0ed-73f3-4c71-a213-974b4b578c55 admin admin] PATH_INFO: `/v3/projects/6296985ef4d64312b2bd1d8de0a67c08` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:16.001404 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4fd0ed-73f3-4c71-a213-974b4b578c55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6296985ef4d64312b2bd1d8de0a67c08)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:16.008888 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4fd0ed-73f3-4c71-a213-974b4b578c55 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:16.060870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-36ae369c-e81e-480a-982d-996cb03e169d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d5cae9464349419c71fed6e935f823', 'request_id': 'req-36ae369c-e81e-480a-982d-996cb03e169d'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:16.130157 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6a4fd0ed-73f3-4c71-a213-974b4b578c55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6296985ef4d64312b2bd1d8de0a67c08', 'request_id': 'req-6a4fd0ed-73f3-4c71-a213-974b4b578c55'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:16.135413 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-36ae369c-e81e-480a-982d-996cb03e169d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d5cae9464349419c71fed6e935f823', 'request_id': 'req-36ae369c-e81e-480a-982d-996cb03e169d'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:16.147411 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-36ae369c-e81e-480a-982d-996cb03e169d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d5cae9464349419c71fed6e935f823', 'request_id': 'req-36ae369c-e81e-480a-982d-996cb03e169d'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:16.171806 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-36ae369c-e81e-480a-982d-996cb03e169d admin admin] The token cache is being invalidate because project 51d5cae9464349419c71fed6e935f823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:16.172405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-36ae369c-e81e-480a-982d-996cb03e169d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:16.173294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-36ae369c-e81e-480a-982d-996cb03e169d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:16.175320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 912/1807] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:15 2022] DELETE /identity/v3/projects/51d5cae9464349419c71fed6e935f823 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:16.179970 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae369c-e81e-480a-982d-996cb03e169d admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:16.182127 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-36ae369c-e81e-480a-982d-996cb03e169d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:16.208202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6a4fd0ed-73f3-4c71-a213-974b4b578c55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6296985ef4d64312b2bd1d8de0a67c08', 'request_id': 'req-6a4fd0ed-73f3-4c71-a213-974b4b578c55'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:16.215860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6a4fd0ed-73f3-4c71-a213-974b4b578c55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6296985ef4d64312b2bd1d8de0a67c08', 'request_id': 'req-6a4fd0ed-73f3-4c71-a213-974b4b578c55'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:16.231535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6a4fd0ed-73f3-4c71-a213-974b4b578c55 admin admin] The token cache is being invalidate because project 6296985ef4d64312b2bd1d8de0a67c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:16.232114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6a4fd0ed-73f3-4c71-a213-974b4b578c55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:16.233232 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6a4fd0ed-73f3-4c71-a213-974b4b578c55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:16.235094 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 896/1808] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:15 2022] DELETE /identity/v3/projects/6296985ef4d64312b2bd1d8de0a67c08 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 16:59:16.236386 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79c955-c03f-4cfb-a647-a11a1783c496 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:16.236674 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79c955-c03f-4cfb-a647-a11a1783c496 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:16.236956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79c955-c03f-4cfb-a647-a11a1783c496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:16.259331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae369c-e81e-480a-982d-996cb03e169d admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:16.266834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-8d79c955-c03f-4cfb-a647-a11a1783c496 None None] MFA Rules not processed for user `55dcd289513b4b60bf28208f9c3d03f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:16.268308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-8d79c955-c03f-4cfb-a647-a11a1783c496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:16.322178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698b33f-f235-4920-b85a-2d6beb3089db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:16.323182 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698b33f-f235-4920-b85a-2d6beb3089db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:16.323527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698b33f-f235-4920-b85a-2d6beb3089db admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:16.323898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698b33f-f235-4920-b85a-2d6beb3089db admin admin] PATH_INFO: `/v3/users/bf031267a1a14fcba3cbbbec1dd136a7` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:16.325264 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698b33f-f235-4920-b85a-2d6beb3089db admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf031267a1a14fcba3cbbbec1dd136a7)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:16.327339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698b33f-f235-4920-b85a-2d6beb3089db admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:16.347518 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 897/1809] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:16 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:16.347518 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79c955-c03f-4cfb-a647-a11a1783c496 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:16.347518 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-8d79c955-c03f-4cfb-a647-a11a1783c496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:16.362095 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79c955-c03f-4cfb-a647-a11a1783c496 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:16.368041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65f9c8-e074-4ece-bf0c-e0790854f36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:16.373100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65f9c8-e074-4ece-bf0c-e0790854f36b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:16.373100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65f9c8-e074-4ece-bf0c-e0790854f36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:16.373100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65f9c8-e074-4ece-bf0c-e0790854f36b admin admin] PATH_INFO: `/v3/users/2093fb6c993d466186e02f1e1a3d7308` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:16.373100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65f9c8-e074-4ece-bf0c-e0790854f36b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2093fb6c993d466186e02f1e1a3d7308)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:16.375050 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65f9c8-e074-4ece-bf0c-e0790854f36b admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:16.563359 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4698b33f-f235-4920-b85a-2d6beb3089db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf031267a1a14fcba3cbbbec1dd136a7'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:16.571259 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4698b33f-f235-4920-b85a-2d6beb3089db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf031267a1a14fcba3cbbbec1dd136a7'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:16.571912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4698b33f-f235-4920-b85a-2d6beb3089db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf031267a1a14fcba3cbbbec1dd136a7'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:16.583487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4698b33f-f235-4920-b85a-2d6beb3089db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf031267a1a14fcba3cbbbec1dd136a7'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:16.584176 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4698b33f-f235-4920-b85a-2d6beb3089db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf031267a1a14fcba3cbbbec1dd136a7'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:16.645174 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-bf65f9c8-e074-4ece-bf0c-e0790854f36b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2093fb6c993d466186e02f1e1a3d7308'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:16.645998 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-bf65f9c8-e074-4ece-bf0c-e0790854f36b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2093fb6c993d466186e02f1e1a3d7308'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:16.676080 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 913/1810] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:16 2022] DELETE /identity/v3/users/bf031267a1a14fcba3cbbbec1dd136a7 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:16.761292 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-bf65f9c8-e074-4ece-bf0c-e0790854f36b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2093fb6c993d466186e02f1e1a3d7308'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:16.762426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-bf65f9c8-e074-4ece-bf0c-e0790854f36b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2093fb6c993d466186e02f1e1a3d7308'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:16.779824 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-bf65f9c8-e074-4ece-bf0c-e0790854f36b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2093fb6c993d466186e02f1e1a3d7308'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:16.792876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 898/1811] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:16 2022] DELETE /identity/v3/users/2093fb6c993d466186e02f1e1a3d7308 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:17.093917 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b8a43-00a6-48f4-9b28-a36ac1376c0d None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:17.094218 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b8a43-00a6-48f4-9b28-a36ac1376c0d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:17.094509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b8a43-00a6-48f4-9b28-a36ac1376c0d None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:17.095903 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 914/1812] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 16:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:59:17.109405 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9894bd9-3b18-4c01-891c-357484cde2b3 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:17.109697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9894bd9-3b18-4c01-891c-357484cde2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:17.110356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9894bd9-3b18-4c01-891c-357484cde2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:17.143474 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-f9894bd9-3b18-4c01-891c-357484cde2b3 None None] MFA Rules not processed for user `5a79a71fa89446c3abbb4fdbf2c93aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:17.149879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-f9894bd9-3b18-4c01-891c-357484cde2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:17.246383 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 899/1813] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 16:59:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:17.289092 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b8a43-00a6-48f4-9b28-a36ac1376c0d None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:17.290592 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2e8b8a43-00a6-48f4-9b28-a36ac1376c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:17.307056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b8a43-00a6-48f4-9b28-a36ac1376c0d None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:17.312584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2a2a0-3c19-4ebf-885f-cdaaf7665fc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79a71fa89446c3abbb4fdbf2c93aac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:17.313333 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2a2a0-3c19-4ebf-885f-cdaaf7665fc2 service placement] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:17.313693 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2a2a0-3c19-4ebf-885f-cdaaf7665fc2 service placement] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:17.314048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2a2a0-3c19-4ebf-885f-cdaaf7665fc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:17.323947 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2a2a0-3c19-4ebf-885f-cdaaf7665fc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:17.325588 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2a2a0-3c19-4ebf-885f-cdaaf7665fc2 service placement] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:17.336155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 915/1814] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:17.396560 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9894bd9-3b18-4c01-891c-357484cde2b3 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:17.396560 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-f9894bd9-3b18-4c01-891c-357484cde2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:17.430311 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2a2a0-3c19-4ebf-885f-cdaaf7665fc2 service placement] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:17.432259 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-bce2a2a0-3c19-4ebf-885f-cdaaf7665fc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:17.501856 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9894bd9-3b18-4c01-891c-357484cde2b3 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:17.511655 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdebaf-bda8-4304-946b-953e52b2aaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:17.512689 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdebaf-bda8-4304-946b-953e52b2aaf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:17.512984 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdebaf-bda8-4304-946b-953e52b2aaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:17.513259 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdebaf-bda8-4304-946b-953e52b2aaf8 admin admin] PATH_INFO: `/v3/projects/207ee2da0b784375be0b172dff172537` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:17.514491 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdebaf-bda8-4304-946b-953e52b2aaf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=207ee2da0b784375be0b172dff172537)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:17.517145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdebaf-bda8-4304-946b-953e52b2aaf8 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:17.583694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2a2a0-3c19-4ebf-885f-cdaaf7665fc2 service placement] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:17.589151 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb526028-19e3-427d-b8e0-b3fce0e9d551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:17.590159 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb526028-19e3-427d-b8e0-b3fce0e9d551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:17.590626 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb526028-19e3-427d-b8e0-b3fce0e9d551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:17.590914 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb526028-19e3-427d-b8e0-b3fce0e9d551 admin admin] PATH_INFO: `/v3/projects/0d16b81c0b054c30a5167b77070122e0` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:17.592211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb526028-19e3-427d-b8e0-b3fce0e9d551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d16b81c0b054c30a5167b77070122e0)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:17.594157 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb526028-19e3-427d-b8e0-b3fce0e9d551 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:17.749016 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-62fdebaf-bda8-4304-946b-953e52b2aaf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '207ee2da0b784375be0b172dff172537', 'request_id': 'req-62fdebaf-bda8-4304-946b-953e52b2aaf8'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:17.920593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-cb526028-19e3-427d-b8e0-b3fce0e9d551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d16b81c0b054c30a5167b77070122e0', 'request_id': 'req-cb526028-19e3-427d-b8e0-b3fce0e9d551'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:18.003031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-62fdebaf-bda8-4304-946b-953e52b2aaf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '207ee2da0b784375be0b172dff172537', 'request_id': 'req-62fdebaf-bda8-4304-946b-953e52b2aaf8'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:18.015821 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-62fdebaf-bda8-4304-946b-953e52b2aaf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '207ee2da0b784375be0b172dff172537', 'request_id': 'req-62fdebaf-bda8-4304-946b-953e52b2aaf8'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:18.036839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-62fdebaf-bda8-4304-946b-953e52b2aaf8 admin admin] The token cache is being invalidate because project 207ee2da0b784375be0b172dff172537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:18.037134 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-62fdebaf-bda8-4304-946b-953e52b2aaf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:18.037854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-62fdebaf-bda8-4304-946b-953e52b2aaf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:18.039487 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 900/1815] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:17 2022] DELETE /identity/v3/projects/207ee2da0b784375be0b172dff172537 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:18.044916 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eed737-4916-45dc-ac8b-bb5417faafa1 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:18.045383 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eed737-4916-45dc-ac8b-bb5417faafa1 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:18.046531 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eed737-4916-45dc-ac8b-bb5417faafa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:18.067085 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-cb526028-19e3-427d-b8e0-b3fce0e9d551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d16b81c0b054c30a5167b77070122e0', 'request_id': 'req-cb526028-19e3-427d-b8e0-b3fce0e9d551'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:18.078241 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-cb526028-19e3-427d-b8e0-b3fce0e9d551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d16b81c0b054c30a5167b77070122e0', 'request_id': 'req-cb526028-19e3-427d-b8e0-b3fce0e9d551'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:18.078375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-34eed737-4916-45dc-ac8b-bb5417faafa1 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:18.078375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-34eed737-4916-45dc-ac8b-bb5417faafa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:18.106611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-cb526028-19e3-427d-b8e0-b3fce0e9d551 admin admin] The token cache is being invalidate because project 0d16b81c0b054c30a5167b77070122e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:18.111633 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-cb526028-19e3-427d-b8e0-b3fce0e9d551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:18.111633 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-cb526028-19e3-427d-b8e0-b3fce0e9d551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:18.111633 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 916/1816] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:17 2022] DELETE /identity/v3/projects/0d16b81c0b054c30a5167b77070122e0 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:18.115639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a922f-4e48-4215-8a80-92da458c70ea None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:18.115940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a922f-4e48-4215-8a80-92da458c70ea None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:18.116303 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a922f-4e48-4215-8a80-92da458c70ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:18.170160 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 901/1817] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:59:18.191752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1f069-a6d6-44ab-bdd6-2c8d45c0c0d6 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:18.192037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1f069-a6d6-44ab-bdd6-2c8d45c0c0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:18.192673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1f069-a6d6-44ab-bdd6-2c8d45c0c0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:18.225179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-55c1f069-a6d6-44ab-bdd6-2c8d45c0c0d6 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:18.226649 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-55c1f069-a6d6-44ab-bdd6-2c8d45c0c0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:18.237414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 902/1818] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:18.243020 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1f069-a6d6-44ab-bdd6-2c8d45c0c0d6 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:18.255166 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1f069-a6d6-44ab-bdd6-2c8d45c0c0d6 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:18.261124 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da23e34-6db6-4e74-82a6-5d1ac19af850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:18.262060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da23e34-6db6-4e74-82a6-5d1ac19af850 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:18.262441 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da23e34-6db6-4e74-82a6-5d1ac19af850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:18.262967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da23e34-6db6-4e74-82a6-5d1ac19af850 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:18.263968 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da23e34-6db6-4e74-82a6-5d1ac19af850 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:59:18.264624 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da23e34-6db6-4e74-82a6-5d1ac19af850 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:18.266326 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da23e34-6db6-4e74-82a6-5d1ac19af850 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:18.286856 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 903/1819] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:59:18.288194 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da23e34-6db6-4e74-82a6-5d1ac19af850 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:18.313017 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da23e34-6db6-4e74-82a6-5d1ac19af850 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:18.321376 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:18.325855 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-d72a922f-4e48-4215-8a80-92da458c70ea None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:18.327091 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e79d3-4085-4b44-a9dd-5752d0d32595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:18.327228 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d72a922f-4e48-4215-8a80-92da458c70ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:18.327898 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e79d3-4085-4b44-a9dd-5752d0d32595 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:18.328242 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e79d3-4085-4b44-a9dd-5752d0d32595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:18.328505 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e79d3-4085-4b44-a9dd-5752d0d32595 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:18.329331 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e79d3-4085-4b44-a9dd-5752d0d32595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:18.331486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e79d3-4085-4b44-a9dd-5752d0d32595 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:18.336320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 917/1820] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:18.345565 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bba77-aa7e-4ebc-9984-d0b3f48252a7 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:18.345853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bba77-aa7e-4ebc-9984-d0b3f48252a7 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:18.346133 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bba77-aa7e-4ebc-9984-d0b3f48252a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:18.368240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-a54bba77-aa7e-4ebc-9984-d0b3f48252a7 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:18.369740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-a54bba77-aa7e-4ebc-9984-d0b3f48252a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:18.378427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 918/1821] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:18.379355 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bba77-aa7e-4ebc-9984-d0b3f48252a7 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:18.380703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-a54bba77-aa7e-4ebc-9984-d0b3f48252a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:18.393526 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bba77-aa7e-4ebc-9984-d0b3f48252a7 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:18.398867 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b7cac-eea2-4305-aabc-e040afaf40c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:18.399761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b7cac-eea2-4305-aabc-e040afaf40c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:18.400073 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b7cac-eea2-4305-aabc-e040afaf40c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:18.400348 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b7cac-eea2-4305-aabc-e040afaf40c5 admin admin] PATH_INFO: `/v3/users/46c80a0e0a44454db55e269ba69f7ed3` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:18.401825 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b7cac-eea2-4305-aabc-e040afaf40c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46c80a0e0a44454db55e269ba69f7ed3)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:18.403729 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b7cac-eea2-4305-aabc-e040afaf40c5 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:18.433371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 904/1822] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:18 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:18.434064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e79d3-4085-4b44-a9dd-5752d0d32595 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:18.457058 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:18.499886 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e79d3-4085-4b44-a9dd-5752d0d32595 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:18.505529 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c982d9-6e33-46bc-a87b-269e436f2da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:18.506300 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c982d9-6e33-46bc-a87b-269e436f2da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:18.506585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c982d9-6e33-46bc-a87b-269e436f2da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:18.506901 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c982d9-6e33-46bc-a87b-269e436f2da7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:18.507697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c982d9-6e33-46bc-a87b-269e436f2da7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:59:18.508057 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c982d9-6e33-46bc-a87b-269e436f2da7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:18.509745 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c982d9-6e33-46bc-a87b-269e436f2da7 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:18.523476 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 905/1823] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:59:18.524512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c982d9-6e33-46bc-a87b-269e436f2da7 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:18.535700 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c982d9-6e33-46bc-a87b-269e436f2da7 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:18.541089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d4783-9937-4358-b888-fd6ccce2a37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:18.541753 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d4783-9937-4358-b888-fd6ccce2a37e admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:18.542039 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d4783-9937-4358-b888-fd6ccce2a37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:18.542316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d4783-9937-4358-b888-fd6ccce2a37e admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:18.543018 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d4783-9937-4358-b888-fd6ccce2a37e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:18.544987 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d4783-9937-4358-b888-fd6ccce2a37e admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:18.637767 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 906/1824] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:18 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:18.638930 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d4783-9937-4358-b888-fd6ccce2a37e admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:18.643710 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c77b7cac-eea2-4305-aabc-e040afaf40c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46c80a0e0a44454db55e269ba69f7ed3'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:18.650353 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d4783-9937-4358-b888-fd6ccce2a37e admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:18.655278 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b13982-134b-4783-916e-fb8e4073297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:18.659108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b13982-134b-4783-916e-fb8e4073297f admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:18.659108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b13982-134b-4783-916e-fb8e4073297f admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:18.659108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b13982-134b-4783-916e-fb8e4073297f admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:18.659108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b13982-134b-4783-916e-fb8e4073297f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:18.659576 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b13982-134b-4783-916e-fb8e4073297f admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:18.663118 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c77b7cac-eea2-4305-aabc-e040afaf40c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46c80a0e0a44454db55e269ba69f7ed3'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:18.664590 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c77b7cac-eea2-4305-aabc-e040afaf40c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46c80a0e0a44454db55e269ba69f7ed3'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:18.676976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c77b7cac-eea2-4305-aabc-e040afaf40c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46c80a0e0a44454db55e269ba69f7ed3'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:18.677647 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c77b7cac-eea2-4305-aabc-e040afaf40c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46c80a0e0a44454db55e269ba69f7ed3'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:18.751086 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 907/1825] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:18 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:18.751086 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b13982-134b-4783-916e-fb8e4073297f admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:18.751086 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-22b13982-134b-4783-916e-fb8e4073297f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:18.759780 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 919/1826] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:18 2022] DELETE /identity/v3/users/46c80a0e0a44454db55e269ba69f7ed3 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:18.760790 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b7cac-eea2-4305-aabc-e040afaf40c5 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:18.762131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c77b7cac-eea2-4305-aabc-e040afaf40c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:18.829717 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b13982-134b-4783-916e-fb8e4073297f admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:18.847025 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b7cac-eea2-4305-aabc-e040afaf40c5 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:18.852378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e43d7d-be5f-431c-b32c-0db6feab771f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:18.857456 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e43d7d-be5f-431c-b32c-0db6feab771f admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:18.857456 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e43d7d-be5f-431c-b32c-0db6feab771f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:18.857456 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e43d7d-be5f-431c-b32c-0db6feab771f admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:18.857456 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e43d7d-be5f-431c-b32c-0db6feab771f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:18.857456 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e43d7d-be5f-431c-b32c-0db6feab771f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:18.889980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843edff-8e35-4e85-ac23-6fff7e6316d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:18.890650 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843edff-8e35-4e85-ac23-6fff7e6316d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:18.890976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843edff-8e35-4e85-ac23-6fff7e6316d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:18.891236 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843edff-8e35-4e85-ac23-6fff7e6316d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:18.892080 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843edff-8e35-4e85-ac23-6fff7e6316d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:18.893740 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843edff-8e35-4e85-ac23-6fff7e6316d2 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:18.904485 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 908/1827] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:18.914221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843edff-8e35-4e85-ac23-6fff7e6316d2 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:18.923908 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843edff-8e35-4e85-ac23-6fff7e6316d2 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:18.928713 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426e4e7-17b4-4b7b-b430-e865de05177c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:18.929355 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426e4e7-17b4-4b7b-b430-e865de05177c admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:18.929641 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426e4e7-17b4-4b7b-b430-e865de05177c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:18.929926 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426e4e7-17b4-4b7b-b430-e865de05177c admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:18.930648 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426e4e7-17b4-4b7b-b430-e865de05177c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:18.932262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426e4e7-17b4-4b7b-b430-e865de05177c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:18.941972 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 909/1828] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 16:59:18.946393 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426e4e7-17b4-4b7b-b430-e865de05177c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:18.955815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426e4e7-17b4-4b7b-b430-e865de05177c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:18.957670 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 920/1829] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:18 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:18.961538 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e43d7d-be5f-431c-b32c-0db6feab771f admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:18.961668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027de8a7-16f4-42f2-91d2-8b65726a2134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:18.962495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027de8a7-16f4-42f2-91d2-8b65726a2134 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:18.962799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027de8a7-16f4-42f2-91d2-8b65726a2134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:18.963077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027de8a7-16f4-42f2-91d2-8b65726a2134 admin admin] PATH_INFO: `/v3/projects/33e40ecd191c45888263248c1764dc26/users/38bf6bb46b3b406fb4e9d19ce2af32e4/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:18.972909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e43d7d-be5f-431c-b32c-0db6feab771f admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:18.977880 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d0a84-c648-4bcc-aafb-07084726ff01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:18.978551 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d0a84-c648-4bcc-aafb-07084726ff01 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:18.978833 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d0a84-c648-4bcc-aafb-07084726ff01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:18.979106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d0a84-c648-4bcc-aafb-07084726ff01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:18.980133 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d0a84-c648-4bcc-aafb-07084726ff01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:18.980800 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027de8a7-16f4-42f2-91d2-8b65726a2134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e40ecd191c45888263248c1764dc26, user_id=38bf6bb46b3b406fb4e9d19ce2af32e4, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:18.981755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d0a84-c648-4bcc-aafb-07084726ff01 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:18.983613 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027de8a7-16f4-42f2-91d2-8b65726a2134 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:18.992986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 921/1830] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 16:59:18.997997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d0a84-c648-4bcc-aafb-07084726ff01 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:19.011239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d0a84-c648-4bcc-aafb-07084726ff01 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:19.017533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c4a74-b3db-411d-bea8-c1cb51fce5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:19.018405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c4a74-b3db-411d-bea8-c1cb51fce5ae admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:19.018816 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c4a74-b3db-411d-bea8-c1cb51fce5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:19.019156 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c4a74-b3db-411d-bea8-c1cb51fce5ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:19.020190 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c4a74-b3db-411d-bea8-c1cb51fce5ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:19.022121 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c4a74-b3db-411d-bea8-c1cb51fce5ae admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:19.046339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 922/1831] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 16:59:19.046339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c4a74-b3db-411d-bea8-c1cb51fce5ae admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:19.050985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-516c4a74-b3db-411d-bea8-c1cb51fce5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:19.064674 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c4a74-b3db-411d-bea8-c1cb51fce5ae admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:19.070768 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b658ad6-d526-43ec-9c73-adb4bb575995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:19.072547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b658ad6-d526-43ec-9c73-adb4bb575995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:19.072547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b658ad6-d526-43ec-9c73-adb4bb575995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:19.072547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b658ad6-d526-43ec-9c73-adb4bb575995 admin admin] PATH_INFO: `/v3/projects/5447eb2871cc4949ba911c8d481a4603` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:19.073574 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b658ad6-d526-43ec-9c73-adb4bb575995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5447eb2871cc4949ba911c8d481a4603)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:19.076197 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b658ad6-d526-43ec-9c73-adb4bb575995 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:19.078052 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 910/1832] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:18 2022] PUT /identity/v3/projects/33e40ecd191c45888263248c1764dc26/users/38bf6bb46b3b406fb4e9d19ce2af32e4/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 16:59:19.078907 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027de8a7-16f4-42f2-91d2-8b65726a2134 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:19.139774 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027de8a7-16f4-42f2-91d2-8b65726a2134 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:19.144464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d35a13-4a26-4c6e-ae9d-1f4ef9c97d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:19.145356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d35a13-4a26-4c6e-ae9d-1f4ef9c97d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:19.145642 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d35a13-4a26-4c6e-ae9d-1f4ef9c97d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:19.145925 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d35a13-4a26-4c6e-ae9d-1f4ef9c97d54 admin admin] PATH_INFO: `/v3/projects/3ac89c1bef804ac4966f57ad54694aa7/users/94dbcb1a84c74ffaa34f1909032a0bdb/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:19.161921 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d35a13-4a26-4c6e-ae9d-1f4ef9c97d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ac89c1bef804ac4966f57ad54694aa7, user_id=94dbcb1a84c74ffaa34f1909032a0bdb, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:19.165632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d35a13-4a26-4c6e-ae9d-1f4ef9c97d54 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:19.176414 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-2b658ad6-d526-43ec-9c73-adb4bb575995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5447eb2871cc4949ba911c8d481a4603', 'request_id': 'req-2b658ad6-d526-43ec-9c73-adb4bb575995'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:19.275245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-2b658ad6-d526-43ec-9c73-adb4bb575995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5447eb2871cc4949ba911c8d481a4603', 'request_id': 'req-2b658ad6-d526-43ec-9c73-adb4bb575995'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:19.281597 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 911/1833] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:19 2022] PUT /identity/v3/projects/3ac89c1bef804ac4966f57ad54694aa7/users/94dbcb1a84c74ffaa34f1909032a0bdb/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:19.283170 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-2b658ad6-d526-43ec-9c73-adb4bb575995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5447eb2871cc4949ba911c8d481a4603', 'request_id': 'req-2b658ad6-d526-43ec-9c73-adb4bb575995'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:19.289876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2bec7-0285-449e-9956-ee626e310f18 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:19.289876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2bec7-0285-449e-9956-ee626e310f18 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:19.289876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2bec7-0285-449e-9956-ee626e310f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:19.293937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-2b658ad6-d526-43ec-9c73-adb4bb575995 admin admin] The token cache is being invalidate because project 5447eb2871cc4949ba911c8d481a4603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:19.294231 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-2b658ad6-d526-43ec-9c73-adb4bb575995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:19.294919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-2b658ad6-d526-43ec-9c73-adb4bb575995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:19.296504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 923/1834] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:19 2022] DELETE /identity/v3/projects/5447eb2871cc4949ba911c8d481a4603 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:19.298788 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f57589-dc7a-4860-b555-5d73c3485818 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:19.299083 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f57589-dc7a-4860-b555-5d73c3485818 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:19.299361 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f57589-dc7a-4860-b555-5d73c3485818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:19.300845 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-81b2bec7-0285-449e-9956-ee626e310f18 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:19.302065 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-81b2bec7-0285-449e-9956-ee626e310f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:19.325922 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-32f57589-dc7a-4860-b555-5d73c3485818 None None] MFA Rules not processed for user `94dbcb1a84c74ffaa34f1909032a0bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:19.327118 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-32f57589-dc7a-4860-b555-5d73c3485818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:19.386765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 912/1835] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:19.386765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2bec7-0285-449e-9956-ee626e310f18 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:19.386765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-81b2bec7-0285-449e-9956-ee626e310f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:19.397800 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2bec7-0285-449e-9956-ee626e310f18 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:19.402772 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c178ca-2de0-4990-9fd5-bf4beb82cb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:19.403639 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c178ca-2de0-4990-9fd5-bf4beb82cb6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:19.403937 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c178ca-2de0-4990-9fd5-bf4beb82cb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:19.404227 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c178ca-2de0-4990-9fd5-bf4beb82cb6c admin admin] PATH_INFO: `/v3/users/55dcd289513b4b60bf28208f9c3d03f5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:19.405441 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c178ca-2de0-4990-9fd5-bf4beb82cb6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=55dcd289513b4b60bf28208f9c3d03f5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:19.407365 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c178ca-2de0-4990-9fd5-bf4beb82cb6c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:19.428337 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 924/1836] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:59:19.429596 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f57589-dc7a-4860-b555-5d73c3485818 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:19.430887 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-32f57589-dc7a-4860-b555-5d73c3485818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:19.485923 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f57589-dc7a-4860-b555-5d73c3485818 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:19.491745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26108cae-e0e2-43e5-8878-4fb497be21f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:19.491745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26108cae-e0e2-43e5-8878-4fb497be21f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:19.491745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26108cae-e0e2-43e5-8878-4fb497be21f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:19.491745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26108cae-e0e2-43e5-8878-4fb497be21f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:19.502490 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26108cae-e0e2-43e5-8878-4fb497be21f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:19.504190 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26108cae-e0e2-43e5-8878-4fb497be21f4 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:19.515849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 925/1837] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:19.520441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26108cae-e0e2-43e5-8878-4fb497be21f4 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:19.520441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-26108cae-e0e2-43e5-8878-4fb497be21f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:19.533064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26108cae-e0e2-43e5-8878-4fb497be21f4 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:19.538282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe43c15-ce27-4daf-8bf1-72188daee444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:19.539032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe43c15-ce27-4daf-8bf1-72188daee444 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:19.539396 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe43c15-ce27-4daf-8bf1-72188daee444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:19.539748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe43c15-ce27-4daf-8bf1-72188daee444 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:19.540554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe43c15-ce27-4daf-8bf1-72188daee444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:19.542581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe43c15-ce27-4daf-8bf1-72188daee444 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:19.942276 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-b4c178ca-2de0-4990-9fd5-bf4beb82cb6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55dcd289513b4b60bf28208f9c3d03f5'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:19.943153 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-b4c178ca-2de0-4990-9fd5-bf4beb82cb6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55dcd289513b4b60bf28208f9c3d03f5'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:20.004178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 926/1838] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:19 2022] POST /identity/v3/projects => generated 385 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:20.005103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe43c15-ce27-4daf-8bf1-72188daee444 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:20.006811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2fe43c15-ce27-4daf-8bf1-72188daee444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:20.020630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-b4c178ca-2de0-4990-9fd5-bf4beb82cb6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55dcd289513b4b60bf28208f9c3d03f5'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:20.021377 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-b4c178ca-2de0-4990-9fd5-bf4beb82cb6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55dcd289513b4b60bf28208f9c3d03f5'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:20.037946 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-b4c178ca-2de0-4990-9fd5-bf4beb82cb6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55dcd289513b4b60bf28208f9c3d03f5'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:20.060681 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 913/1839] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:19 2022] DELETE /identity/v3/users/55dcd289513b4b60bf28208f9c3d03f5 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:20.161939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe43c15-ce27-4daf-8bf1-72188daee444 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:20.268581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102f61a-120c-4861-96d7-d9af8f4a4b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:20.270348 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102f61a-120c-4861-96d7-d9af8f4a4b92 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:20.270348 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102f61a-120c-4861-96d7-d9af8f4a4b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:20.270843 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102f61a-120c-4861-96d7-d9af8f4a4b92 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:20.271993 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102f61a-120c-4861-96d7-d9af8f4a4b92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:20.274905 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102f61a-120c-4861-96d7-d9af8f4a4b92 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:20.374899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 927/1840] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:20 2022] POST /identity/v3/users => generated 299 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:20.379291 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c178ca-2de0-4990-9fd5-bf4beb82cb6c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:20.393512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c178ca-2de0-4990-9fd5-bf4beb82cb6c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:20.398861 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4e619-c6ce-40a3-b25f-241f4c784ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:20.400050 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4e619-c6ce-40a3-b25f-241f4c784ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:20.400050 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4e619-c6ce-40a3-b25f-241f4c784ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:20.400050 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4e619-c6ce-40a3-b25f-241f4c784ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:20.400859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4e619-c6ce-40a3-b25f-241f4c784ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:20.402721 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4e619-c6ce-40a3-b25f-241f4c784ba7 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:20.414298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 914/1841] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 16:59:20.418382 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102f61a-120c-4861-96d7-d9af8f4a4b92 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:20.431118 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102f61a-120c-4861-96d7-d9af8f4a4b92 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:20.437030 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea86f17-33c6-45d3-a0bd-9d1989075a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:20.439772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea86f17-33c6-45d3-a0bd-9d1989075a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:20.439772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea86f17-33c6-45d3-a0bd-9d1989075a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:20.439772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea86f17-33c6-45d3-a0bd-9d1989075a05 admin admin] PATH_INFO: `/v3/projects/2a663ab26b4b492ba07e51daa0878815/users/1c9d7c3899ca4226bc1cf2076887a291/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:20.478041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4e619-c6ce-40a3-b25f-241f4c784ba7 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:20.478219 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea86f17-33c6-45d3-a0bd-9d1989075a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a663ab26b4b492ba07e51daa0878815, user_id=1c9d7c3899ca4226bc1cf2076887a291, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:20.478323 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-52a4e619-c6ce-40a3-b25f-241f4c784ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:20.478465 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea86f17-33c6-45d3-a0bd-9d1989075a05 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:20.487339 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4e619-c6ce-40a3-b25f-241f4c784ba7 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:20.492830 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c0767-3e38-4b3b-b1b2-2e72862bf6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:20.497304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c0767-3e38-4b3b-b1b2-2e72862bf6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:20.497304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c0767-3e38-4b3b-b1b2-2e72862bf6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:20.497304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c0767-3e38-4b3b-b1b2-2e72862bf6ea admin admin] PATH_INFO: `/v3/projects/f54a972b36fe4261a47152097c616dbe` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:20.497304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c0767-3e38-4b3b-b1b2-2e72862bf6ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=f54a972b36fe4261a47152097c616dbe)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:20.498654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c0767-3e38-4b3b-b1b2-2e72862bf6ea admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:20.724900 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 928/1842] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:20 2022] PUT /identity/v3/projects/2a663ab26b4b492ba07e51daa0878815/users/1c9d7c3899ca4226bc1cf2076887a291/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:20.727767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea86f17-33c6-45d3-a0bd-9d1989075a05 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:20.831918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea86f17-33c6-45d3-a0bd-9d1989075a05 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:20.857989 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689ac61-e919-4e4d-825b-b9087ef50118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:20.859709 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689ac61-e919-4e4d-825b-b9087ef50118 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:20.860307 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689ac61-e919-4e4d-825b-b9087ef50118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:20.863828 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689ac61-e919-4e4d-825b-b9087ef50118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:20.865838 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f76c0767-3e38-4b3b-b1b2-2e72862bf6ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f54a972b36fe4261a47152097c616dbe', 'request_id': 'req-f76c0767-3e38-4b3b-b1b2-2e72862bf6ea'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:20.867931 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689ac61-e919-4e4d-825b-b9087ef50118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:20.872819 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689ac61-e919-4e4d-825b-b9087ef50118 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:20.891306 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 929/1843] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 16:59:20.898661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689ac61-e919-4e4d-825b-b9087ef50118 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:20.913452 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689ac61-e919-4e4d-825b-b9087ef50118 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:20.951565 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f76c0767-3e38-4b3b-b1b2-2e72862bf6ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f54a972b36fe4261a47152097c616dbe', 'request_id': 'req-f76c0767-3e38-4b3b-b1b2-2e72862bf6ea'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:20.958065 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f76c0767-3e38-4b3b-b1b2-2e72862bf6ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f54a972b36fe4261a47152097c616dbe', 'request_id': 'req-f76c0767-3e38-4b3b-b1b2-2e72862bf6ea'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:20.970662 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f76c0767-3e38-4b3b-b1b2-2e72862bf6ea admin admin] The token cache is being invalidate because project f54a972b36fe4261a47152097c616dbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:20.970992 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f76c0767-3e38-4b3b-b1b2-2e72862bf6ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:20.971917 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f76c0767-3e38-4b3b-b1b2-2e72862bf6ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:20.985672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 915/1844] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:20 2022] DELETE /identity/v3/projects/f54a972b36fe4261a47152097c616dbe => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:20.989620 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77e8d7-a28f-4fc9-a245-ee00a81bf184 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:20.992205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77e8d7-a28f-4fc9-a245-ee00a81bf184 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:20.992205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77e8d7-a28f-4fc9-a245-ee00a81bf184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:21.000403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1dc07-f5ea-42de-8a63-5afc04489507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:21.003133 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1dc07-f5ea-42de-8a63-5afc04489507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:21.004196 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1dc07-f5ea-42de-8a63-5afc04489507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:21.005767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1dc07-f5ea-42de-8a63-5afc04489507 admin admin] PATH_INFO: `/v3/projects/2a663ab26b4b492ba07e51daa0878815/users/1c9d7c3899ca4226bc1cf2076887a291/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:21.014947 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1dc07-f5ea-42de-8a63-5afc04489507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a663ab26b4b492ba07e51daa0878815, user_id=1c9d7c3899ca4226bc1cf2076887a291, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:21.018283 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1dc07-f5ea-42de-8a63-5afc04489507 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:21.039602 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-ac77e8d7-a28f-4fc9-a245-ee00a81bf184 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:21.041193 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-ac77e8d7-a28f-4fc9-a245-ee00a81bf184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:21.056774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 930/1845] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:20 2022] PUT /identity/v3/projects/2a663ab26b4b492ba07e51daa0878815/users/1c9d7c3899ca4226bc1cf2076887a291/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:21.064401 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556f9e3-0f1a-4d52-97cd-aaff9bed78e1 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:21.064776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556f9e3-0f1a-4d52-97cd-aaff9bed78e1 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:21.065081 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556f9e3-0f1a-4d52-97cd-aaff9bed78e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:21.073617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:21.115724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-d556f9e3-0f1a-4d52-97cd-aaff9bed78e1 None None] MFA Rules not processed for user `1c9d7c3899ca4226bc1cf2076887a291`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:21.119861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d556f9e3-0f1a-4d52-97cd-aaff9bed78e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:21.149716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 916/1846] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:21.151266 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dc36b-616c-4cd7-a0be-41ae6ed282bd None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:21.151857 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dc36b-616c-4cd7-a0be-41ae6ed282bd None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:21.152164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dc36b-616c-4cd7-a0be-41ae6ed282bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:21.198255 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-fc0dc36b-616c-4cd7-a0be-41ae6ed282bd None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:21.200433 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-fc0dc36b-616c-4cd7-a0be-41ae6ed282bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:21.215306 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 917/1847] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:59:21.216914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dc36b-616c-4cd7-a0be-41ae6ed282bd None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:21.237377 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dc36b-616c-4cd7-a0be-41ae6ed282bd None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:21.249267 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d812d9b-beed-45f4-b5a1-58a89ad63ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:21.250773 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d812d9b-beed-45f4-b5a1-58a89ad63ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:21.251071 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d812d9b-beed-45f4-b5a1-58a89ad63ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:21.251401 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d812d9b-beed-45f4-b5a1-58a89ad63ee6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:21.252466 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d812d9b-beed-45f4-b5a1-58a89ad63ee6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:59:21.252466 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d812d9b-beed-45f4-b5a1-58a89ad63ee6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:21.259177 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d812d9b-beed-45f4-b5a1-58a89ad63ee6 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:21.280300 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 918/1848] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:59:21.293053 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d812d9b-beed-45f4-b5a1-58a89ad63ee6 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:21.297733 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 931/1849] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:59:21.298770 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556f9e3-0f1a-4d52-97cd-aaff9bed78e1 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:21.300156 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d556f9e3-0f1a-4d52-97cd-aaff9bed78e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:21.314636 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d812d9b-beed-45f4-b5a1-58a89ad63ee6 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:21.324878 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5b98e-b6d6-47fd-ae1f-36fdbd8ad188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:21.325591 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5b98e-b6d6-47fd-ae1f-36fdbd8ad188 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:21.325880 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5b98e-b6d6-47fd-ae1f-36fdbd8ad188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:21.326158 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5b98e-b6d6-47fd-ae1f-36fdbd8ad188 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:21.327037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5b98e-b6d6-47fd-ae1f-36fdbd8ad188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:21.329022 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c5b98e-b6d6-47fd-ae1f-36fdbd8ad188 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:21.392226 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:21.426865 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556f9e3-0f1a-4d52-97cd-aaff9bed78e1 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:21.432262 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3216f-6fac-49a1-b192-42f1f2fff685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:21.433133 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3216f-6fac-49a1-b192-42f1f2fff685 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:21.433653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3216f-6fac-49a1-b192-42f1f2fff685 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:21.434900 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3216f-6fac-49a1-b192-42f1f2fff685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:21.469550 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3216f-6fac-49a1-b192-42f1f2fff685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:21.472417 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3216f-6fac-49a1-b192-42f1f2fff685 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:21.496162 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 919/1850] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:21 2022] POST /identity/v3/projects => generated 387 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:21.499834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5b98e-b6d6-47fd-ae1f-36fdbd8ad188 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:21.510826 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 932/1851] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 16:59:21.644350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3216f-6fac-49a1-b192-42f1f2fff685 service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:21.645961 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-02e3216f-6fac-49a1-b192-42f1f2fff685 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:21.680867 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3216f-6fac-49a1-b192-42f1f2fff685 service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:21.730688 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5b98e-b6d6-47fd-ae1f-36fdbd8ad188 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:21.759811 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b02e92-5713-4591-9a49-da51a3d46dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:21.760556 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b02e92-5713-4591-9a49-da51a3d46dea admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:21.762044 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b02e92-5713-4591-9a49-da51a3d46dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:21.762344 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b02e92-5713-4591-9a49-da51a3d46dea admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:21.763087 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b02e92-5713-4591-9a49-da51a3d46dea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:21.765162 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b02e92-5713-4591-9a49-da51a3d46dea admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:21.847625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee0ff2-9ea8-40cf-a440-682faa627e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:21.847625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee0ff2-9ea8-40cf-a440-682faa627e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:21.847625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee0ff2-9ea8-40cf-a440-682faa627e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:21.847625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee0ff2-9ea8-40cf-a440-682faa627e26 admin admin] PATH_INFO: `/v3/users/94dbcb1a84c74ffaa34f1909032a0bdb` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:21.848123 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee0ff2-9ea8-40cf-a440-682faa627e26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94dbcb1a84c74ffaa34f1909032a0bdb)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:21.857864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee0ff2-9ea8-40cf-a440-682faa627e26 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:21.888712 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 920/1852] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:21 2022] POST /identity/v3/users => generated 294 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 16:59:21.889679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b02e92-5713-4591-9a49-da51a3d46dea admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:21.914284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b02e92-5713-4591-9a49-da51a3d46dea admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:21.933018 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c73a4d-4afd-45dd-b617-30a08ff5b03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:21.934095 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c73a4d-4afd-45dd-b617-30a08ff5b03c admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:21.934501 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c73a4d-4afd-45dd-b617-30a08ff5b03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:21.935700 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c73a4d-4afd-45dd-b617-30a08ff5b03c admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:21.937504 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c73a4d-4afd-45dd-b617-30a08ff5b03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:21.942404 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c73a4d-4afd-45dd-b617-30a08ff5b03c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:21.958280 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 921/1853] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:21.959435 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c73a4d-4afd-45dd-b617-30a08ff5b03c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:21.978535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c73a4d-4afd-45dd-b617-30a08ff5b03c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:21.985625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c4543-4842-4fab-880f-bb4ed180f778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:21.986583 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c4543-4842-4fab-880f-bb4ed180f778 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:21.987797 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c4543-4842-4fab-880f-bb4ed180f778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:21.988690 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c4543-4842-4fab-880f-bb4ed180f778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:21.989790 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c4543-4842-4fab-880f-bb4ed180f778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:21.993080 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c4543-4842-4fab-880f-bb4ed180f778 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:22.044071 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 922/1854] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:22.049284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c4543-4842-4fab-880f-bb4ed180f778 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:22.078517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c4543-4842-4fab-880f-bb4ed180f778 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:22.094217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca20b74-b8a1-4f4a-b703-9bd33dc495d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:22.097193 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca20b74-b8a1-4f4a-b703-9bd33dc495d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:22.097485 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca20b74-b8a1-4f4a-b703-9bd33dc495d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:22.097932 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca20b74-b8a1-4f4a-b703-9bd33dc495d7 admin admin] PATH_INFO: `/v3/projects/090187c2de004c4487aec177f683e747/users/bb0bbbf4767644439947d5ece1f81e57/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:22.120984 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca20b74-b8a1-4f4a-b703-9bd33dc495d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=090187c2de004c4487aec177f683e747, user_id=bb0bbbf4767644439947d5ece1f81e57, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:22.125756 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca20b74-b8a1-4f4a-b703-9bd33dc495d7 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:22.161085 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-f5ee0ff2-9ea8-40cf-a440-682faa627e26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94dbcb1a84c74ffaa34f1909032a0bdb'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:22.187146 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-f5ee0ff2-9ea8-40cf-a440-682faa627e26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94dbcb1a84c74ffaa34f1909032a0bdb'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:22.191394 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-f5ee0ff2-9ea8-40cf-a440-682faa627e26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94dbcb1a84c74ffaa34f1909032a0bdb'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:22.237758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 923/1855] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:22 2022] PUT /identity/v3/projects/090187c2de004c4487aec177f683e747/users/bb0bbbf4767644439947d5ece1f81e57/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:22.244235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645e012-0c1e-4e2d-8bd9-a7758198a623 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:22.244651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645e012-0c1e-4e2d-8bd9-a7758198a623 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:22.245029 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645e012-0c1e-4e2d-8bd9-a7758198a623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:22.282317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-f5ee0ff2-9ea8-40cf-a440-682faa627e26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94dbcb1a84c74ffaa34f1909032a0bdb'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:22.282317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-f5ee0ff2-9ea8-40cf-a440-682faa627e26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94dbcb1a84c74ffaa34f1909032a0bdb'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:22.306289 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-b645e012-0c1e-4e2d-8bd9-a7758198a623 None None] MFA Rules not processed for user `38bf6bb46b3b406fb4e9d19ce2af32e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:22.314395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b645e012-0c1e-4e2d-8bd9-a7758198a623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:22.410683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 933/1856] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:21 2022] DELETE /identity/v3/users/94dbcb1a84c74ffaa34f1909032a0bdb => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:22.421488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54765c-01be-48b1-8af2-950a4a2ec355 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:22.421488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54765c-01be-48b1-8af2-950a4a2ec355 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:22.421488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54765c-01be-48b1-8af2-950a4a2ec355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:22.491331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-fa54765c-01be-48b1-8af2-950a4a2ec355 None None] MFA Rules not processed for user `bb0bbbf4767644439947d5ece1f81e57`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:22.492317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-fa54765c-01be-48b1-8af2-950a4a2ec355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:22.493028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 924/1857] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:22.495059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf5225-c641-4989-bc3a-3724d926f21f None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:22.495461 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf5225-c641-4989-bc3a-3724d926f21f None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:22.495840 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf5225-c641-4989-bc3a-3724d926f21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:22.556146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-f2cf5225-c641-4989-bc3a-3724d926f21f None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:22.558708 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-f2cf5225-c641-4989-bc3a-3724d926f21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:22.664098 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 934/1858] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:22.669301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54765c-01be-48b1-8af2-950a4a2ec355 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:22.681255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-fa54765c-01be-48b1-8af2-950a4a2ec355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:22.718893 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54765c-01be-48b1-8af2-950a4a2ec355 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:22.724182 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 925/1859] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:22.728851 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393e474-cb9b-4887-a0d2-b27a39300130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:22.729976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf5225-c641-4989-bc3a-3724d926f21f None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:22.730983 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393e474-cb9b-4887-a0d2-b27a39300130 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:22.731443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393e474-cb9b-4887-a0d2-b27a39300130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:22.731910 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393e474-cb9b-4887-a0d2-b27a39300130 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:22.733191 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393e474-cb9b-4887-a0d2-b27a39300130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:22.734722 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-f2cf5225-c641-4989-bc3a-3724d926f21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:22.735633 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393e474-cb9b-4887-a0d2-b27a39300130 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:22.800922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf5225-c641-4989-bc3a-3724d926f21f None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:22.800922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0170df1-f62d-4a12-a8d0-dc9ace482ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:22.800922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0170df1-f62d-4a12-a8d0-dc9ace482ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:22.800922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0170df1-f62d-4a12-a8d0-dc9ace482ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:22.806868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0170df1-f62d-4a12-a8d0-dc9ace482ba9 admin admin] PATH_INFO: `/v3/users/3117f68f5bb641d98a1ea758629570e6` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:22.806868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0170df1-f62d-4a12-a8d0-dc9ace482ba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3117f68f5bb641d98a1ea758629570e6)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:22.806868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0170df1-f62d-4a12-a8d0-dc9ace482ba9 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:23.169397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 935/1860] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:22 2022] POST /identity/v3/projects => generated 371 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:23.170283 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393e474-cb9b-4887-a0d2-b27a39300130 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:23.172198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-6393e474-cb9b-4887-a0d2-b27a39300130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:23.265133 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f0170df1-f62d-4a12-a8d0-dc9ace482ba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3117f68f5bb641d98a1ea758629570e6'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:23.265751 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f0170df1-f62d-4a12-a8d0-dc9ace482ba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3117f68f5bb641d98a1ea758629570e6'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:23.267947 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393e474-cb9b-4887-a0d2-b27a39300130 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:23.279116 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcefc93-e4f3-446a-b81b-cf56194ad4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:23.280136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcefc93-e4f3-446a-b81b-cf56194ad4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:23.280923 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcefc93-e4f3-446a-b81b-cf56194ad4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:23.281487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcefc93-e4f3-446a-b81b-cf56194ad4c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:23.282535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcefc93-e4f3-446a-b81b-cf56194ad4c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:23.285385 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcefc93-e4f3-446a-b81b-cf56194ad4c2 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:23.334261 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f0170df1-f62d-4a12-a8d0-dc9ace482ba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3117f68f5bb641d98a1ea758629570e6'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:23.335527 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f0170df1-f62d-4a12-a8d0-dc9ace482ba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3117f68f5bb641d98a1ea758629570e6'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:23.349391 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f0170df1-f62d-4a12-a8d0-dc9ace482ba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3117f68f5bb641d98a1ea758629570e6'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:23.362086 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 926/1861] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:22 2022] DELETE /identity/v3/users/3117f68f5bb641d98a1ea758629570e6 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:23.362922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0170df1-f62d-4a12-a8d0-dc9ace482ba9 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:23.364309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-f0170df1-f62d-4a12-a8d0-dc9ace482ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:23.437129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 936/1862] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:23 2022] POST /identity/v3/projects => generated 387 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:23.437594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0170df1-f62d-4a12-a8d0-dc9ace482ba9 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:23.437951 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcefc93-e4f3-446a-b81b-cf56194ad4c2 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:23.441118 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-bdcefc93-e4f3-446a-b81b-cf56194ad4c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:23.507498 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e101f1-3885-4f4d-b13a-17448d9a77d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:23.508181 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e101f1-3885-4f4d-b13a-17448d9a77d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:23.508471 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e101f1-3885-4f4d-b13a-17448d9a77d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:23.508749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e101f1-3885-4f4d-b13a-17448d9a77d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:23.511028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-f4e101f1-3885-4f4d-b13a-17448d9a77d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:23.581595 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcefc93-e4f3-446a-b81b-cf56194ad4c2 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:23.586424 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e101f1-3885-4f4d-b13a-17448d9a77d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:23.595916 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81c90b-c2be-4bf9-bafd-d4f65c1870a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:23.596060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e101f1-3885-4f4d-b13a-17448d9a77d0 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:23.596255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81c90b-c2be-4bf9-bafd-d4f65c1870a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:23.596255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81c90b-c2be-4bf9-bafd-d4f65c1870a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:23.596255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81c90b-c2be-4bf9-bafd-d4f65c1870a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:23.596255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81c90b-c2be-4bf9-bafd-d4f65c1870a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:23.596255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81c90b-c2be-4bf9-bafd-d4f65c1870a7 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:23.598059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 927/1863] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:23.599192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303a7fc-3c4e-40df-84d8-c0a5a27abb87 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:23.599476 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303a7fc-3c4e-40df-84d8-c0a5a27abb87 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:23.599783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303a7fc-3c4e-40df-84d8-c0a5a27abb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:23.621673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-8303a7fc-3c4e-40df-84d8-c0a5a27abb87 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:23.621673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-8303a7fc-3c4e-40df-84d8-c0a5a27abb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:23.627146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 928/1864] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:23.627940 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303a7fc-3c4e-40df-84d8-c0a5a27abb87 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:23.635989 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-8303a7fc-3c4e-40df-84d8-c0a5a27abb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:23.649192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303a7fc-3c4e-40df-84d8-c0a5a27abb87 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:23.655304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4e785-6f58-4ba7-8ad4-12dcb04cdecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:23.655991 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4e785-6f58-4ba7-8ad4-12dcb04cdecb admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:23.656314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4e785-6f58-4ba7-8ad4-12dcb04cdecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:23.656596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4e785-6f58-4ba7-8ad4-12dcb04cdecb admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:23.657301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4e785-6f58-4ba7-8ad4-12dcb04cdecb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:23.659234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4e785-6f58-4ba7-8ad4-12dcb04cdecb admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:23.697013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 937/1865] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:23 2022] POST /identity/v3/users => generated 292 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:23.698022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81c90b-c2be-4bf9-bafd-d4f65c1870a7 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:23.718290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81c90b-c2be-4bf9-bafd-d4f65c1870a7 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:23.728708 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b129e-7304-477a-93d2-3040d1d44688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:23.729372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b129e-7304-477a-93d2-3040d1d44688 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:23.729661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b129e-7304-477a-93d2-3040d1d44688 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:23.729955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b129e-7304-477a-93d2-3040d1d44688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:23.749741 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b129e-7304-477a-93d2-3040d1d44688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:23.751219 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b129e-7304-477a-93d2-3040d1d44688 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:23.754681 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 929/1866] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:23 2022] POST /identity/v3/users => generated 300 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:23.755993 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4e785-6f58-4ba7-8ad4-12dcb04cdecb admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:23.773930 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4e785-6f58-4ba7-8ad4-12dcb04cdecb admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:23.781488 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a439498-9ee3-4b95-aef5-84f9c610ebfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:23.788725 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a439498-9ee3-4b95-aef5-84f9c610ebfe admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:23.788725 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a439498-9ee3-4b95-aef5-84f9c610ebfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:23.788939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 938/1867] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:23.789028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a439498-9ee3-4b95-aef5-84f9c610ebfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:23.789110 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b129e-7304-477a-93d2-3040d1d44688 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:23.789258 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a439498-9ee3-4b95-aef5-84f9c610ebfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:23.789258 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a439498-9ee3-4b95-aef5-84f9c610ebfe admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:23.802588 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b129e-7304-477a-93d2-3040d1d44688 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:23.811102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:23.816417 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 930/1868] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:23.819776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7c955-9f29-4608-a5d3-c5c039f40bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:23.820504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c955-9f29-4608-a5d3-c5c039f40bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:23.821098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a439498-9ee3-4b95-aef5-84f9c610ebfe admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:23.821570 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c955-9f29-4608-a5d3-c5c039f40bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:23.821710 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c955-9f29-4608-a5d3-c5c039f40bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:23.823035 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7c955-9f29-4608-a5d3-c5c039f40bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:23.824950 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7c955-9f29-4608-a5d3-c5c039f40bc6 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:23.837201 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 939/1869] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:23.841502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7c955-9f29-4608-a5d3-c5c039f40bc6 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:23.844090 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a439498-9ee3-4b95-aef5-84f9c610ebfe admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:23.859215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352ab94-0b04-4b21-bd69-ca2ab43793a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:23.860234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352ab94-0b04-4b21-bd69-ca2ab43793a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:23.860589 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352ab94-0b04-4b21-bd69-ca2ab43793a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:23.861143 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352ab94-0b04-4b21-bd69-ca2ab43793a6 admin admin] PATH_INFO: `/v3/projects/0e25e5d811364fe2a1abbbe41e1e9547/users/b08fc853a4e547b7a0d886e4a7aa4949/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:23.865056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7c955-9f29-4608-a5d3-c5c039f40bc6 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:23.882283 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f3e21-c900-4cbe-8594-4ae421e90fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:23.883321 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f3e21-c900-4cbe-8594-4ae421e90fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:23.883953 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f3e21-c900-4cbe-8594-4ae421e90fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:23.884339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f3e21-c900-4cbe-8594-4ae421e90fcb admin admin] PATH_INFO: `/v3/projects/0d76dbdc2daa467d9156d3b0aa49a328/users/146a3979566a4bdc9c71b1eeb22ef29f/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:23.894889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352ab94-0b04-4b21-bd69-ca2ab43793a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e25e5d811364fe2a1abbbe41e1e9547, user_id=b08fc853a4e547b7a0d886e4a7aa4949, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:23.898251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352ab94-0b04-4b21-bd69-ca2ab43793a6 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:23.912007 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f3e21-c900-4cbe-8594-4ae421e90fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d76dbdc2daa467d9156d3b0aa49a328, user_id=146a3979566a4bdc9c71b1eeb22ef29f, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:23.917008 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f3e21-c900-4cbe-8594-4ae421e90fcb admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:24.014703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 931/1870] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:23 2022] PUT /identity/v3/projects/0e25e5d811364fe2a1abbbe41e1e9547/users/b08fc853a4e547b7a0d886e4a7aa4949/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:24.019062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352ab94-0b04-4b21-bd69-ca2ab43793a6 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:24.042086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 940/1871] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:23 2022] PUT /identity/v3/projects/0d76dbdc2daa467d9156d3b0aa49a328/users/146a3979566a4bdc9c71b1eeb22ef29f/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:24.048087 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f3e21-c900-4cbe-8594-4ae421e90fcb admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:24.211982 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352ab94-0b04-4b21-bd69-ca2ab43793a6 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:24.294713 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f3e21-c900-4cbe-8594-4ae421e90fcb admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:24.305366 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14120c-096f-47c2-9d29-f0385e59dfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:24.308356 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14120c-096f-47c2-9d29-f0385e59dfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:24.308356 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14120c-096f-47c2-9d29-f0385e59dfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:24.310893 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14120c-096f-47c2-9d29-f0385e59dfa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:24.310893 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14120c-096f-47c2-9d29-f0385e59dfa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:24.314210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14120c-096f-47c2-9d29-f0385e59dfa9 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:24.354287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 941/1872] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 16:59:24.370246 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14120c-096f-47c2-9d29-f0385e59dfa9 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:24.384705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52e8bc-13f0-4676-a2c2-ec42d4ab5ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:24.385707 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52e8bc-13f0-4676-a2c2-ec42d4ab5ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:24.386201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52e8bc-13f0-4676-a2c2-ec42d4ab5ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:24.387929 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52e8bc-13f0-4676-a2c2-ec42d4ab5ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:24.389139 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52e8bc-13f0-4676-a2c2-ec42d4ab5ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:24.394026 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52e8bc-13f0-4676-a2c2-ec42d4ab5ab4 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:24.406754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14120c-096f-47c2-9d29-f0385e59dfa9 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:24.414924 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8ae16-4217-4699-8298-329ce7fd2f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:24.416667 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 932/1873] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 16:59:24.420842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52e8bc-13f0-4676-a2c2-ec42d4ab5ab4 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:24.421349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8ae16-4217-4699-8298-329ce7fd2f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:24.424530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8ae16-4217-4699-8298-329ce7fd2f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:24.427573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8ae16-4217-4699-8298-329ce7fd2f3e admin admin] PATH_INFO: `/v3/projects/0d76dbdc2daa467d9156d3b0aa49a328/users/146a3979566a4bdc9c71b1eeb22ef29f/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:24.430879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8ae16-4217-4699-8298-329ce7fd2f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d76dbdc2daa467d9156d3b0aa49a328, user_id=146a3979566a4bdc9c71b1eeb22ef29f, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:24.440443 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52e8bc-13f0-4676-a2c2-ec42d4ab5ab4 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:24.440987 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8ae16-4217-4699-8298-329ce7fd2f3e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:24.455011 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc65271-b4ac-466f-bbd2-113ff1920767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:24.457373 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc65271-b4ac-466f-bbd2-113ff1920767 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:24.459490 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc65271-b4ac-466f-bbd2-113ff1920767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:24.460287 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc65271-b4ac-466f-bbd2-113ff1920767 admin admin] PATH_INFO: `/v3/projects/0e25e5d811364fe2a1abbbe41e1e9547/users/b08fc853a4e547b7a0d886e4a7aa4949/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:24.464723 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc65271-b4ac-466f-bbd2-113ff1920767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e25e5d811364fe2a1abbbe41e1e9547, user_id=b08fc853a4e547b7a0d886e4a7aa4949, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:24.468828 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 942/1874] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:24 2022] PUT /identity/v3/projects/0d76dbdc2daa467d9156d3b0aa49a328/users/146a3979566a4bdc9c71b1eeb22ef29f/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:24.470684 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc65271-b4ac-466f-bbd2-113ff1920767 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:24.479440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105093fe-967d-4f35-aadc-b6e976a13194 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:24.480319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105093fe-967d-4f35-aadc-b6e976a13194 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:24.480829 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105093fe-967d-4f35-aadc-b6e976a13194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:24.504155 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 933/1875] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:24 2022] PUT /identity/v3/projects/0e25e5d811364fe2a1abbbe41e1e9547/users/b08fc853a4e547b7a0d886e4a7aa4949/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:24.530956 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-105093fe-967d-4f35-aadc-b6e976a13194 None None] MFA Rules not processed for user `146a3979566a4bdc9c71b1eeb22ef29f`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:24.533060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-105093fe-967d-4f35-aadc-b6e976a13194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:24.561603 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:24.717218 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 943/1876] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:59:24.965598 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc65271-b4ac-466f-bbd2-113ff1920767 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:24.967058 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-afc65271-b4ac-466f-bbd2-113ff1920767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:25.055572 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105093fe-967d-4f35-aadc-b6e976a13194 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:25.057002 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-105093fe-967d-4f35-aadc-b6e976a13194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:25.110933 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc65271-b4ac-466f-bbd2-113ff1920767 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:25.115895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bfa04-db79-4423-98e7-32e6d3eb1e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:25.117434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bfa04-db79-4423-98e7-32e6d3eb1e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:25.117784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bfa04-db79-4423-98e7-32e6d3eb1e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:25.118132 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bfa04-db79-4423-98e7-32e6d3eb1e1e admin admin] PATH_INFO: `/v3/projects/1cb626ec1cb344d6bdae2fa7cf3740e4` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:25.119603 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703bfa04-db79-4423-98e7-32e6d3eb1e1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb626ec1cb344d6bdae2fa7cf3740e4)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:25.123138 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703bfa04-db79-4423-98e7-32e6d3eb1e1e admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:25.206134 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105093fe-967d-4f35-aadc-b6e976a13194 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:25.216334 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4de705-e568-4514-9c16-a4aa926fa86d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:25.217124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4de705-e568-4514-9c16-a4aa926fa86d service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:25.217454 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4de705-e568-4514-9c16-a4aa926fa86d service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:25.217869 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4de705-e568-4514-9c16-a4aa926fa86d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:25.246468 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4de705-e568-4514-9c16-a4aa926fa86d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:25.246468 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4de705-e568-4514-9c16-a4aa926fa86d service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:25.271198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 944/1877] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:25.328727 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4de705-e568-4514-9c16-a4aa926fa86d service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:25.356125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4de705-e568-4514-9c16-a4aa926fa86d service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:25.373418 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0f134-b7ba-4ccc-b404-e888d43011ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:25.379749 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0f134-b7ba-4ccc-b404-e888d43011ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:25.380640 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0f134-b7ba-4ccc-b404-e888d43011ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:25.382259 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0f134-b7ba-4ccc-b404-e888d43011ce admin admin] PATH_INFO: `/v3/users/bb0bbbf4767644439947d5ece1f81e57` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:25.387410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0f134-b7ba-4ccc-b404-e888d43011ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb0bbbf4767644439947d5ece1f81e57)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:25.393803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0f134-b7ba-4ccc-b404-e888d43011ce admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:25.561620 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-703bfa04-db79-4423-98e7-32e6d3eb1e1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb626ec1cb344d6bdae2fa7cf3740e4', 'request_id': 'req-703bfa04-db79-4423-98e7-32e6d3eb1e1e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:25.731264 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-bcb0f134-b7ba-4ccc-b404-e888d43011ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb0bbbf4767644439947d5ece1f81e57'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:25.740773 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-703bfa04-db79-4423-98e7-32e6d3eb1e1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb626ec1cb344d6bdae2fa7cf3740e4', 'request_id': 'req-703bfa04-db79-4423-98e7-32e6d3eb1e1e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:25.748420 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-703bfa04-db79-4423-98e7-32e6d3eb1e1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb626ec1cb344d6bdae2fa7cf3740e4', 'request_id': 'req-703bfa04-db79-4423-98e7-32e6d3eb1e1e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:25.752698 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-bcb0f134-b7ba-4ccc-b404-e888d43011ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb0bbbf4767644439947d5ece1f81e57'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:25.755729 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-bcb0f134-b7ba-4ccc-b404-e888d43011ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb0bbbf4767644439947d5ece1f81e57'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:25.765429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-703bfa04-db79-4423-98e7-32e6d3eb1e1e admin admin] The token cache is being invalidate because project 1cb626ec1cb344d6bdae2fa7cf3740e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:25.766502 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-703bfa04-db79-4423-98e7-32e6d3eb1e1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:25.767833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-703bfa04-db79-4423-98e7-32e6d3eb1e1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:25.770714 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 934/1878] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:24 2022] DELETE /identity/v3/projects/1cb626ec1cb344d6bdae2fa7cf3740e4 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:25.772914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bfa04-db79-4423-98e7-32e6d3eb1e1e admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:25.776820 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-703bfa04-db79-4423-98e7-32e6d3eb1e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:25.780740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-bcb0f134-b7ba-4ccc-b404-e888d43011ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb0bbbf4767644439947d5ece1f81e57'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:25.780740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-bcb0f134-b7ba-4ccc-b404-e888d43011ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb0bbbf4767644439947d5ece1f81e57'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:25.870186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bfa04-db79-4423-98e7-32e6d3eb1e1e admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:25.875167 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58447ad9-5125-4eff-9850-aeba7b41e63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:25.876038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58447ad9-5125-4eff-9850-aeba7b41e63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:25.876378 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58447ad9-5125-4eff-9850-aeba7b41e63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:25.876635 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58447ad9-5125-4eff-9850-aeba7b41e63f admin admin] PATH_INFO: `/v3/projects/3ac89c1bef804ac4966f57ad54694aa7` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:25.877920 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58447ad9-5125-4eff-9850-aeba7b41e63f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ac89c1bef804ac4966f57ad54694aa7)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:25.879846 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58447ad9-5125-4eff-9850-aeba7b41e63f admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:25.891268 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 945/1879] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:25 2022] DELETE /identity/v3/users/bb0bbbf4767644439947d5ece1f81e57 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 16:59:25.892556 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0f134-b7ba-4ccc-b404-e888d43011ce admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:25.894303 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-bcb0f134-b7ba-4ccc-b404-e888d43011ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:25.963641 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0f134-b7ba-4ccc-b404-e888d43011ce admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:25.968422 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a5ab0-8b9b-42df-b0ca-8bdff3bf4841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:25.969288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a5ab0-8b9b-42df-b0ca-8bdff3bf4841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:25.969573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a5ab0-8b9b-42df-b0ca-8bdff3bf4841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:25.969839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a5ab0-8b9b-42df-b0ca-8bdff3bf4841 admin admin] PATH_INFO: `/v3/users/10aa43ecf2d64dd68f88bb88b0541e3e` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:25.971062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a5ab0-8b9b-42df-b0ca-8bdff3bf4841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10aa43ecf2d64dd68f88bb88b0541e3e)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:25.973145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a5ab0-8b9b-42df-b0ca-8bdff3bf4841 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:26.037370 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-58447ad9-5125-4eff-9850-aeba7b41e63f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ac89c1bef804ac4966f57ad54694aa7', 'request_id': 'req-58447ad9-5125-4eff-9850-aeba7b41e63f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:26.128007 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-58447ad9-5125-4eff-9850-aeba7b41e63f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ac89c1bef804ac4966f57ad54694aa7', 'request_id': 'req-58447ad9-5125-4eff-9850-aeba7b41e63f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:26.135203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-58447ad9-5125-4eff-9850-aeba7b41e63f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ac89c1bef804ac4966f57ad54694aa7', 'request_id': 'req-58447ad9-5125-4eff-9850-aeba7b41e63f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:26.148311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-58447ad9-5125-4eff-9850-aeba7b41e63f admin admin] The token cache is being invalidate because project 3ac89c1bef804ac4966f57ad54694aa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:26.148736 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-58447ad9-5125-4eff-9850-aeba7b41e63f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:26.149511 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-58447ad9-5125-4eff-9850-aeba7b41e63f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:26.151345 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 935/1880] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:25 2022] DELETE /identity/v3/projects/3ac89c1bef804ac4966f57ad54694aa7 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:26.155421 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc89764-59cd-47db-a615-7f9197c35adf None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:26.155711 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc89764-59cd-47db-a615-7f9197c35adf None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:26.156148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc89764-59cd-47db-a615-7f9197c35adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:26.159133 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-396a5ab0-8b9b-42df-b0ca-8bdff3bf4841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10aa43ecf2d64dd68f88bb88b0541e3e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:26.166435 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-396a5ab0-8b9b-42df-b0ca-8bdff3bf4841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10aa43ecf2d64dd68f88bb88b0541e3e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:26.167182 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-396a5ab0-8b9b-42df-b0ca-8bdff3bf4841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10aa43ecf2d64dd68f88bb88b0541e3e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:26.189061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-5bc89764-59cd-47db-a615-7f9197c35adf None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:26.190399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-5bc89764-59cd-47db-a615-7f9197c35adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:26.201870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-396a5ab0-8b9b-42df-b0ca-8bdff3bf4841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10aa43ecf2d64dd68f88bb88b0541e3e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:26.202696 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-396a5ab0-8b9b-42df-b0ca-8bdff3bf4841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10aa43ecf2d64dd68f88bb88b0541e3e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:26.255555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 936/1881] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:26.260058 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc89764-59cd-47db-a615-7f9197c35adf None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:26.263512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-5bc89764-59cd-47db-a615-7f9197c35adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:26.281584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc89764-59cd-47db-a615-7f9197c35adf None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:26.286472 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454198f-7019-493d-9636-91007d95b509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:26.294816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454198f-7019-493d-9636-91007d95b509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:26.294816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454198f-7019-493d-9636-91007d95b509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:26.294816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454198f-7019-493d-9636-91007d95b509 admin admin] PATH_INFO: `/v3/users/1c9d7c3899ca4226bc1cf2076887a291` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:26.295116 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 946/1882] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:25 2022] DELETE /identity/v3/users/10aa43ecf2d64dd68f88bb88b0541e3e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:26.295317 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454198f-7019-493d-9636-91007d95b509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c9d7c3899ca4226bc1cf2076887a291)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:26.295408 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a5ab0-8b9b-42df-b0ca-8bdff3bf4841 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:26.295498 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454198f-7019-493d-9636-91007d95b509 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:26.295605 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-396a5ab0-8b9b-42df-b0ca-8bdff3bf4841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:26.363749 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a5ab0-8b9b-42df-b0ca-8bdff3bf4841 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:26.367986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83c63e-fe5e-42e0-a14c-8761fe9326b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:26.368596 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83c63e-fe5e-42e0-a14c-8761fe9326b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:26.368881 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83c63e-fe5e-42e0-a14c-8761fe9326b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:26.369161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83c63e-fe5e-42e0-a14c-8761fe9326b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:26.429892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83c63e-fe5e-42e0-a14c-8761fe9326b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:26.431286 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83c63e-fe5e-42e0-a14c-8761fe9326b7 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:26.442538 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 947/1883] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:26.472618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:DELETE=17,keystone:SELECT=78,keystone:INSERT=5 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:26.551634 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-8454198f-7019-493d-9636-91007d95b509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c9d7c3899ca4226bc1cf2076887a291'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:26.552561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-8454198f-7019-493d-9636-91007d95b509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c9d7c3899ca4226bc1cf2076887a291'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:26.655562 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-8454198f-7019-493d-9636-91007d95b509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c9d7c3899ca4226bc1cf2076887a291'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:26.661123 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-8454198f-7019-493d-9636-91007d95b509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c9d7c3899ca4226bc1cf2076887a291'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:26.674297 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-8454198f-7019-493d-9636-91007d95b509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c9d7c3899ca4226bc1cf2076887a291'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:26.689354 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 937/1884] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:26 2022] DELETE /identity/v3/users/1c9d7c3899ca4226bc1cf2076887a291 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:26.771913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83c63e-fe5e-42e0-a14c-8761fe9326b7 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:26.774696 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-8a83c63e-fe5e-42e0-a14c-8761fe9326b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:26.787881 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83c63e-fe5e-42e0-a14c-8761fe9326b7 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:26.855507 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3387f6-4b9a-4d51-94de-c3cd0135f108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:26.856557 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3387f6-4b9a-4d51-94de-c3cd0135f108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:26.856832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3387f6-4b9a-4d51-94de-c3cd0135f108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:26.857265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3387f6-4b9a-4d51-94de-c3cd0135f108 admin admin] PATH_INFO: `/v3/projects/87786558138146b7b2b5a490a5273e45` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:26.858789 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3387f6-4b9a-4d51-94de-c3cd0135f108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87786558138146b7b2b5a490a5273e45)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:26.860993 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3387f6-4b9a-4d51-94de-c3cd0135f108 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:26.905302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a044b-529b-4678-88cb-34884704b90e None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:26.905835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a044b-529b-4678-88cb-34884704b90e None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:26.906315 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a044b-529b-4678-88cb-34884704b90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:26.953900 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-268a044b-529b-4678-88cb-34884704b90e None None] MFA Rules not processed for user `b08fc853a4e547b7a0d886e4a7aa4949`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:26.954933 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-268a044b-529b-4678-88cb-34884704b90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:27.033056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-db3387f6-4b9a-4d51-94de-c3cd0135f108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87786558138146b7b2b5a490a5273e45', 'request_id': 'req-db3387f6-4b9a-4d51-94de-c3cd0135f108'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:27.033203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:27.052824 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 938/1885] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:27.057096 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a044b-529b-4678-88cb-34884704b90e None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:27.058630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-268a044b-529b-4678-88cb-34884704b90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:27.072741 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a044b-529b-4678-88cb-34884704b90e None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:27.136329 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586bf88-af2d-4a37-a646-9ae4472bfabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:27.137197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586bf88-af2d-4a37-a646-9ae4472bfabd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:27.137540 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586bf88-af2d-4a37-a646-9ae4472bfabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:27.137801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586bf88-af2d-4a37-a646-9ae4472bfabd admin admin] PATH_INFO: `/v3/projects/090187c2de004c4487aec177f683e747` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:27.139344 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586bf88-af2d-4a37-a646-9ae4472bfabd admin admin] RBAC: Authorizing `identity:delete_project(project_id=090187c2de004c4487aec177f683e747)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:27.141381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586bf88-af2d-4a37-a646-9ae4472bfabd admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:27.153259 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-db3387f6-4b9a-4d51-94de-c3cd0135f108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87786558138146b7b2b5a490a5273e45', 'request_id': 'req-db3387f6-4b9a-4d51-94de-c3cd0135f108'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:27.163093 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-db3387f6-4b9a-4d51-94de-c3cd0135f108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87786558138146b7b2b5a490a5273e45', 'request_id': 'req-db3387f6-4b9a-4d51-94de-c3cd0135f108'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:27.171804 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-db3387f6-4b9a-4d51-94de-c3cd0135f108 admin admin] The token cache is being invalidate because project 87786558138146b7b2b5a490a5273e45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:27.172097 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-db3387f6-4b9a-4d51-94de-c3cd0135f108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:27.172950 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-db3387f6-4b9a-4d51-94de-c3cd0135f108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:27.174513 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 948/1886] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:26 2022] DELETE /identity/v3/projects/87786558138146b7b2b5a490a5273e45 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:27.175304 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3387f6-4b9a-4d51-94de-c3cd0135f108 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:27.176631 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-db3387f6-4b9a-4d51-94de-c3cd0135f108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:27.231632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3387f6-4b9a-4d51-94de-c3cd0135f108 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:27.238534 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc0a7b-f26b-47b8-9833-4f61d0ead2cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:27.246566 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc0a7b-f26b-47b8-9833-4f61d0ead2cc service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:27.246566 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc0a7b-f26b-47b8-9833-4f61d0ead2cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:27.246566 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc0a7b-f26b-47b8-9833-4f61d0ead2cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:27.246566 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-14cc0a7b-f26b-47b8-9833-4f61d0ead2cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:27.265483 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e586bf88-af2d-4a37-a646-9ae4472bfabd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '090187c2de004c4487aec177f683e747', 'request_id': 'req-e586bf88-af2d-4a37-a646-9ae4472bfabd'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:27.315476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc0a7b-f26b-47b8-9833-4f61d0ead2cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:27.316956 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc0a7b-f26b-47b8-9833-4f61d0ead2cc service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:27.327214 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 949/1887] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:27.332290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9b737-9d5d-460f-a8ab-01a45888b5f4 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:27.332290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9b737-9d5d-460f-a8ab-01a45888b5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:27.332290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9b737-9d5d-460f-a8ab-01a45888b5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:27.348929 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-17b9b737-9d5d-460f-a8ab-01a45888b5f4 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:27.350223 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-17b9b737-9d5d-460f-a8ab-01a45888b5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:27.357466 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e586bf88-af2d-4a37-a646-9ae4472bfabd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '090187c2de004c4487aec177f683e747', 'request_id': 'req-e586bf88-af2d-4a37-a646-9ae4472bfabd'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:27.368331 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e586bf88-af2d-4a37-a646-9ae4472bfabd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '090187c2de004c4487aec177f683e747', 'request_id': 'req-e586bf88-af2d-4a37-a646-9ae4472bfabd'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:27.390961 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e586bf88-af2d-4a37-a646-9ae4472bfabd admin admin] The token cache is being invalidate because project 090187c2de004c4487aec177f683e747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:27.391266 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e586bf88-af2d-4a37-a646-9ae4472bfabd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:27.393663 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e586bf88-af2d-4a37-a646-9ae4472bfabd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:27.396671 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 939/1888] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:27 2022] DELETE /identity/v3/projects/090187c2de004c4487aec177f683e747 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:27.396671 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586bf88-af2d-4a37-a646-9ae4472bfabd admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:27.396671 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e586bf88-af2d-4a37-a646-9ae4472bfabd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:27.430079 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 950/1889] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:27.430079 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9b737-9d5d-460f-a8ab-01a45888b5f4 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:27.430079 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-17b9b737-9d5d-460f-a8ab-01a45888b5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:27.433313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9b737-9d5d-460f-a8ab-01a45888b5f4 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:27.438911 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba006e2f-7fef-4771-b8cd-a664a5431b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:27.439789 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba006e2f-7fef-4771-b8cd-a664a5431b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:27.440136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba006e2f-7fef-4771-b8cd-a664a5431b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:27.440387 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba006e2f-7fef-4771-b8cd-a664a5431b36 admin admin] PATH_INFO: `/v3/users/146a3979566a4bdc9c71b1eeb22ef29f` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:27.441725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba006e2f-7fef-4771-b8cd-a664a5431b36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=146a3979566a4bdc9c71b1eeb22ef29f)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:27.443652 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba006e2f-7fef-4771-b8cd-a664a5431b36 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:27.474316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586bf88-af2d-4a37-a646-9ae4472bfabd admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:27.479022 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e6f63-a484-4c61-85af-123f8a137fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:27.479885 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e6f63-a484-4c61-85af-123f8a137fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:27.480197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e6f63-a484-4c61-85af-123f8a137fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:27.480474 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e6f63-a484-4c61-85af-123f8a137fa2 admin admin] PATH_INFO: `/v3/projects/2a663ab26b4b492ba07e51daa0878815` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:27.481705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e6f63-a484-4c61-85af-123f8a137fa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a663ab26b4b492ba07e51daa0878815)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:27.483612 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e6f63-a484-4c61-85af-123f8a137fa2 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:27.659359 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ba006e2f-7fef-4771-b8cd-a664a5431b36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '146a3979566a4bdc9c71b1eeb22ef29f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:27.662802 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-2b4e6f63-a484-4c61-85af-123f8a137fa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a663ab26b4b492ba07e51daa0878815', 'request_id': 'req-2b4e6f63-a484-4c61-85af-123f8a137fa2'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:27.666893 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ba006e2f-7fef-4771-b8cd-a664a5431b36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '146a3979566a4bdc9c71b1eeb22ef29f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:27.671622 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ba006e2f-7fef-4771-b8cd-a664a5431b36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '146a3979566a4bdc9c71b1eeb22ef29f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:27.681231 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ba006e2f-7fef-4771-b8cd-a664a5431b36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '146a3979566a4bdc9c71b1eeb22ef29f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:27.682095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ba006e2f-7fef-4771-b8cd-a664a5431b36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '146a3979566a4bdc9c71b1eeb22ef29f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:27.728371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-2b4e6f63-a484-4c61-85af-123f8a137fa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a663ab26b4b492ba07e51daa0878815', 'request_id': 'req-2b4e6f63-a484-4c61-85af-123f8a137fa2'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:27.734741 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-2b4e6f63-a484-4c61-85af-123f8a137fa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a663ab26b4b492ba07e51daa0878815', 'request_id': 'req-2b4e6f63-a484-4c61-85af-123f8a137fa2'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:27.749829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-2b4e6f63-a484-4c61-85af-123f8a137fa2 admin admin] The token cache is being invalidate because project 2a663ab26b4b492ba07e51daa0878815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:27.750195 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-2b4e6f63-a484-4c61-85af-123f8a137fa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:27.750997 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-2b4e6f63-a484-4c61-85af-123f8a137fa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:27.752767 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 940/1890] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:27 2022] DELETE /identity/v3/projects/2a663ab26b4b492ba07e51daa0878815 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:27.754361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ca5bf-d775-4daa-89b2-13b34cec2191 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:27.754716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ca5bf-d775-4daa-89b2-13b34cec2191 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:27.755073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ca5bf-d775-4daa-89b2-13b34cec2191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:27.776733 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-7a3ca5bf-d775-4daa-89b2-13b34cec2191 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:27.778049 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-7a3ca5bf-d775-4daa-89b2-13b34cec2191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:27.814417 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 951/1891] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:27 2022] DELETE /identity/v3/users/146a3979566a4bdc9c71b1eeb22ef29f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:27.816526 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b05be4-bba0-4e44-b1f6-e3d6a2bfbcf2 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:27.816816 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b05be4-bba0-4e44-b1f6-e3d6a2bfbcf2 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:27.817533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b05be4-bba0-4e44-b1f6-e3d6a2bfbcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:27.837303 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-03b05be4-bba0-4e44-b1f6-e3d6a2bfbcf2 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:27.838950 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-03b05be4-bba0-4e44-b1f6-e3d6a2bfbcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:27.844866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 941/1892] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:27.852943 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ca5bf-d775-4daa-89b2-13b34cec2191 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:27.862310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ca5bf-d775-4daa-89b2-13b34cec2191 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:27.914336 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 952/1893] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:27.921818 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97506e-2e1d-4e2d-83c1-f99595d6fc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:27.922254 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2294a4-5ee3-42f1-aea8-59ab5267eb62 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:27.922672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97506e-2e1d-4e2d-83c1-f99595d6fc76 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:27.922771 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2294a4-5ee3-42f1-aea8-59ab5267eb62 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:27.922970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97506e-2e1d-4e2d-83c1-f99595d6fc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:27.923056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2294a4-5ee3-42f1-aea8-59ab5267eb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:27.923309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97506e-2e1d-4e2d-83c1-f99595d6fc76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:27.924270 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97506e-2e1d-4e2d-83c1-f99595d6fc76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:59:27.929816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97506e-2e1d-4e2d-83c1-f99595d6fc76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:27.929816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97506e-2e1d-4e2d-83c1-f99595d6fc76 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:27.942006 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 942/1894] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 16:59:27.942164 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-9f2294a4-5ee3-42f1-aea8-59ab5267eb62 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:27.942531 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-9f2294a4-5ee3-42f1-aea8-59ab5267eb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:27.942956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97506e-2e1d-4e2d-83c1-f99595d6fc76 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:27.953748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97506e-2e1d-4e2d-83c1-f99595d6fc76 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:27.954169 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 953/1895] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:59:27.958566 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2294a4-5ee3-42f1-aea8-59ab5267eb62 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:27.965935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2294a4-5ee3-42f1-aea8-59ab5267eb62 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:27.970357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccdea2-de26-4561-a40f-d327c9bd7adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:27.971089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccdea2-de26-4561-a40f-d327c9bd7adb admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:27.971363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccdea2-de26-4561-a40f-d327c9bd7adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:27.971642 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccdea2-de26-4561-a40f-d327c9bd7adb admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:27.972594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccdea2-de26-4561-a40f-d327c9bd7adb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:27.974629 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccdea2-de26-4561-a40f-d327c9bd7adb admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:27.983390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2eab4-7469-48c8-a906-6d95a5e9ce5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:27.984229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2eab4-7469-48c8-a906-6d95a5e9ce5f admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:27.987804 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2eab4-7469-48c8-a906-6d95a5e9ce5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:27.987804 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2eab4-7469-48c8-a906-6d95a5e9ce5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:27.987804 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2eab4-7469-48c8-a906-6d95a5e9ce5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:59:27.987804 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2eab4-7469-48c8-a906-6d95a5e9ce5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:27.987804 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2eab4-7469-48c8-a906-6d95a5e9ce5f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:28.000021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 954/1896] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:59:28.004579 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2eab4-7469-48c8-a906-6d95a5e9ce5f admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:28.019537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2eab4-7469-48c8-a906-6d95a5e9ce5f admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:28.026366 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800e94e-20a5-410b-af86-33f3efd05ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:28.027524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800e94e-20a5-410b-af86-33f3efd05ecd admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:28.027865 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800e94e-20a5-410b-af86-33f3efd05ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:28.028140 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800e94e-20a5-410b-af86-33f3efd05ecd admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:28.028834 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800e94e-20a5-410b-af86-33f3efd05ecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:28.030849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800e94e-20a5-410b-af86-33f3efd05ecd admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:28.074899 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 943/1897] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:27 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 16:59:28.078751 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccdea2-de26-4561-a40f-d327c9bd7adb admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:28.185734 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccdea2-de26-4561-a40f-d327c9bd7adb admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:28.201229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ab745-df7b-4e7d-8035-353a8602a404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:28.201341 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 955/1898] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:28 2022] POST /identity/v3/projects => generated 381 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 16:59:28.201534 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ab745-df7b-4e7d-8035-353a8602a404 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:28.201928 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ab745-df7b-4e7d-8035-353a8602a404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:28.202505 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ab745-df7b-4e7d-8035-353a8602a404 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:28.203946 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ab745-df7b-4e7d-8035-353a8602a404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:28.204063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800e94e-20a5-410b-af86-33f3efd05ecd admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:28.206836 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ab745-df7b-4e7d-8035-353a8602a404 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:28.272647 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800e94e-20a5-410b-af86-33f3efd05ecd admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:28.278570 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d73eef-01a1-44e7-a725-cdb7644e32f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:28.279284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d73eef-01a1-44e7-a725-cdb7644e32f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:28.279805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d73eef-01a1-44e7-a725-cdb7644e32f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:28.280375 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d73eef-01a1-44e7-a725-cdb7644e32f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:28.281135 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d73eef-01a1-44e7-a725-cdb7644e32f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:28.283163 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d73eef-01a1-44e7-a725-cdb7644e32f4 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:28.311463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:28.347686 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 944/1899] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:28 2022] POST /identity/v3/users => generated 285 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:28.352270 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ab745-df7b-4e7d-8035-353a8602a404 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:28.357795 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-295ab745-df7b-4e7d-8035-353a8602a404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:28.378330 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 956/1900] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:28 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:28.379297 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ab745-df7b-4e7d-8035-353a8602a404 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:28.379501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d73eef-01a1-44e7-a725-cdb7644e32f4 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:28.391554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d73eef-01a1-44e7-a725-cdb7644e32f4 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:28.396582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4a172-0d50-47f4-bba6-1097bda29df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:28.397760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a172-0d50-47f4-bba6-1097bda29df0 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:28.398049 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a172-0d50-47f4-bba6-1097bda29df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:28.398328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a172-0d50-47f4-bba6-1097bda29df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:28.399130 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4a172-0d50-47f4-bba6-1097bda29df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:28.401125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4a172-0d50-47f4-bba6-1097bda29df0 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:28.406424 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776110a9-1650-479d-8fcb-db3c58814612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:28.407587 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776110a9-1650-479d-8fcb-db3c58814612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:28.407926 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776110a9-1650-479d-8fcb-db3c58814612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:28.408368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776110a9-1650-479d-8fcb-db3c58814612 admin admin] PATH_INFO: `/v3/users/11f34180981e447bbc0318aa8f1e8cfd` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:28.409501 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776110a9-1650-479d-8fcb-db3c58814612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11f34180981e447bbc0318aa8f1e8cfd)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:28.411498 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776110a9-1650-479d-8fcb-db3c58814612 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:28.420990 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 957/1901] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:28.421924 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4a172-0d50-47f4-bba6-1097bda29df0 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:28.424144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-35a4a172-0d50-47f4-bba6-1097bda29df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:28.441674 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4a172-0d50-47f4-bba6-1097bda29df0 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:28.450562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c754b-83c0-4a3a-a8fa-e236a39cd4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:28.451396 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c754b-83c0-4a3a-a8fa-e236a39cd4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:28.451618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c754b-83c0-4a3a-a8fa-e236a39cd4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:28.451914 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c754b-83c0-4a3a-a8fa-e236a39cd4fe admin admin] PATH_INFO: `/v3/projects/0d76dbdc2daa467d9156d3b0aa49a328` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:28.453359 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c754b-83c0-4a3a-a8fa-e236a39cd4fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d76dbdc2daa467d9156d3b0aa49a328)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:28.455285 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c754b-83c0-4a3a-a8fa-e236a39cd4fe admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:28.557482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:28.651413 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-035c754b-83c0-4a3a-a8fa-e236a39cd4fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d76dbdc2daa467d9156d3b0aa49a328', 'request_id': 'req-035c754b-83c0-4a3a-a8fa-e236a39cd4fe'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:28.651965 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-776110a9-1650-479d-8fcb-db3c58814612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11f34180981e447bbc0318aa8f1e8cfd'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:28.653156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-776110a9-1650-479d-8fcb-db3c58814612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11f34180981e447bbc0318aa8f1e8cfd'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:28.733074 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-035c754b-83c0-4a3a-a8fa-e236a39cd4fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d76dbdc2daa467d9156d3b0aa49a328', 'request_id': 'req-035c754b-83c0-4a3a-a8fa-e236a39cd4fe'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:28.740916 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-035c754b-83c0-4a3a-a8fa-e236a39cd4fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d76dbdc2daa467d9156d3b0aa49a328', 'request_id': 'req-035c754b-83c0-4a3a-a8fa-e236a39cd4fe'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:28.751539 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-035c754b-83c0-4a3a-a8fa-e236a39cd4fe admin admin] The token cache is being invalidate because project 0d76dbdc2daa467d9156d3b0aa49a328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:28.751853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-035c754b-83c0-4a3a-a8fa-e236a39cd4fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:28.752531 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-035c754b-83c0-4a3a-a8fa-e236a39cd4fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:28.754313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 958/1902] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:28 2022] DELETE /identity/v3/projects/0d76dbdc2daa467d9156d3b0aa49a328 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:28.755079 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c754b-83c0-4a3a-a8fa-e236a39cd4fe admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:28.756390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-035c754b-83c0-4a3a-a8fa-e236a39cd4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:28.801194 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-776110a9-1650-479d-8fcb-db3c58814612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11f34180981e447bbc0318aa8f1e8cfd'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:28.802149 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-776110a9-1650-479d-8fcb-db3c58814612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11f34180981e447bbc0318aa8f1e8cfd'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:28.825970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-776110a9-1650-479d-8fcb-db3c58814612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11f34180981e447bbc0318aa8f1e8cfd'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:28.827370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c754b-83c0-4a3a-a8fa-e236a39cd4fe admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:28.836623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd751238-5b42-469e-8d07-b3da7e1648bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:28.837541 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd751238-5b42-469e-8d07-b3da7e1648bb admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:28.837894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd751238-5b42-469e-8d07-b3da7e1648bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:28.838237 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd751238-5b42-469e-8d07-b3da7e1648bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:28.839052 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd751238-5b42-469e-8d07-b3da7e1648bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:28.843150 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 945/1903] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:28 2022] DELETE /identity/v3/users/11f34180981e447bbc0318aa8f1e8cfd => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:28.845357 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd751238-5b42-469e-8d07-b3da7e1648bb admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:28.845487 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776110a9-1650-479d-8fcb-db3c58814612 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:28.845487 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-776110a9-1650-479d-8fcb-db3c58814612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:28.852840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 959/1904] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:28.854089 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50099cf1-6c57-46f6-80e3-7316d324c854 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:28.854382 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50099cf1-6c57-46f6-80e3-7316d324c854 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:28.854662 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50099cf1-6c57-46f6-80e3-7316d324c854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:28.872647 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-50099cf1-6c57-46f6-80e3-7316d324c854 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:28.873858 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-50099cf1-6c57-46f6-80e3-7316d324c854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:28.915241 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776110a9-1650-479d-8fcb-db3c58814612 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:28.921297 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f602d-fe33-4361-b0a4-0668caf8a050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:28.921969 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f602d-fe33-4361-b0a4-0668caf8a050 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:28.922249 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f602d-fe33-4361-b0a4-0668caf8a050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:28.922520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f602d-fe33-4361-b0a4-0668caf8a050 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:28.923258 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f602d-fe33-4361-b0a4-0668caf8a050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:28.924911 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f602d-fe33-4361-b0a4-0668caf8a050 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:28.939393 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 946/1905] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:28.939393 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d453729-225c-4684-ab4e-08f72ccc0562 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:28.939393 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d453729-225c-4684-ab4e-08f72ccc0562 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:28.939393 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d453729-225c-4684-ab4e-08f72ccc0562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:28.948242 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 960/1906] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:28.950017 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50099cf1-6c57-46f6-80e3-7316d324c854 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:28.958155 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-3d453729-225c-4684-ab4e-08f72ccc0562 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:28.959384 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-3d453729-225c-4684-ab4e-08f72ccc0562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:28.963028 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50099cf1-6c57-46f6-80e3-7316d324c854 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:28.967942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a01a37-3a22-4beb-9cbf-58d31a5ff3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:28.968664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a01a37-3a22-4beb-9cbf-58d31a5ff3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:28.968946 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a01a37-3a22-4beb-9cbf-58d31a5ff3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:28.969222 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a01a37-3a22-4beb-9cbf-58d31a5ff3d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:28.969756 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 947/1907] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:28.969961 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a01a37-3a22-4beb-9cbf-58d31a5ff3d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:28.971556 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a01a37-3a22-4beb-9cbf-58d31a5ff3d7 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:28.976684 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d453729-225c-4684-ab4e-08f72ccc0562 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:28.979073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-3d453729-225c-4684-ab4e-08f72ccc0562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:28.985207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 961/1908] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:28.985207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3042f26-d36a-4d74-9bcd-4b3e5dbe28d2 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:28.985207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3042f26-d36a-4d74-9bcd-4b3e5dbe28d2 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:28.985207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3042f26-d36a-4d74-9bcd-4b3e5dbe28d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:29.000743 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d453729-225c-4684-ab4e-08f72ccc0562 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:29.005143 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-f3042f26-d36a-4d74-9bcd-4b3e5dbe28d2 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:29.007816 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f3042f26-d36a-4d74-9bcd-4b3e5dbe28d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:29.012733 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a189cf-a533-446d-8dff-e85637c92c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:29.015988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a189cf-a533-446d-8dff-e85637c92c18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:29.015988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a189cf-a533-446d-8dff-e85637c92c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:29.015988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a189cf-a533-446d-8dff-e85637c92c18 admin admin] PATH_INFO: `/v3/projects/db21a7c96da04c37ac95229868fc7af0/users/be963ba1a8d64d39bc2e2c862c37be55/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:29.018705 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 962/1909] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:29.019673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3042f26-d36a-4d74-9bcd-4b3e5dbe28d2 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:29.025471 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f3042f26-d36a-4d74-9bcd-4b3e5dbe28d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:29.030722 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a189cf-a533-446d-8dff-e85637c92c18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db21a7c96da04c37ac95229868fc7af0, user_id=be963ba1a8d64d39bc2e2c862c37be55, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:29.033476 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a189cf-a533-446d-8dff-e85637c92c18 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:29.082146 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3042f26-d36a-4d74-9bcd-4b3e5dbe28d2 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:29.085799 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b5030-424c-413b-97ae-87a96ae95605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:29.086442 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b5030-424c-413b-97ae-87a96ae95605 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:29.086727 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b5030-424c-413b-97ae-87a96ae95605 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:29.087005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b5030-424c-413b-97ae-87a96ae95605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:29.096068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b5030-424c-413b-97ae-87a96ae95605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:29.097547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b5030-424c-413b-97ae-87a96ae95605 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:29.106936 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 963/1910] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:29.107687 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b5030-424c-413b-97ae-87a96ae95605 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:29.117287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b5030-424c-413b-97ae-87a96ae95605 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:29.122383 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319c0cd-1b7e-4792-8e8c-eea7b3bba693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:29.123494 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319c0cd-1b7e-4792-8e8c-eea7b3bba693 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:29.123788 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319c0cd-1b7e-4792-8e8c-eea7b3bba693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:29.124259 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319c0cd-1b7e-4792-8e8c-eea7b3bba693 admin admin] PATH_INFO: `/v3/projects/3b393da9a05542aaa39af0b0acb3e974/users/630500c9bd344fa6adee0bdbce264d41/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:29.128182 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 948/1911] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:28 2022] PUT /identity/v3/projects/db21a7c96da04c37ac95229868fc7af0/users/be963ba1a8d64d39bc2e2c862c37be55/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:29.138122 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a189cf-a533-446d-8dff-e85637c92c18 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:29.140587 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319c0cd-1b7e-4792-8e8c-eea7b3bba693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b393da9a05542aaa39af0b0acb3e974, user_id=630500c9bd344fa6adee0bdbce264d41, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:29.143253 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319c0cd-1b7e-4792-8e8c-eea7b3bba693 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:29.214336 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a189cf-a533-446d-8dff-e85637c92c18 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:29.215211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 964/1912] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:29 2022] PUT /identity/v3/projects/3b393da9a05542aaa39af0b0acb3e974/users/630500c9bd344fa6adee0bdbce264d41/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:29.215968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d655d7f-8051-499e-a580-a951a05f14cf None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:29.216295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d655d7f-8051-499e-a580-a951a05f14cf None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:29.216584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d655d7f-8051-499e-a580-a951a05f14cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:29.252395 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-5d655d7f-8051-499e-a580-a951a05f14cf None None] MFA Rules not processed for user `be963ba1a8d64d39bc2e2c862c37be55`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:29.253619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-5d655d7f-8051-499e-a580-a951a05f14cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:29.281601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb271d-ef65-45e6-a5cc-db6558f0a24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:29.282269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb271d-ef65-45e6-a5cc-db6558f0a24b admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:29.282557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb271d-ef65-45e6-a5cc-db6558f0a24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:29.282835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb271d-ef65-45e6-a5cc-db6558f0a24b admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:29.283568 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb271d-ef65-45e6-a5cc-db6558f0a24b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:59:29.283883 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb271d-ef65-45e6-a5cc-db6558f0a24b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:29.285526 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb271d-ef65-45e6-a5cc-db6558f0a24b admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:29.296799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 949/1913] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:59:29.298173 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd01de6-0c0d-4fe2-9af7-c3b2db312cc9 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:29.298407 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd01de6-0c0d-4fe2-9af7-c3b2db312cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:29.298691 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd01de6-0c0d-4fe2-9af7-c3b2db312cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:29.329112 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-0fd01de6-0c0d-4fe2-9af7-c3b2db312cc9 None None] MFA Rules not processed for user `630500c9bd344fa6adee0bdbce264d41`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:29.330335 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0fd01de6-0c0d-4fe2-9af7-c3b2db312cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:29.336250 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 965/1914] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:29.337936 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d655d7f-8051-499e-a580-a951a05f14cf None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:29.359267 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d655d7f-8051-499e-a580-a951a05f14cf None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:29.363573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa263ba-39f2-4bcf-8ebd-24518add8459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:29.364418 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa263ba-39f2-4bcf-8ebd-24518add8459 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:29.364738 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa263ba-39f2-4bcf-8ebd-24518add8459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:29.365179 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa263ba-39f2-4bcf-8ebd-24518add8459 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:29.365909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa263ba-39f2-4bcf-8ebd-24518add8459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:29.368629 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa263ba-39f2-4bcf-8ebd-24518add8459 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:29.413729 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 950/1915] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:29.413729 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd01de6-0c0d-4fe2-9af7-c3b2db312cc9 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:29.425921 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd01de6-0c0d-4fe2-9af7-c3b2db312cc9 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:29.432379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9574c-d298-4690-b1d8-765acfcc2ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:29.433108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9574c-d298-4690-b1d8-765acfcc2ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:29.433400 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9574c-d298-4690-b1d8-765acfcc2ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:29.433881 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9574c-d298-4690-b1d8-765acfcc2ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:29.434640 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9574c-d298-4690-b1d8-765acfcc2ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:29.437292 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9574c-d298-4690-b1d8-765acfcc2ec9 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:29.542345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 966/1916] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:29 2022] POST /identity/v3/projects => generated 391 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:29.543226 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa263ba-39f2-4bcf-8ebd-24518add8459 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:29.544861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-eaa263ba-39f2-4bcf-8ebd-24518add8459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:29.565771 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 951/1917] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:29 2022] POST /identity/v3/projects => generated 367 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:29.567420 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9574c-d298-4690-b1d8-765acfcc2ec9 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:29.646401 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9574c-d298-4690-b1d8-765acfcc2ec9 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:29.651938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aefd02-30d8-4e6e-98b6-885420d6eab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:29.652826 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aefd02-30d8-4e6e-98b6-885420d6eab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:29.653228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aefd02-30d8-4e6e-98b6-885420d6eab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:29.653571 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aefd02-30d8-4e6e-98b6-885420d6eab5 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:29.654337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aefd02-30d8-4e6e-98b6-885420d6eab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:29.656676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aefd02-30d8-4e6e-98b6-885420d6eab5 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:29.656804 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa263ba-39f2-4bcf-8ebd-24518add8459 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:29.713033 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcafc8e-e8e7-46ed-be9b-571932eaaaeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:29.713724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcafc8e-e8e7-46ed-be9b-571932eaaaeb service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:29.714013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcafc8e-e8e7-46ed-be9b-571932eaaaeb service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:29.714292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcafc8e-e8e7-46ed-be9b-571932eaaaeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:29.741605 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 952/1918] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:29 2022] POST /identity/v3/users => generated 296 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:29.742685 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aefd02-30d8-4e6e-98b6-885420d6eab5 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:29.752781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aefd02-30d8-4e6e-98b6-885420d6eab5 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:29.757578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba08ed-4f39-4130-bbb0-30d503563e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:29.758250 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba08ed-4f39-4130-bbb0-30d503563e16 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:29.758537 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba08ed-4f39-4130-bbb0-30d503563e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:29.758813 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba08ed-4f39-4130-bbb0-30d503563e16 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:29.759667 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba08ed-4f39-4130-bbb0-30d503563e16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:29.761638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba08ed-4f39-4130-bbb0-30d503563e16 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:29.783192 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcafc8e-e8e7-46ed-be9b-571932eaaaeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:29.784701 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcafc8e-e8e7-46ed-be9b-571932eaaaeb service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:29.794120 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 967/1919] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:29.794898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcafc8e-e8e7-46ed-be9b-571932eaaaeb service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:29.810339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcafc8e-e8e7-46ed-be9b-571932eaaaeb service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:29.810339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0dbb4-fa00-4056-97e6-762f99f9f2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:29.810981 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0dbb4-fa00-4056-97e6-762f99f9f2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:29.811269 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0dbb4-fa00-4056-97e6-762f99f9f2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:29.811547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0dbb4-fa00-4056-97e6-762f99f9f2b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:29.812314 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0dbb4-fa00-4056-97e6-762f99f9f2b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:29.813935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0dbb4-fa00-4056-97e6-762f99f9f2b0 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:29.832423 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 968/1920] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:29.832423 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0dbb4-fa00-4056-97e6-762f99f9f2b0 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:29.839037 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-a8b0dbb4-fa00-4056-97e6-762f99f9f2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:29.851384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0dbb4-fa00-4056-97e6-762f99f9f2b0 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:29.856003 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3371b4a-131d-4f98-8f1c-adbcf71db341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:29.856996 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3371b4a-131d-4f98-8f1c-adbcf71db341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:29.857282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3371b4a-131d-4f98-8f1c-adbcf71db341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:29.857561 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3371b4a-131d-4f98-8f1c-adbcf71db341 admin admin] PATH_INFO: `/v3/projects/0f694ceb03d147f2b5408b5d21ae8e75` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:29.858752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3371b4a-131d-4f98-8f1c-adbcf71db341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f694ceb03d147f2b5408b5d21ae8e75)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:29.860699 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3371b4a-131d-4f98-8f1c-adbcf71db341 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:29.893930 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 953/1921] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:29 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:29.894826 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba08ed-4f39-4130-bbb0-30d503563e16 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:29.903161 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:29.906698 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba08ed-4f39-4130-bbb0-30d503563e16 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:29.911260 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3401c-50aa-481a-9c21-06f50217b90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:29.912120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3401c-50aa-481a-9c21-06f50217b90c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:29.912411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3401c-50aa-481a-9c21-06f50217b90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:29.912684 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3401c-50aa-481a-9c21-06f50217b90c admin admin] PATH_INFO: `/v3/users/630500c9bd344fa6adee0bdbce264d41` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:29.914530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3401c-50aa-481a-9c21-06f50217b90c admin admin] RBAC: Authorizing `identity:delete_user(user_id=630500c9bd344fa6adee0bdbce264d41)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:29.916465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3401c-50aa-481a-9c21-06f50217b90c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:29.984594 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-a3371b4a-131d-4f98-8f1c-adbcf71db341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f694ceb03d147f2b5408b5d21ae8e75', 'request_id': 'req-a3371b4a-131d-4f98-8f1c-adbcf71db341'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:30.048162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-a3371b4a-131d-4f98-8f1c-adbcf71db341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f694ceb03d147f2b5408b5d21ae8e75', 'request_id': 'req-a3371b4a-131d-4f98-8f1c-adbcf71db341'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:30.055355 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-a3371b4a-131d-4f98-8f1c-adbcf71db341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f694ceb03d147f2b5408b5d21ae8e75', 'request_id': 'req-a3371b4a-131d-4f98-8f1c-adbcf71db341'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:30.065422 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-a3371b4a-131d-4f98-8f1c-adbcf71db341 admin admin] The token cache is being invalidate because project 0f694ceb03d147f2b5408b5d21ae8e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:30.065697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-a3371b4a-131d-4f98-8f1c-adbcf71db341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:30.066346 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-a3371b4a-131d-4f98-8f1c-adbcf71db341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:30.067904 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 969/1922] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:29 2022] DELETE /identity/v3/projects/0f694ceb03d147f2b5408b5d21ae8e75 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:30.068778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3371b4a-131d-4f98-8f1c-adbcf71db341 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:30.070770 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-a3371b4a-131d-4f98-8f1c-adbcf71db341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:30.119143 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0ee3401c-50aa-481a-9c21-06f50217b90c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630500c9bd344fa6adee0bdbce264d41'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:30.119816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0ee3401c-50aa-481a-9c21-06f50217b90c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630500c9bd344fa6adee0bdbce264d41'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:30.129183 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:30.134274 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3371b4a-131d-4f98-8f1c-adbcf71db341 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:30.138925 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc90d1-5e1c-405d-a1c8-2c6fd33b61d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:30.139585 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc90d1-5e1c-405d-a1c8-2c6fd33b61d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:30.139871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc90d1-5e1c-405d-a1c8-2c6fd33b61d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:30.140179 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc90d1-5e1c-405d-a1c8-2c6fd33b61d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:30.140949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc90d1-5e1c-405d-a1c8-2c6fd33b61d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:30.142546 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc90d1-5e1c-405d-a1c8-2c6fd33b61d7 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:30.153085 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 970/1923] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:30.154006 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc90d1-5e1c-405d-a1c8-2c6fd33b61d7 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:30.155567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-a9cc90d1-5e1c-405d-a1c8-2c6fd33b61d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:30.167740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc90d1-5e1c-405d-a1c8-2c6fd33b61d7 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:30.172422 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e7337-9d62-4b4c-b65f-a4e41bd5d9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:30.173047 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e7337-9d62-4b4c-b65f-a4e41bd5d9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:30.173335 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e7337-9d62-4b4c-b65f-a4e41bd5d9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:30.173616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e7337-9d62-4b4c-b65f-a4e41bd5d9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:30.174329 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e7337-9d62-4b4c-b65f-a4e41bd5d9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:30.175884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e7337-9d62-4b4c-b65f-a4e41bd5d9b5 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:30.179401 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0ee3401c-50aa-481a-9c21-06f50217b90c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630500c9bd344fa6adee0bdbce264d41'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:30.180038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0ee3401c-50aa-481a-9c21-06f50217b90c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630500c9bd344fa6adee0bdbce264d41'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:30.185657 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 971/1924] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:30.186455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e7337-9d62-4b4c-b65f-a4e41bd5d9b5 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:30.188156 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-a46e7337-9d62-4b4c-b65f-a4e41bd5d9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:30.193096 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0ee3401c-50aa-481a-9c21-06f50217b90c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630500c9bd344fa6adee0bdbce264d41'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:30.201059 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e7337-9d62-4b4c-b65f-a4e41bd5d9b5 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:30.205858 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7aab7-e6c0-4908-bc3c-91ab6912c03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:30.206452 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 954/1925] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:29 2022] DELETE /identity/v3/users/630500c9bd344fa6adee0bdbce264d41 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:30.206782 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7aab7-e6c0-4908-bc3c-91ab6912c03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:30.207036 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7aab7-e6c0-4908-bc3c-91ab6912c03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:30.207371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3401c-50aa-481a-9c21-06f50217b90c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:30.207470 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7aab7-e6c0-4908-bc3c-91ab6912c03b admin admin] PATH_INFO: `/v3/users/e749fe50d657492f84ad2b274b1d7088` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:30.208653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7aab7-e6c0-4908-bc3c-91ab6912c03b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e749fe50d657492f84ad2b274b1d7088)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:30.208765 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0ee3401c-50aa-481a-9c21-06f50217b90c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:30.211291 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7aab7-e6c0-4908-bc3c-91ab6912c03b admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:30.271793 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3401c-50aa-481a-9c21-06f50217b90c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:30.277577 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4dc8ab-b93c-440d-a092-979e2fdb83c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:30.278411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4dc8ab-b93c-440d-a092-979e2fdb83c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:30.278798 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4dc8ab-b93c-440d-a092-979e2fdb83c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:30.279071 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4dc8ab-b93c-440d-a092-979e2fdb83c0 admin admin] PATH_INFO: `/v3/projects/2d837d4589624e0699d0715f2f4ad133/users/b339b5033d4340c5b07e22af783c4df2/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:30.302521 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4dc8ab-b93c-440d-a092-979e2fdb83c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d837d4589624e0699d0715f2f4ad133, user_id=b339b5033d4340c5b07e22af783c4df2, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:30.302521 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4dc8ab-b93c-440d-a092-979e2fdb83c0 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:30.437833 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-7ee7aab7-e6c0-4908-bc3c-91ab6912c03b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e749fe50d657492f84ad2b274b1d7088'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:30.445924 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-7ee7aab7-e6c0-4908-bc3c-91ab6912c03b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e749fe50d657492f84ad2b274b1d7088'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:30.446590 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-7ee7aab7-e6c0-4908-bc3c-91ab6912c03b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e749fe50d657492f84ad2b274b1d7088'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:30.447615 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 955/1926] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:30 2022] PUT /identity/v3/projects/2d837d4589624e0699d0715f2f4ad133/users/b339b5033d4340c5b07e22af783c4df2/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:30.448559 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4dc8ab-b93c-440d-a092-979e2fdb83c0 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:30.457910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-2e4dc8ab-b93c-440d-a092-979e2fdb83c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:30.458853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-7ee7aab7-e6c0-4908-bc3c-91ab6912c03b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e749fe50d657492f84ad2b274b1d7088'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:30.459574 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-7ee7aab7-e6c0-4908-bc3c-91ab6912c03b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e749fe50d657492f84ad2b274b1d7088'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:30.519873 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4dc8ab-b93c-440d-a092-979e2fdb83c0 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:30.524530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8d9d6-0045-414a-93d3-338da6a8e4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:30.525410 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8d9d6-0045-414a-93d3-338da6a8e4a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:30.525688 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8d9d6-0045-414a-93d3-338da6a8e4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:30.525993 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8d9d6-0045-414a-93d3-338da6a8e4a4 admin admin] PATH_INFO: `/v3/projects/bb9739cd29e94da4938494e28c4acfd0/users/3b4b0001f3b84286a50cc97717508d04/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:30.539685 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8d9d6-0045-414a-93d3-338da6a8e4a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb9739cd29e94da4938494e28c4acfd0, user_id=3b4b0001f3b84286a50cc97717508d04, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:30.542339 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8d9d6-0045-414a-93d3-338da6a8e4a4 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:30.551440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 972/1927] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:30 2022] DELETE /identity/v3/users/e749fe50d657492f84ad2b274b1d7088 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:30.554586 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33887cd9-b6fd-438e-8508-d1e13104b359 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:30.554586 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33887cd9-b6fd-438e-8508-d1e13104b359 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:30.554586 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33887cd9-b6fd-438e-8508-d1e13104b359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:30.572622 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-33887cd9-b6fd-438e-8508-d1e13104b359 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:30.573812 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-33887cd9-b6fd-438e-8508-d1e13104b359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:30.621964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 956/1928] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:30 2022] PUT /identity/v3/projects/bb9739cd29e94da4938494e28c4acfd0/users/3b4b0001f3b84286a50cc97717508d04/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:30.621964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8d9d6-0045-414a-93d3-338da6a8e4a4 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:30.623518 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b1e8d9d6-0045-414a-93d3-338da6a8e4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:30.664716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 973/1929] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:30.664716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49821d3-1f55-4bf4-b377-cb29ea0360e9 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:30.664716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49821d3-1f55-4bf4-b377-cb29ea0360e9 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:30.664716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49821d3-1f55-4bf4-b377-cb29ea0360e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:30.704077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-d49821d3-1f55-4bf4-b377-cb29ea0360e9 None None] MFA Rules not processed for user `b339b5033d4340c5b07e22af783c4df2`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:30.706840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d49821d3-1f55-4bf4-b377-cb29ea0360e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:30.708177 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8d9d6-0045-414a-93d3-338da6a8e4a4 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:30.712770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd5cad-40de-4778-b11e-9d6a953af4ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:30.717938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd5cad-40de-4778-b11e-9d6a953af4ae service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:30.717938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd5cad-40de-4778-b11e-9d6a953af4ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:30.717938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd5cad-40de-4778-b11e-9d6a953af4ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:30.717938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-ecfd5cad-40de-4778-b11e-9d6a953af4ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:30.786897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd5cad-40de-4778-b11e-9d6a953af4ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:30.788379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd5cad-40de-4778-b11e-9d6a953af4ae service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:30.795089 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 974/1930] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:30.795089 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49821d3-1f55-4bf4-b377-cb29ea0360e9 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:30.799011 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 957/1931] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:30 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:30.799849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd5cad-40de-4778-b11e-9d6a953af4ae service cinder] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:30.804339 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-ecfd5cad-40de-4778-b11e-9d6a953af4ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:30.868432 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd5cad-40de-4778-b11e-9d6a953af4ae service cinder] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:30.872529 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f975c0-e8fd-4f76-8475-b99d6fe0d72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:30.873968 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f975c0-e8fd-4f76-8475-b99d6fe0d72d service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:30.874334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f975c0-e8fd-4f76-8475-b99d6fe0d72d service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:30.874670 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f975c0-e8fd-4f76-8475-b99d6fe0d72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:30.888403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f975c0-e8fd-4f76-8475-b99d6fe0d72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:30.888940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49821d3-1f55-4bf4-b377-cb29ea0360e9 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:30.891054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f975c0-e8fd-4f76-8475-b99d6fe0d72d service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:30.896290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cae322-0714-4198-af36-b715be31a40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:30.896395 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cae322-0714-4198-af36-b715be31a40c admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:30.896689 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cae322-0714-4198-af36-b715be31a40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:30.896969 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cae322-0714-4198-af36-b715be31a40c admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:30.897944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cae322-0714-4198-af36-b715be31a40c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:30.900234 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cae322-0714-4198-af36-b715be31a40c admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:30.904258 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 958/1932] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:30.905183 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f975c0-e8fd-4f76-8475-b99d6fe0d72d service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:30.907240 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-60f975c0-e8fd-4f76-8475-b99d6fe0d72d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:30.915370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 975/1933] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:30.916458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cae322-0714-4198-af36-b715be31a40c admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:30.922661 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f975c0-e8fd-4f76-8475-b99d6fe0d72d service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:30.927696 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cae322-0714-4198-af36-b715be31a40c admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:30.929497 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60938703-dfe8-48c1-af8d-4ab46720cd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:30.930341 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60938703-dfe8-48c1-af8d-4ab46720cd63 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:30.930712 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60938703-dfe8-48c1-af8d-4ab46720cd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:30.931378 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60938703-dfe8-48c1-af8d-4ab46720cd63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:30.931684 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60938703-dfe8-48c1-af8d-4ab46720cd63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:30.933740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1284ccb-9bf7-4423-a71b-5b223943e1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:30.933855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60938703-dfe8-48c1-af8d-4ab46720cd63 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:30.935432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1284ccb-9bf7-4423-a71b-5b223943e1dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:30.935432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1284ccb-9bf7-4423-a71b-5b223943e1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:30.935432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1284ccb-9bf7-4423-a71b-5b223943e1dd admin admin] PATH_INFO: `/v3/projects/bb9739cd29e94da4938494e28c4acfd0/users/3b4b0001f3b84286a50cc97717508d04/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:30.937488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1284ccb-9bf7-4423-a71b-5b223943e1dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb9739cd29e94da4938494e28c4acfd0, user_id=3b4b0001f3b84286a50cc97717508d04, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:30.940910 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1284ccb-9bf7-4423-a71b-5b223943e1dd admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:30.954266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 976/1934] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:30 2022] PUT /identity/v3/projects/bb9739cd29e94da4938494e28c4acfd0/users/3b4b0001f3b84286a50cc97717508d04/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:30.966387 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b2ab-34e4-4626-84e3-c76a08234ead None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:30.966703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b2ab-34e4-4626-84e3-c76a08234ead None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:30.967373 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b2ab-34e4-4626-84e3-c76a08234ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:31.012402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-84a3b2ab-34e4-4626-84e3-c76a08234ead None None] MFA Rules not processed for user `3b4b0001f3b84286a50cc97717508d04`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:31.014344 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-84a3b2ab-34e4-4626-84e3-c76a08234ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:31.039809 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 959/1935] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:30 2022] POST /identity/v3/projects => generated 393 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:31.043877 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60938703-dfe8-48c1-af8d-4ab46720cd63 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:31.128941 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 977/1936] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:30 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:59:31.140539 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3b2ab-34e4-4626-84e3-c76a08234ead None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:31.158842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60938703-dfe8-48c1-af8d-4ab46720cd63 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:31.162049 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55781a-7b59-43a9-85a4-bf2320a75cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:31.164041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55781a-7b59-43a9-85a4-bf2320a75cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:31.164457 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55781a-7b59-43a9-85a4-bf2320a75cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:31.169358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55781a-7b59-43a9-85a4-bf2320a75cb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:31.169358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55781a-7b59-43a9-85a4-bf2320a75cb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:31.169358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55781a-7b59-43a9-85a4-bf2320a75cb7 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:31.222461 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:31.228198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3b2ab-34e4-4626-84e3-c76a08234ead None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:31.256196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 960/1937] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:31 2022] POST /identity/v3/users => generated 303 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:31.257142 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55781a-7b59-43a9-85a4-bf2320a75cb7 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:31.260782 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-5c55781a-7b59-43a9-85a4-bf2320a75cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:31.291854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55781a-7b59-43a9-85a4-bf2320a75cb7 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:31.301585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd80b79-a4e6-4d1e-a0fd-e5adb38d3815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:31.302153 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd80b79-a4e6-4d1e-a0fd-e5adb38d3815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:31.302731 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd80b79-a4e6-4d1e-a0fd-e5adb38d3815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:31.303457 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd80b79-a4e6-4d1e-a0fd-e5adb38d3815 admin admin] PATH_INFO: `/v3/projects/3a749a13893042e794d8f066fb7de02b` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:31.305110 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd80b79-a4e6-4d1e-a0fd-e5adb38d3815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a749a13893042e794d8f066fb7de02b)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:31.307578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd80b79-a4e6-4d1e-a0fd-e5adb38d3815 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:31.316778 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f09ef-585a-47b7-97f6-27004d7d7ac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:31.317528 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f09ef-585a-47b7-97f6-27004d7d7ac9 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:31.317882 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f09ef-585a-47b7-97f6-27004d7d7ac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:31.318227 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f09ef-585a-47b7-97f6-27004d7d7ac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:31.396622 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f09ef-585a-47b7-97f6-27004d7d7ac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:31.399277 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f09ef-585a-47b7-97f6-27004d7d7ac9 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:31.414019 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 978/1938] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 16:59:31.414719 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f09ef-585a-47b7-97f6-27004d7d7ac9 service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:31.425711 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f09ef-585a-47b7-97f6-27004d7d7ac9 service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:31.450241 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac27f9-d2e7-4e7e-9b4c-6c3c116fb10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:31.450800 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac27f9-d2e7-4e7e-9b4c-6c3c116fb10a admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:31.451161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac27f9-d2e7-4e7e-9b4c-6c3c116fb10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:31.452436 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac27f9-d2e7-4e7e-9b4c-6c3c116fb10a admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:31.453575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac27f9-d2e7-4e7e-9b4c-6c3c116fb10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:31.456617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac27f9-d2e7-4e7e-9b4c-6c3c116fb10a admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:31.474358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 979/1939] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:31.474358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac27f9-d2e7-4e7e-9b4c-6c3c116fb10a admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:31.474835 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-bcac27f9-d2e7-4e7e-9b4c-6c3c116fb10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:31.485570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-9cd80b79-a4e6-4d1e-a0fd-e5adb38d3815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a749a13893042e794d8f066fb7de02b', 'request_id': 'req-9cd80b79-a4e6-4d1e-a0fd-e5adb38d3815'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:31.489093 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac27f9-d2e7-4e7e-9b4c-6c3c116fb10a admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:31.544806 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5cf29-bce6-47cf-af3b-56410689f2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:31.545677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5cf29-bce6-47cf-af3b-56410689f2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:31.545956 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5cf29-bce6-47cf-af3b-56410689f2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:31.546229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5cf29-bce6-47cf-af3b-56410689f2c7 admin admin] PATH_INFO: `/v3/projects/3b393da9a05542aaa39af0b0acb3e974` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:31.547426 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5cf29-bce6-47cf-af3b-56410689f2c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b393da9a05542aaa39af0b0acb3e974)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:31.549365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5cf29-bce6-47cf-af3b-56410689f2c7 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:31.590914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-9cd80b79-a4e6-4d1e-a0fd-e5adb38d3815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a749a13893042e794d8f066fb7de02b', 'request_id': 'req-9cd80b79-a4e6-4d1e-a0fd-e5adb38d3815'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:31.597024 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-9cd80b79-a4e6-4d1e-a0fd-e5adb38d3815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a749a13893042e794d8f066fb7de02b', 'request_id': 'req-9cd80b79-a4e6-4d1e-a0fd-e5adb38d3815'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:31.609382 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-9cd80b79-a4e6-4d1e-a0fd-e5adb38d3815 admin admin] The token cache is being invalidate because project 3a749a13893042e794d8f066fb7de02b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:31.609843 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-9cd80b79-a4e6-4d1e-a0fd-e5adb38d3815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:31.610635 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-9cd80b79-a4e6-4d1e-a0fd-e5adb38d3815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:31.612319 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 961/1940] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:31 2022] DELETE /identity/v3/projects/3a749a13893042e794d8f066fb7de02b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:31.613145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd80b79-a4e6-4d1e-a0fd-e5adb38d3815 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:31.614503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-9cd80b79-a4e6-4d1e-a0fd-e5adb38d3815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:31.623609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:31.628774 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd80b79-a4e6-4d1e-a0fd-e5adb38d3815 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:31.633966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568122c-faf1-46de-938e-595363eaf667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:31.634830 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568122c-faf1-46de-938e-595363eaf667 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:31.635143 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568122c-faf1-46de-938e-595363eaf667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:31.635396 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568122c-faf1-46de-938e-595363eaf667 admin admin] PATH_INFO: `/v3/projects/8c3fec0814aa4eb2b395237eba0eb7be/users/cd3ccc8930f04e22bb45413854720c43/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:31.650281 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568122c-faf1-46de-938e-595363eaf667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3fec0814aa4eb2b395237eba0eb7be, user_id=cd3ccc8930f04e22bb45413854720c43, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:31.653240 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568122c-faf1-46de-938e-595363eaf667 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:31.743508 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 962/1941] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:31 2022] PUT /identity/v3/projects/8c3fec0814aa4eb2b395237eba0eb7be/users/cd3ccc8930f04e22bb45413854720c43/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:31.744459 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568122c-faf1-46de-938e-595363eaf667 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:31.746066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-4568122c-faf1-46de-938e-595363eaf667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:31.751364 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-65f5cf29-bce6-47cf-af3b-56410689f2c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b393da9a05542aaa39af0b0acb3e974', 'request_id': 'req-65f5cf29-bce6-47cf-af3b-56410689f2c7'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:31.805587 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568122c-faf1-46de-938e-595363eaf667 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:31.823669 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-65f5cf29-bce6-47cf-af3b-56410689f2c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b393da9a05542aaa39af0b0acb3e974', 'request_id': 'req-65f5cf29-bce6-47cf-af3b-56410689f2c7'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:31.830545 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-65f5cf29-bce6-47cf-af3b-56410689f2c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b393da9a05542aaa39af0b0acb3e974', 'request_id': 'req-65f5cf29-bce6-47cf-af3b-56410689f2c7'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:31.841949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-65f5cf29-bce6-47cf-af3b-56410689f2c7 admin admin] The token cache is being invalidate because project 3b393da9a05542aaa39af0b0acb3e974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:31.842238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-65f5cf29-bce6-47cf-af3b-56410689f2c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:31.842905 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-65f5cf29-bce6-47cf-af3b-56410689f2c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:31.847722 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 980/1942] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:31 2022] DELETE /identity/v3/projects/3b393da9a05542aaa39af0b0acb3e974 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:31.847722 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c84c6e-b0a8-497e-8611-4f14001d05c5 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:31.847722 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c84c6e-b0a8-497e-8611-4f14001d05c5 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:31.847722 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c84c6e-b0a8-497e-8611-4f14001d05c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:31.863771 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24238d31-cb2d-4f05-a18a-3acb79428b3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:31.864561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24238d31-cb2d-4f05-a18a-3acb79428b3e service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:31.864982 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24238d31-cb2d-4f05-a18a-3acb79428b3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:31.865077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-f8c84c6e-b0a8-497e-8611-4f14001d05c5 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:31.865336 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24238d31-cb2d-4f05-a18a-3acb79428b3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:31.866250 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f8c84c6e-b0a8-497e-8611-4f14001d05c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:31.868364 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-24238d31-cb2d-4f05-a18a-3acb79428b3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:31.948449 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24238d31-cb2d-4f05-a18a-3acb79428b3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:31.950043 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24238d31-cb2d-4f05-a18a-3acb79428b3e service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:31.959621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 963/1943] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:31.966222 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 981/1944] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:31.966815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24238d31-cb2d-4f05-a18a-3acb79428b3e service cinder] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:31.966815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-24238d31-cb2d-4f05-a18a-3acb79428b3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:31.967063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141968c7-bcd4-4b19-b5e3-a632eb4ce6b6 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:31.967063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141968c7-bcd4-4b19-b5e3-a632eb4ce6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:31.967063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141968c7-bcd4-4b19-b5e3-a632eb4ce6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:31.975197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24238d31-cb2d-4f05-a18a-3acb79428b3e service cinder] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:31.980210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f44cb-86d3-4d44-a8fa-e1f3c8cb3e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:31.980878 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f44cb-86d3-4d44-a8fa-e1f3c8cb3e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:31.981157 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f44cb-86d3-4d44-a8fa-e1f3c8cb3e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:31.981486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f44cb-86d3-4d44-a8fa-e1f3c8cb3e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:31.982281 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f44cb-86d3-4d44-a8fa-e1f3c8cb3e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:31.984034 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f44cb-86d3-4d44-a8fa-e1f3c8cb3e16 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:31.988138 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-141968c7-bcd4-4b19-b5e3-a632eb4ce6b6 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:31.989592 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-141968c7-bcd4-4b19-b5e3-a632eb4ce6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:31.998431 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 964/1945] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:31.998431 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a29994-e498-42ea-9c70-5f89536c6969 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:31.998854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a29994-e498-42ea-9c70-5f89536c6969 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:31.999145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a29994-e498-42ea-9c70-5f89536c6969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:32.015649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 982/1946] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:32.015649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141968c7-bcd4-4b19-b5e3-a632eb4ce6b6 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:32.025645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-57a29994-e498-42ea-9c70-5f89536c6969 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:32.027587 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-57a29994-e498-42ea-9c70-5f89536c6969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:32.029487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141968c7-bcd4-4b19-b5e3-a632eb4ce6b6 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:32.035049 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745578b-2c4b-411d-81bc-b6584fb15126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:32.036552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 965/1947] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:32.036692 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745578b-2c4b-411d-81bc-b6584fb15126 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:32.037887 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d418b-e970-480e-8ebd-6c0dbde1f8a3 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:32.038677 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d418b-e970-480e-8ebd-6c0dbde1f8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:32.039255 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d418b-e970-480e-8ebd-6c0dbde1f8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:32.040452 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745578b-2c4b-411d-81bc-b6584fb15126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:32.040963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745578b-2c4b-411d-81bc-b6584fb15126 admin admin] PATH_INFO: `/v3/projects/8c3fec0814aa4eb2b395237eba0eb7be/users/cd3ccc8930f04e22bb45413854720c43/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:32.043694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745578b-2c4b-411d-81bc-b6584fb15126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3fec0814aa4eb2b395237eba0eb7be, user_id=cd3ccc8930f04e22bb45413854720c43, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:32.048193 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745578b-2c4b-411d-81bc-b6584fb15126 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:32.064707 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-6a2d418b-e970-480e-8ebd-6c0dbde1f8a3 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:32.066378 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6a2d418b-e970-480e-8ebd-6c0dbde1f8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:32.072570 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 983/1948] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:32 2022] PUT /identity/v3/projects/8c3fec0814aa4eb2b395237eba0eb7be/users/cd3ccc8930f04e22bb45413854720c43/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:32.073616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745578b-2c4b-411d-81bc-b6584fb15126 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:32.156736 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745578b-2c4b-411d-81bc-b6584fb15126 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:32.162777 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a100ae-13ec-45a2-9914-4f20e0effc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:32.167137 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 966/1949] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:32.167253 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a100ae-13ec-45a2-9914-4f20e0effc34 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:32.167253 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a100ae-13ec-45a2-9914-4f20e0effc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:32.167253 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a100ae-13ec-45a2-9914-4f20e0effc34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:32.167253 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a100ae-13ec-45a2-9914-4f20e0effc34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:59:32.167253 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a100ae-13ec-45a2-9914-4f20e0effc34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:32.168543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb970e99-2585-4c28-976b-858f0b9dc756 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:32.168858 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a100ae-13ec-45a2-9914-4f20e0effc34 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:32.169008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb970e99-2585-4c28-976b-858f0b9dc756 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:32.169185 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb970e99-2585-4c28-976b-858f0b9dc756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:32.196938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 984/1950] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:59:32.197983 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a100ae-13ec-45a2-9914-4f20e0effc34 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:32.218750 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a100ae-13ec-45a2-9914-4f20e0effc34 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:32.220796 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-cb970e99-2585-4c28-976b-858f0b9dc756 None None] MFA Rules not processed for user `cd3ccc8930f04e22bb45413854720c43`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:32.222253 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-cb970e99-2585-4c28-976b-858f0b9dc756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:32.224443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7280d49-b31c-4f2d-9f81-fdd80aea9c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:32.225262 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7280d49-b31c-4f2d-9f81-fdd80aea9c95 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:32.225744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7280d49-b31c-4f2d-9f81-fdd80aea9c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:32.226096 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7280d49-b31c-4f2d-9f81-fdd80aea9c95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:32.227261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7280d49-b31c-4f2d-9f81-fdd80aea9c95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:59:32.227643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7280d49-b31c-4f2d-9f81-fdd80aea9c95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:32.230360 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7280d49-b31c-4f2d-9f81-fdd80aea9c95 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:32.241726 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:32.253144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 985/1951] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:59:32.254377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7280d49-b31c-4f2d-9f81-fdd80aea9c95 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:32.268640 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7280d49-b31c-4f2d-9f81-fdd80aea9c95 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:32.280913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c1396-1755-4750-9339-146acafdcbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:32.280913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c1396-1755-4750-9339-146acafdcbbf admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:32.280913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c1396-1755-4750-9339-146acafdcbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:32.280913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c1396-1755-4750-9339-146acafdcbbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:32.281366 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c1396-1755-4750-9339-146acafdcbbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:32.281366 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c1396-1755-4750-9339-146acafdcbbf admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:32.317619 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 967/1952] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:32.318432 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb970e99-2585-4c28-976b-858f0b9dc756 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:32.332293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb970e99-2585-4c28-976b-858f0b9dc756 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:32.337700 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74708e-90c7-4f59-b33e-02da806a3eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:32.338484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74708e-90c7-4f59-b33e-02da806a3eee admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:32.338721 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74708e-90c7-4f59-b33e-02da806a3eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:32.343051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74708e-90c7-4f59-b33e-02da806a3eee admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:32.343051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74708e-90c7-4f59-b33e-02da806a3eee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:32.343051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74708e-90c7-4f59-b33e-02da806a3eee admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:32.410426 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 986/1953] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:32 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:32.412063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c1396-1755-4750-9339-146acafdcbbf admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:32.414515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-838c1396-1755-4750-9339-146acafdcbbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:32.468186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 968/1954] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:32 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:32.469095 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74708e-90c7-4f59-b33e-02da806a3eee admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:32.474207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c1396-1755-4750-9339-146acafdcbbf admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:32.527530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35603a72-318a-4bb5-99fc-f7ce2c0fd4de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:32.528269 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35603a72-318a-4bb5-99fc-f7ce2c0fd4de service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:32.528557 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35603a72-318a-4bb5-99fc-f7ce2c0fd4de service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:32.528841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35603a72-318a-4bb5-99fc-f7ce2c0fd4de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:32.541321 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74708e-90c7-4f59-b33e-02da806a3eee admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:32.545957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6c0be-fdb9-429d-ae0f-c2043b131170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:32.546615 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6c0be-fdb9-429d-ae0f-c2043b131170 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:32.546899 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6c0be-fdb9-429d-ae0f-c2043b131170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:32.547178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6c0be-fdb9-429d-ae0f-c2043b131170 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:32.547894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6c0be-fdb9-429d-ae0f-c2043b131170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:32.549837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6c0be-fdb9-429d-ae0f-c2043b131170 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:32.593094 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35603a72-318a-4bb5-99fc-f7ce2c0fd4de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:32.594264 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35603a72-318a-4bb5-99fc-f7ce2c0fd4de service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:32.605346 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 987/1955] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:32.605346 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35603a72-318a-4bb5-99fc-f7ce2c0fd4de service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:32.617488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35603a72-318a-4bb5-99fc-f7ce2c0fd4de service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:32.622473 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9c445-225a-47e1-bb5f-3ba1eacf2e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:32.623275 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9c445-225a-47e1-bb5f-3ba1eacf2e5e admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:32.623569 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9c445-225a-47e1-bb5f-3ba1eacf2e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:32.623850 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9c445-225a-47e1-bb5f-3ba1eacf2e5e admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:32.624592 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9c445-225a-47e1-bb5f-3ba1eacf2e5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:32.626583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9c445-225a-47e1-bb5f-3ba1eacf2e5e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:32.668548 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 969/1956] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:32 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:32.669732 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6c0be-fdb9-429d-ae0f-c2043b131170 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:32.680856 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6c0be-fdb9-429d-ae0f-c2043b131170 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:32.685639 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18d709-bd16-4a60-98e5-1d8533a47688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:32.686298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18d709-bd16-4a60-98e5-1d8533a47688 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:32.686579 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18d709-bd16-4a60-98e5-1d8533a47688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:32.686873 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18d709-bd16-4a60-98e5-1d8533a47688 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:32.687582 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18d709-bd16-4a60-98e5-1d8533a47688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:32.689209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18d709-bd16-4a60-98e5-1d8533a47688 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:32.702267 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 970/1957] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 16:59:32.702267 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18d709-bd16-4a60-98e5-1d8533a47688 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:32.709318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18d709-bd16-4a60-98e5-1d8533a47688 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:32.713515 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442b1de-00dd-49b9-a990-272e926fc590 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:32.714117 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442b1de-00dd-49b9-a990-272e926fc590 service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:32.714399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442b1de-00dd-49b9-a990-272e926fc590 service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:32.714679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442b1de-00dd-49b9-a990-272e926fc590 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:32.716777 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-d442b1de-00dd-49b9-a990-272e926fc590 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:32.752560 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 988/1958] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:32 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:32.752560 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9c445-225a-47e1-bb5f-3ba1eacf2e5e admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:32.760361 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9c445-225a-47e1-bb5f-3ba1eacf2e5e admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:32.765201 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95299c3-bbb6-4ccd-a50a-7d0798ce19aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:32.765857 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95299c3-bbb6-4ccd-a50a-7d0798ce19aa admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:32.766144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95299c3-bbb6-4ccd-a50a-7d0798ce19aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:32.766425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95299c3-bbb6-4ccd-a50a-7d0798ce19aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:32.767164 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95299c3-bbb6-4ccd-a50a-7d0798ce19aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:32.768816 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95299c3-bbb6-4ccd-a50a-7d0798ce19aa admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:32.775720 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442b1de-00dd-49b9-a990-272e926fc590 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:32.777597 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442b1de-00dd-49b9-a990-272e926fc590 service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:32.779578 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 989/1959] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:32.780459 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95299c3-bbb6-4ccd-a50a-7d0798ce19aa admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:32.790108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 971/1960] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:32.791137 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95299c3-bbb6-4ccd-a50a-7d0798ce19aa admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:32.792687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442b1de-00dd-49b9-a990-272e926fc590 service cinder] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:32.809735 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442b1de-00dd-49b9-a990-272e926fc590 service cinder] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:32.812768 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f44cd2-cf4d-4142-9109-889776a972c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:32.813447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f44cd2-cf4d-4142-9109-889776a972c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:32.813743 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f44cd2-cf4d-4142-9109-889776a972c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:32.814035 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f44cd2-cf4d-4142-9109-889776a972c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:32.814784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f44cd2-cf4d-4142-9109-889776a972c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:32.815412 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ac0c6-55e1-4b02-90d5-703a6859579f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:32.816440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f44cd2-cf4d-4142-9109-889776a972c1 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:32.816640 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ac0c6-55e1-4b02-90d5-703a6859579f admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:32.816995 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ac0c6-55e1-4b02-90d5-703a6859579f admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:32.817195 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ac0c6-55e1-4b02-90d5-703a6859579f admin admin] PATH_INFO: `/v3/projects/ba479e7b130e45d4b224f9b7fad34740/users/5640de18fda644ee92c83852b53ef7da/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:32.833645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ac0c6-55e1-4b02-90d5-703a6859579f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba479e7b130e45d4b224f9b7fad34740, user_id=5640de18fda644ee92c83852b53ef7da, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:32.837511 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ac0c6-55e1-4b02-90d5-703a6859579f admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:32.840307 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 990/1961] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:32.844165 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f44cd2-cf4d-4142-9109-889776a972c1 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:32.853286 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:32.856751 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f44cd2-cf4d-4142-9109-889776a972c1 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:32.862589 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bd3c2-3c1a-4975-95b8-66c743b4b2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:32.863384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bd3c2-3c1a-4975-95b8-66c743b4b2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:32.864405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bd3c2-3c1a-4975-95b8-66c743b4b2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:32.864720 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bd3c2-3c1a-4975-95b8-66c743b4b2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:32.865465 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bd3c2-3c1a-4975-95b8-66c743b4b2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:32.867929 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bd3c2-3c1a-4975-95b8-66c743b4b2a7 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:32.883570 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 991/1962] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 16:59:32.887571 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bd3c2-3c1a-4975-95b8-66c743b4b2a7 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:32.902403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bd3c2-3c1a-4975-95b8-66c743b4b2a7 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:32.907871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25131d9-4f72-4412-bbf0-837da9c087cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:32.909048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25131d9-4f72-4412-bbf0-837da9c087cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:32.915167 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25131d9-4f72-4412-bbf0-837da9c087cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:32.915167 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25131d9-4f72-4412-bbf0-837da9c087cc admin admin] PATH_INFO: `/v3/projects/34cde55dd2ae4e84a03c205b34d16c46/users/43cdf1e065d543f783a15eb53e6f3830/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:32.915381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 972/1963] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:32 2022] PUT /identity/v3/projects/ba479e7b130e45d4b224f9b7fad34740/users/5640de18fda644ee92c83852b53ef7da/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:32.925346 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4666136-923a-42e5-a776-d8c6cc06985a None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:32.925530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4666136-923a-42e5-a776-d8c6cc06985a None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:32.925742 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4666136-923a-42e5-a776-d8c6cc06985a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:32.929159 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25131d9-4f72-4412-bbf0-837da9c087cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=34cde55dd2ae4e84a03c205b34d16c46, user_id=43cdf1e065d543f783a15eb53e6f3830, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:32.932809 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25131d9-4f72-4412-bbf0-837da9c087cc admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:32.958685 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-b4666136-923a-42e5-a776-d8c6cc06985a None None] MFA Rules not processed for user `5640de18fda644ee92c83852b53ef7da`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:32.960466 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b4666136-923a-42e5-a776-d8c6cc06985a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:33.031653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 992/1964] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:32 2022] PUT /identity/v3/projects/34cde55dd2ae4e84a03c205b34d16c46/users/43cdf1e065d543f783a15eb53e6f3830/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:33.039966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 973/1965] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:33.041429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25131d9-4f72-4412-bbf0-837da9c087cc admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:33.045458 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117723f-e6ad-45c6-adad-83b691b35b57 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:33.046288 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117723f-e6ad-45c6-adad-83b691b35b57 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:33.047414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117723f-e6ad-45c6-adad-83b691b35b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:33.079127 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-5117723f-e6ad-45c6-adad-83b691b35b57 None None] MFA Rules not processed for user `43cdf1e065d543f783a15eb53e6f3830`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:33.080464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-5117723f-e6ad-45c6-adad-83b691b35b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:33.117048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25131d9-4f72-4412-bbf0-837da9c087cc admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:33.122463 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43878d0-811c-48e9-95a2-d7a60fdb19c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:33.123106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43878d0-811c-48e9-95a2-d7a60fdb19c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:33.123106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43878d0-811c-48e9-95a2-d7a60fdb19c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:33.123346 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43878d0-811c-48e9-95a2-d7a60fdb19c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:33.124120 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43878d0-811c-48e9-95a2-d7a60fdb19c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:33.126052 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43878d0-811c-48e9-95a2-d7a60fdb19c0 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:33.160673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 974/1966] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:33.227837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 993/1967] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:33 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:33.231662 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117723f-e6ad-45c6-adad-83b691b35b57 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:33.243792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117723f-e6ad-45c6-adad-83b691b35b57 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:33.312483 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b9e77-88fd-48dd-b707-423425a12046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:33.312483 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b9e77-88fd-48dd-b707-423425a12046 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:33.312483 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b9e77-88fd-48dd-b707-423425a12046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:33.312483 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b9e77-88fd-48dd-b707-423425a12046 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:33.312839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b9e77-88fd-48dd-b707-423425a12046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:33.312839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b9e77-88fd-48dd-b707-423425a12046 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:33.326643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43878d0-811c-48e9-95a2-d7a60fdb19c0 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:33.328531 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f43878d0-811c-48e9-95a2-d7a60fdb19c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:33.422802 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 975/1968] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:33 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:33.425050 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b9e77-88fd-48dd-b707-423425a12046 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:33.425287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43878d0-811c-48e9-95a2-d7a60fdb19c0 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:33.438125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66038d-3b56-4e0c-a6ae-9ac012853d57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:33.438807 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66038d-3b56-4e0c-a6ae-9ac012853d57 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:33.439095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66038d-3b56-4e0c-a6ae-9ac012853d57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:33.439379 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66038d-3b56-4e0c-a6ae-9ac012853d57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:33.449903 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b9e77-88fd-48dd-b707-423425a12046 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:33.468878 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b01041-8a06-4cc9-b0a9-c0cee099dacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:33.469736 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b01041-8a06-4cc9-b0a9-c0cee099dacb admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:33.470127 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b01041-8a06-4cc9-b0a9-c0cee099dacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:33.470510 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b01041-8a06-4cc9-b0a9-c0cee099dacb admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:33.471395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b01041-8a06-4cc9-b0a9-c0cee099dacb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:33.473172 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b01041-8a06-4cc9-b0a9-c0cee099dacb admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:33.511271 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 976/1969] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:33.513449 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b01041-8a06-4cc9-b0a9-c0cee099dacb admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:33.530091 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b01041-8a06-4cc9-b0a9-c0cee099dacb admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:33.537118 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07afc9-768a-438b-98f3-0143ff9161e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:33.538647 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07afc9-768a-438b-98f3-0143ff9161e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:33.538942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07afc9-768a-438b-98f3-0143ff9161e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:33.539202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07afc9-768a-438b-98f3-0143ff9161e8 admin admin] PATH_INFO: `/v3/projects/099baa80ac294f21854a1318207cd647/users/63648f16a35949379302d8d83dd83f4c/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:33.546505 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66038d-3b56-4e0c-a6ae-9ac012853d57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:33.548382 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66038d-3b56-4e0c-a6ae-9ac012853d57 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:33.561450 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07afc9-768a-438b-98f3-0143ff9161e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=099baa80ac294f21854a1318207cd647, user_id=63648f16a35949379302d8d83dd83f4c, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:33.563286 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 994/1970] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:33.565105 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07afc9-768a-438b-98f3-0143ff9161e8 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:33.637682 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 977/1971] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:33 2022] PUT /identity/v3/projects/099baa80ac294f21854a1318207cd647/users/63648f16a35949379302d8d83dd83f4c/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:33.641395 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66038d-3b56-4e0c-a6ae-9ac012853d57 service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:33.664840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66038d-3b56-4e0c-a6ae-9ac012853d57 service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:33.804789 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e86f1-b1b1-4c0e-802e-62809ff4ab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:33.805692 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e86f1-b1b1-4c0e-802e-62809ff4ab2e admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:33.805985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e86f1-b1b1-4c0e-802e-62809ff4ab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:33.806270 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e86f1-b1b1-4c0e-802e-62809ff4ab2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:33.807469 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e86f1-b1b1-4c0e-802e-62809ff4ab2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:33.809618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e86f1-b1b1-4c0e-802e-62809ff4ab2e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:33.827298 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 995/1972] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:33.831378 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07afc9-768a-438b-98f3-0143ff9161e8 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:33.848601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07afc9-768a-438b-98f3-0143ff9161e8 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:33.873123 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623594a6-cff8-4fea-83bf-b426fc5a9e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:33.874011 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623594a6-cff8-4fea-83bf-b426fc5a9e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:33.874302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623594a6-cff8-4fea-83bf-b426fc5a9e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:33.874636 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623594a6-cff8-4fea-83bf-b426fc5a9e02 admin admin] PATH_INFO: `/v3/projects/099baa80ac294f21854a1318207cd647/users/63648f16a35949379302d8d83dd83f4c/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:33.877637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623594a6-cff8-4fea-83bf-b426fc5a9e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=099baa80ac294f21854a1318207cd647, user_id=63648f16a35949379302d8d83dd83f4c, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:33.880709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623594a6-cff8-4fea-83bf-b426fc5a9e02 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:33.893012 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 978/1973] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:33 2022] PUT /identity/v3/projects/099baa80ac294f21854a1318207cd647/users/63648f16a35949379302d8d83dd83f4c/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:33.903805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570e227-b406-4c70-9ba9-81095b7cd09e None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:33.904140 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570e227-b406-4c70-9ba9-81095b7cd09e None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:33.904427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570e227-b406-4c70-9ba9-81095b7cd09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:33.938835 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-3570e227-b406-4c70-9ba9-81095b7cd09e None None] MFA Rules not processed for user `63648f16a35949379302d8d83dd83f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:33.940218 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3570e227-b406-4c70-9ba9-81095b7cd09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:33.991211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca291d14-db79-45c6-a6ff-72c4a8fec40e None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:33.991739 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca291d14-db79-45c6-a6ff-72c4a8fec40e None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:33.991957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca291d14-db79-45c6-a6ff-72c4a8fec40e None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:33.993499 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 979/1974] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 16:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 16:59:34.011923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec77598-c82a-45df-9b09-54cd86425b51 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:34.012409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec77598-c82a-45df-9b09-54cd86425b51 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:34.012701 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec77598-c82a-45df-9b09-54cd86425b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:34.021433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 996/1975] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:34.045032 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-0ec77598-c82a-45df-9b09-54cd86425b51 None None] MFA Rules not processed for user `78e7bdfffdc84465a570d135d1d86380`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:34.046262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0ec77598-c82a-45df-9b09-54cd86425b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:34.132648 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 980/1976] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 16:59:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 16:59:34.143426 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570e227-b406-4c70-9ba9-81095b7cd09e None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:34.147911 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec77598-c82a-45df-9b09-54cd86425b51 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:34.149366 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0ec77598-c82a-45df-9b09-54cd86425b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:34.164549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec77598-c82a-45df-9b09-54cd86425b51 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:34.168080 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:34.171587 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69df27-f356-4b77-a9e9-5c0b99f0428f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:34.173705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69df27-f356-4b77-a9e9-5c0b99f0428f service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:34.173705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69df27-f356-4b77-a9e9-5c0b99f0428f service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:34.173705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69df27-f356-4b77-a9e9-5c0b99f0428f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:34.183803 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69df27-f356-4b77-a9e9-5c0b99f0428f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:34.185480 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69df27-f356-4b77-a9e9-5c0b99f0428f service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:34.197300 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 981/1977] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 16:59:34.211837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570e227-b406-4c70-9ba9-81095b7cd09e None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:34.218682 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5f61b-5dc9-4d96-92ed-f03a16773109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:34.219348 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5f61b-5dc9-4d96-92ed-f03a16773109 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:34.219635 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5f61b-5dc9-4d96-92ed-f03a16773109 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:34.219918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5f61b-5dc9-4d96-92ed-f03a16773109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:34.280831 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5f61b-5dc9-4d96-92ed-f03a16773109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:34.282345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5f61b-5dc9-4d96-92ed-f03a16773109 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:34.291935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 997/1978] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:35.024640 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:35.955497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:36.687697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:38.251831 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:38.509668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69df27-f356-4b77-a9e9-5c0b99f0428f service nova] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:38.511082 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-db69df27-f356-4b77-a9e9-5c0b99f0428f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:38.557390 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:38.576129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69df27-f356-4b77-a9e9-5c0b99f0428f service nova] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:38.580627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb18b7-868a-465e-a46f-aad9cc5e0a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:38.581581 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb18b7-868a-465e-a46f-aad9cc5e0a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:38.581866 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb18b7-868a-465e-a46f-aad9cc5e0a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:38.582140 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb18b7-868a-465e-a46f-aad9cc5e0a97 admin admin] PATH_INFO: `/v3/users/be963ba1a8d64d39bc2e2c862c37be55` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:38.583321 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb18b7-868a-465e-a46f-aad9cc5e0a97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be963ba1a8d64d39bc2e2c862c37be55)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:38.585883 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb18b7-868a-465e-a46f-aad9cc5e0a97 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:38.758394 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4bfb18b7-868a-465e-a46f-aad9cc5e0a97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be963ba1a8d64d39bc2e2c862c37be55'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:38.759028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4bfb18b7-868a-465e-a46f-aad9cc5e0a97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be963ba1a8d64d39bc2e2c862c37be55'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:38.825238 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4bfb18b7-868a-465e-a46f-aad9cc5e0a97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be963ba1a8d64d39bc2e2c862c37be55'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:38.826318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4bfb18b7-868a-465e-a46f-aad9cc5e0a97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be963ba1a8d64d39bc2e2c862c37be55'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:38.849867 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4bfb18b7-868a-465e-a46f-aad9cc5e0a97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be963ba1a8d64d39bc2e2c862c37be55'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:38.868227 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 982/1979] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:38 2022] DELETE /identity/v3/users/be963ba1a8d64d39bc2e2c862c37be55 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:38.872930 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190a37f-5718-4ef3-8601-7aaf9a8c076a None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:38.873321 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190a37f-5718-4ef3-8601-7aaf9a8c076a None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:38.873613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2190a37f-5718-4ef3-8601-7aaf9a8c076a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:38.892432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-2190a37f-5718-4ef3-8601-7aaf9a8c076a None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:38.893645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2190a37f-5718-4ef3-8601-7aaf9a8c076a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:38.954625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 998/1980] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:38.964258 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb18b7-868a-465e-a46f-aad9cc5e0a97 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:38.966088 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-4bfb18b7-868a-465e-a46f-aad9cc5e0a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:39.027122 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb18b7-868a-465e-a46f-aad9cc5e0a97 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:39.031247 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc6e05-32c8-4476-9450-0655862ca54a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:39.031953 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc6e05-32c8-4476-9450-0655862ca54a service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:39.032276 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc6e05-32c8-4476-9450-0655862ca54a service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:39.032559 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc6e05-32c8-4476-9450-0655862ca54a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:39.044900 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc6e05-32c8-4476-9450-0655862ca54a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:39.046366 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc6e05-32c8-4476-9450-0655862ca54a service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:39.058648 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 983/1981] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 16:59:39.300368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:39.395071 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:39.580900 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190a37f-5718-4ef3-8601-7aaf9a8c076a None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:39.583309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2190a37f-5718-4ef3-8601-7aaf9a8c076a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:39.596203 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2190a37f-5718-4ef3-8601-7aaf9a8c076a None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:39.601853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f81876-bd42-4f51-a794-8a26bb9e0852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:39.602717 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f81876-bd42-4f51-a794-8a26bb9e0852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:39.606707 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f81876-bd42-4f51-a794-8a26bb9e0852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:39.606707 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f81876-bd42-4f51-a794-8a26bb9e0852 admin admin] PATH_INFO: `/v3/projects/db21a7c96da04c37ac95229868fc7af0` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:39.606707 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f81876-bd42-4f51-a794-8a26bb9e0852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db21a7c96da04c37ac95229868fc7af0)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:39.606707 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f81876-bd42-4f51-a794-8a26bb9e0852 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:39.686561 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-03f81876-bd42-4f51-a794-8a26bb9e0852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db21a7c96da04c37ac95229868fc7af0', 'request_id': 'req-03f81876-bd42-4f51-a794-8a26bb9e0852'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:39.732953 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-03f81876-bd42-4f51-a794-8a26bb9e0852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db21a7c96da04c37ac95229868fc7af0', 'request_id': 'req-03f81876-bd42-4f51-a794-8a26bb9e0852'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:39.739050 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-03f81876-bd42-4f51-a794-8a26bb9e0852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db21a7c96da04c37ac95229868fc7af0', 'request_id': 'req-03f81876-bd42-4f51-a794-8a26bb9e0852'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:39.749558 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-03f81876-bd42-4f51-a794-8a26bb9e0852 admin admin] The token cache is being invalidate because project db21a7c96da04c37ac95229868fc7af0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:39.749846 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-03f81876-bd42-4f51-a794-8a26bb9e0852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:39.750468 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-03f81876-bd42-4f51-a794-8a26bb9e0852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:39.752066 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 999/1982] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:39 2022] DELETE /identity/v3/projects/db21a7c96da04c37ac95229868fc7af0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:39.756132 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc6e05-32c8-4476-9450-0655862ca54a service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:39.765648 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc6e05-32c8-4476-9450-0655862ca54a service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:39.825226 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6942f-f9fc-429e-9873-73a97c82d3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:39.826043 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6942f-f9fc-429e-9873-73a97c82d3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:39.826329 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6942f-f9fc-429e-9873-73a97c82d3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:39.826608 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6942f-f9fc-429e-9873-73a97c82d3ec admin admin] PATH_INFO: `/v3/users/3b4b0001f3b84286a50cc97717508d04` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:39.827838 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6942f-f9fc-429e-9873-73a97c82d3ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b4b0001f3b84286a50cc97717508d04)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:39.829826 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6942f-f9fc-429e-9873-73a97c82d3ec admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:40.016345 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-04f6942f-f9fc-429e-9873-73a97c82d3ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b4b0001f3b84286a50cc97717508d04'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:40.016990 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-04f6942f-f9fc-429e-9873-73a97c82d3ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b4b0001f3b84286a50cc97717508d04'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:40.093103 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-04f6942f-f9fc-429e-9873-73a97c82d3ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b4b0001f3b84286a50cc97717508d04'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:40.093716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-04f6942f-f9fc-429e-9873-73a97c82d3ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b4b0001f3b84286a50cc97717508d04'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:40.103428 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:40.106308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-04f6942f-f9fc-429e-9873-73a97c82d3ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b4b0001f3b84286a50cc97717508d04'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:40.118905 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 984/1983] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:39 2022] DELETE /identity/v3/users/3b4b0001f3b84286a50cc97717508d04 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:40.156835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:40.377877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:40.551000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f81876-bd42-4f51-a794-8a26bb9e0852 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:40.552669 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-03f81876-bd42-4f51-a794-8a26bb9e0852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:40.567333 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f81876-bd42-4f51-a794-8a26bb9e0852 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:40.647554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a15cbd-cc1d-43a5-88f8-1a4c7de2f455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:40.648462 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a15cbd-cc1d-43a5-88f8-1a4c7de2f455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:40.648747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a15cbd-cc1d-43a5-88f8-1a4c7de2f455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:40.649026 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a15cbd-cc1d-43a5-88f8-1a4c7de2f455 admin admin] PATH_INFO: `/v3/projects/bb9739cd29e94da4938494e28c4acfd0` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:40.650239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a15cbd-cc1d-43a5-88f8-1a4c7de2f455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb9739cd29e94da4938494e28c4acfd0)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:40.652492 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a15cbd-cc1d-43a5-88f8-1a4c7de2f455 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:40.819654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-18a15cbd-cc1d-43a5-88f8-1a4c7de2f455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb9739cd29e94da4938494e28c4acfd0', 'request_id': 'req-18a15cbd-cc1d-43a5-88f8-1a4c7de2f455'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:40.883946 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:40.891599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-18a15cbd-cc1d-43a5-88f8-1a4c7de2f455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb9739cd29e94da4938494e28c4acfd0', 'request_id': 'req-18a15cbd-cc1d-43a5-88f8-1a4c7de2f455'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:40.898802 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-18a15cbd-cc1d-43a5-88f8-1a4c7de2f455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb9739cd29e94da4938494e28c4acfd0', 'request_id': 'req-18a15cbd-cc1d-43a5-88f8-1a4c7de2f455'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:40.910140 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-18a15cbd-cc1d-43a5-88f8-1a4c7de2f455 admin admin] The token cache is being invalidate because project bb9739cd29e94da4938494e28c4acfd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:40.910529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-18a15cbd-cc1d-43a5-88f8-1a4c7de2f455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:40.911570 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-18a15cbd-cc1d-43a5-88f8-1a4c7de2f455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:40.913701 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1000/1984] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:40 2022] DELETE /identity/v3/projects/bb9739cd29e94da4938494e28c4acfd0 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:40.923209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca13dc-0913-42f1-b0cd-963b29b18f42 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:40.923209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca13dc-0913-42f1-b0cd-963b29b18f42 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:40.923209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca13dc-0913-42f1-b0cd-963b29b18f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:40.938520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-22ca13dc-0913-42f1-b0cd-963b29b18f42 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:40.939834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-22ca13dc-0913-42f1-b0cd-963b29b18f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:41.007334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 985/1985] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:41.014112 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ff8d4-f950-4642-be43-905a6c811674 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:41.014472 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ff8d4-f950-4642-be43-905a6c811674 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:41.014869 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ff8d4-f950-4642-be43-905a6c811674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:41.035542 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-cd3ff8d4-f950-4642-be43-905a6c811674 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:41.036794 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-cd3ff8d4-f950-4642-be43-905a6c811674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:41.045732 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1001/1986] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:41.049962 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca13dc-0913-42f1-b0cd-963b29b18f42 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:41.059506 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca13dc-0913-42f1-b0cd-963b29b18f42 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:41.066747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae6695-fb17-476e-b770-fe60833f8070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:41.067406 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae6695-fb17-476e-b770-fe60833f8070 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:41.067688 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae6695-fb17-476e-b770-fe60833f8070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:41.067965 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae6695-fb17-476e-b770-fe60833f8070 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:41.068753 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae6695-fb17-476e-b770-fe60833f8070 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:59:41.069063 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae6695-fb17-476e-b770-fe60833f8070 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:41.070663 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae6695-fb17-476e-b770-fe60833f8070 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:41.082377 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 986/1987] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:59:41.087317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ff8d4-f950-4642-be43-905a6c811674 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:41.096992 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ff8d4-f950-4642-be43-905a6c811674 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:41.102338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2862ed-b818-4af0-ae4d-4b9bf4f24cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:41.102979 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2862ed-b818-4af0-ae4d-4b9bf4f24cee admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:41.103261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2862ed-b818-4af0-ae4d-4b9bf4f24cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:41.105421 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2862ed-b818-4af0-ae4d-4b9bf4f24cee admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:41.105421 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2862ed-b818-4af0-ae4d-4b9bf4f24cee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:41.106468 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2862ed-b818-4af0-ae4d-4b9bf4f24cee admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:41.127800 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:41.177099 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1002/1988] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:41 2022] POST /identity/v3/projects => generated 381 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:41.178375 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae6695-fb17-476e-b770-fe60833f8070 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:41.189155 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae6695-fb17-476e-b770-fe60833f8070 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:41.246880 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204f6b7-dd12-4e99-a9f4-58566433872a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:41.247542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204f6b7-dd12-4e99-a9f4-58566433872a admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:41.247822 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204f6b7-dd12-4e99-a9f4-58566433872a admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:41.248095 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204f6b7-dd12-4e99-a9f4-58566433872a admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:41.248818 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204f6b7-dd12-4e99-a9f4-58566433872a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:41.250754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204f6b7-dd12-4e99-a9f4-58566433872a admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:41.351478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 987/1989] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:41 2022] POST /identity/v3/users => generated 291 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:41.355460 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2862ed-b818-4af0-ae4d-4b9bf4f24cee admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:41.365712 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2862ed-b818-4af0-ae4d-4b9bf4f24cee admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:41.370379 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802781e-4ada-453c-94e4-bd96d99b9059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:41.371033 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802781e-4ada-453c-94e4-bd96d99b9059 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:41.371319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802781e-4ada-453c-94e4-bd96d99b9059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:41.371601 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802781e-4ada-453c-94e4-bd96d99b9059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:41.372370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802781e-4ada-453c-94e4-bd96d99b9059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:41.373988 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802781e-4ada-453c-94e4-bd96d99b9059 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:41.384961 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1003/1990] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:41.388979 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204f6b7-dd12-4e99-a9f4-58566433872a admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:41.400050 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204f6b7-dd12-4e99-a9f4-58566433872a admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:41.404984 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ac721-acdb-4d7a-8abd-df8edbc12634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:41.405672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ac721-acdb-4d7a-8abd-df8edbc12634 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:41.405964 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ac721-acdb-4d7a-8abd-df8edbc12634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:41.414203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ac721-acdb-4d7a-8abd-df8edbc12634 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:41.414203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ac721-acdb-4d7a-8abd-df8edbc12634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:41.414203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ac721-acdb-4d7a-8abd-df8edbc12634 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:41.418391 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 988/1991] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:41.422319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802781e-4ada-453c-94e4-bd96d99b9059 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:41.432516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802781e-4ada-453c-94e4-bd96d99b9059 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:41.438402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff392583-453a-46ba-ba44-da93fcf144db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:41.439365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff392583-453a-46ba-ba44-da93fcf144db admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:41.439654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff392583-453a-46ba-ba44-da93fcf144db admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:41.439933 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff392583-453a-46ba-ba44-da93fcf144db admin admin] PATH_INFO: `/v3/projects/7c54c02c7b884b17b0ba29096f770c3c/users/2b3ebaab2dda44d2a5d5a2565a00fec8/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:41.455858 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff392583-453a-46ba-ba44-da93fcf144db admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c54c02c7b884b17b0ba29096f770c3c, user_id=2b3ebaab2dda44d2a5d5a2565a00fec8, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:41.458582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff392583-453a-46ba-ba44-da93fcf144db admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:41.497728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:41.545651 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1004/1992] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:41 2022] PUT /identity/v3/projects/7c54c02c7b884b17b0ba29096f770c3c/users/2b3ebaab2dda44d2a5d5a2565a00fec8/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:41.556970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe770429-6f8a-4319-b588-77e141931757 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:41.557267 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe770429-6f8a-4319-b588-77e141931757 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:41.557553 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe770429-6f8a-4319-b588-77e141931757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:41.586624 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-fe770429-6f8a-4319-b588-77e141931757 None None] MFA Rules not processed for user `2b3ebaab2dda44d2a5d5a2565a00fec8`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:41.587849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-fe770429-6f8a-4319-b588-77e141931757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:41.653512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 989/1993] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:41.657865 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff392583-453a-46ba-ba44-da93fcf144db admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:41.717473 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:41.727691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff392583-453a-46ba-ba44-da93fcf144db admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:41.732495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11187b9-2c85-4ee0-980b-d082f5fa469a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:41.733152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11187b9-2c85-4ee0-980b-d082f5fa469a admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:41.733434 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11187b9-2c85-4ee0-980b-d082f5fa469a admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:41.733708 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11187b9-2c85-4ee0-980b-d082f5fa469a admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:41.734781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11187b9-2c85-4ee0-980b-d082f5fa469a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:41.736468 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11187b9-2c85-4ee0-980b-d082f5fa469a admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:41.828168 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1005/1994] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:41 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:41.829786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe770429-6f8a-4319-b588-77e141931757 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:41.840552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe770429-6f8a-4319-b588-77e141931757 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:41.860722 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=82,keystone:INSERT=8,keystone:DELETE=10 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:41.899149 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db61ce-42d6-4c41-95ef-5dcbac256f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:41.899825 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db61ce-42d6-4c41-95ef-5dcbac256f7b admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:41.900134 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db61ce-42d6-4c41-95ef-5dcbac256f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:41.900419 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db61ce-42d6-4c41-95ef-5dcbac256f7b admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:41.901150 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db61ce-42d6-4c41-95ef-5dcbac256f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:41.903330 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db61ce-42d6-4c41-95ef-5dcbac256f7b admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:42.001011 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 990/1995] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:41 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:42.002351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11187b9-2c85-4ee0-980b-d082f5fa469a admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:42.015547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11187b9-2c85-4ee0-980b-d082f5fa469a admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:42.027458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac57b43-ce40-40d2-a6d0-e5a0010c7daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:42.028330 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac57b43-ce40-40d2-a6d0-e5a0010c7daf admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:42.028639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac57b43-ce40-40d2-a6d0-e5a0010c7daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:42.028912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac57b43-ce40-40d2-a6d0-e5a0010c7daf admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:42.029751 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac57b43-ce40-40d2-a6d0-e5a0010c7daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:42.031289 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac57b43-ce40-40d2-a6d0-e5a0010c7daf admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:42.042894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1006/1996] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:42.047178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db61ce-42d6-4c41-95ef-5dcbac256f7b admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:42.057983 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db61ce-42d6-4c41-95ef-5dcbac256f7b admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:42.062559 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d7751-91cd-4fdc-9093-928d3595a8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:42.063432 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d7751-91cd-4fdc-9093-928d3595a8d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:42.063714 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d7751-91cd-4fdc-9093-928d3595a8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:42.063992 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d7751-91cd-4fdc-9093-928d3595a8d9 admin admin] PATH_INFO: `/v3/projects/9c768ae04dd049b4a5e41b6ca648ea58/users/d7c3694876ec4ccd853163a5f9b1daf8/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:42.078383 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d7751-91cd-4fdc-9093-928d3595a8d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c768ae04dd049b4a5e41b6ca648ea58, user_id=d7c3694876ec4ccd853163a5f9b1daf8, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:42.081088 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d7751-91cd-4fdc-9093-928d3595a8d9 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:42.172545 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 991/1997] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:42 2022] PUT /identity/v3/projects/9c768ae04dd049b4a5e41b6ca648ea58/users/d7c3694876ec4ccd853163a5f9b1daf8/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:42.176519 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac57b43-ce40-40d2-a6d0-e5a0010c7daf admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:42.179491 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:42.188775 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac57b43-ce40-40d2-a6d0-e5a0010c7daf admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:42.248275 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58678008-2351-4bd3-94dd-c9f8b9d69a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:42.248950 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58678008-2351-4bd3-94dd-c9f8b9d69a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:42.249232 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58678008-2351-4bd3-94dd-c9f8b9d69a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:42.249508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58678008-2351-4bd3-94dd-c9f8b9d69a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:42.250357 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58678008-2351-4bd3-94dd-c9f8b9d69a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:42.252024 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58678008-2351-4bd3-94dd-c9f8b9d69a9c admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:42.265659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1007/1998] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:42.266843 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d7751-91cd-4fdc-9093-928d3595a8d9 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:42.277385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d7751-91cd-4fdc-9093-928d3595a8d9 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:42.282032 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f70d2c-64e2-464f-8ce1-980bc25bbec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:42.282912 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f70d2c-64e2-464f-8ce1-980bc25bbec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:42.283193 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f70d2c-64e2-464f-8ce1-980bc25bbec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:42.283468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f70d2c-64e2-464f-8ce1-980bc25bbec1 admin admin] PATH_INFO: `/v3/projects/9c768ae04dd049b4a5e41b6ca648ea58/users/d7c3694876ec4ccd853163a5f9b1daf8/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:42.286177 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f70d2c-64e2-464f-8ce1-980bc25bbec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c768ae04dd049b4a5e41b6ca648ea58, user_id=d7c3694876ec4ccd853163a5f9b1daf8, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:42.289396 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f70d2c-64e2-464f-8ce1-980bc25bbec1 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:42.300405 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 992/1999] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:42 2022] PUT /identity/v3/projects/9c768ae04dd049b4a5e41b6ca648ea58/users/d7c3694876ec4ccd853163a5f9b1daf8/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:42.311146 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6015d6-22f8-4ceb-b255-a8de4f3c86ca None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:42.311533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6015d6-22f8-4ceb-b255-a8de4f3c86ca None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:42.311880 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6015d6-22f8-4ceb-b255-a8de4f3c86ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:42.338821 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-0f6015d6-22f8-4ceb-b255-a8de4f3c86ca None None] MFA Rules not processed for user `d7c3694876ec4ccd853163a5f9b1daf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:42.340208 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-0f6015d6-22f8-4ceb-b255-a8de4f3c86ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:42.411062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1008/2000] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:42.422284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f70d2c-64e2-464f-8ce1-980bc25bbec1 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:42.424070 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-35f70d2c-64e2-464f-8ce1-980bc25bbec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:42.479596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f70d2c-64e2-464f-8ce1-980bc25bbec1 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:42.483374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21fcfb-5fc7-48bf-8b3c-f33b57976dad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:42.484009 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21fcfb-5fc7-48bf-8b3c-f33b57976dad service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:42.484324 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21fcfb-5fc7-48bf-8b3c-f33b57976dad service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:42.484764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21fcfb-5fc7-48bf-8b3c-f33b57976dad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:42.493685 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21fcfb-5fc7-48bf-8b3c-f33b57976dad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:42.495103 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21fcfb-5fc7-48bf-8b3c-f33b57976dad service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:42.504546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 993/2001] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:42.540203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:42.768711 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:42.791454 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:42.928171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:43.004117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6015d6-22f8-4ceb-b255-a8de4f3c86ca None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:43.037771 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:43.067522 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6015d6-22f8-4ceb-b255-a8de4f3c86ca None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:43.074063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4dc07d-ce45-49c6-85cf-d8d6234e08ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:43.075195 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dc07d-ce45-49c6-85cf-d8d6234e08ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:43.075512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dc07d-ce45-49c6-85cf-d8d6234e08ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:43.075756 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dc07d-ce45-49c6-85cf-d8d6234e08ca admin admin] PATH_INFO: `/v3/users/2b3ebaab2dda44d2a5d5a2565a00fec8` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:43.077028 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4dc07d-ce45-49c6-85cf-d8d6234e08ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3ebaab2dda44d2a5d5a2565a00fec8)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:43.078976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4dc07d-ce45-49c6-85cf-d8d6234e08ca admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:43.174222 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:43.248343 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ab4dc07d-ce45-49c6-85cf-d8d6234e08ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3ebaab2dda44d2a5d5a2565a00fec8'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:43.255004 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ab4dc07d-ce45-49c6-85cf-d8d6234e08ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3ebaab2dda44d2a5d5a2565a00fec8'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:43.255673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ab4dc07d-ce45-49c6-85cf-d8d6234e08ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3ebaab2dda44d2a5d5a2565a00fec8'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:43.268564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ab4dc07d-ce45-49c6-85cf-d8d6234e08ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3ebaab2dda44d2a5d5a2565a00fec8'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:43.269241 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ab4dc07d-ce45-49c6-85cf-d8d6234e08ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3ebaab2dda44d2a5d5a2565a00fec8'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:43.372022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1009/2002] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:43 2022] DELETE /identity/v3/users/2b3ebaab2dda44d2a5d5a2565a00fec8 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:43.376762 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4bac6-db07-4b97-a142-cfbf94be445d None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:43.377057 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4bac6-db07-4b97-a142-cfbf94be445d None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:43.377354 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4bac6-db07-4b97-a142-cfbf94be445d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:43.395599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-58e4bac6-db07-4b97-a142-cfbf94be445d None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:43.396823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-58e4bac6-db07-4b97-a142-cfbf94be445d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:43.431615 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:43.453831 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:43.456713 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 994/2003] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:43.466113 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4dc07d-ce45-49c6-85cf-d8d6234e08ca admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:43.467556 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-ab4dc07d-ce45-49c6-85cf-d8d6234e08ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:43.511136 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:43.523883 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4dc07d-ce45-49c6-85cf-d8d6234e08ca admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:43.527758 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80897f4-e4fe-4588-822c-206a4a6fc9f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:43.528432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80897f4-e4fe-4588-822c-206a4a6fc9f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:43.528719 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80897f4-e4fe-4588-822c-206a4a6fc9f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:43.528996 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80897f4-e4fe-4588-822c-206a4a6fc9f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:43.538636 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80897f4-e4fe-4588-822c-206a4a6fc9f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:43.540062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80897f4-e4fe-4588-822c-206a4a6fc9f5 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:43.549490 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1010/2004] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:43.568052 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:43.585364 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:43.692029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:43.734487 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:43.814145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:43.915587 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:43.919601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4bac6-db07-4b97-a142-cfbf94be445d None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:43.921146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-58e4bac6-db07-4b97-a142-cfbf94be445d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:43.933387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4bac6-db07-4b97-a142-cfbf94be445d None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:43.937950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd43fd-3509-424a-9448-cc0743eae633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:43.939056 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd43fd-3509-424a-9448-cc0743eae633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:43.939271 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd43fd-3509-424a-9448-cc0743eae633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:43.939436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd43fd-3509-424a-9448-cc0743eae633 admin admin] PATH_INFO: `/v3/projects/7c54c02c7b884b17b0ba29096f770c3c` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:43.940653 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd43fd-3509-424a-9448-cc0743eae633 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c54c02c7b884b17b0ba29096f770c3c)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:43.942637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd43fd-3509-424a-9448-cc0743eae633 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:43.997131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:44.108443 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-54dd43fd-3509-424a-9448-cc0743eae633 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c54c02c7b884b17b0ba29096f770c3c', 'request_id': 'req-54dd43fd-3509-424a-9448-cc0743eae633'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:44.179044 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-54dd43fd-3509-424a-9448-cc0743eae633 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c54c02c7b884b17b0ba29096f770c3c', 'request_id': 'req-54dd43fd-3509-424a-9448-cc0743eae633'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:44.185097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-54dd43fd-3509-424a-9448-cc0743eae633 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c54c02c7b884b17b0ba29096f770c3c', 'request_id': 'req-54dd43fd-3509-424a-9448-cc0743eae633'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:44.196749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-54dd43fd-3509-424a-9448-cc0743eae633 admin admin] The token cache is being invalidate because project 7c54c02c7b884b17b0ba29096f770c3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:44.197092 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-54dd43fd-3509-424a-9448-cc0743eae633 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:44.197708 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-54dd43fd-3509-424a-9448-cc0743eae633 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:44.201003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 995/2005] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:43 2022] DELETE /identity/v3/projects/7c54c02c7b884b17b0ba29096f770c3c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:44.205010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80897f4-e4fe-4588-822c-206a4a6fc9f5 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:44.215196 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80897f4-e4fe-4588-822c-206a4a6fc9f5 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:44.269751 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2365e29-7e5b-4701-b9c9-8a92e65934ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:44.270615 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2365e29-7e5b-4701-b9c9-8a92e65934ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:44.270901 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2365e29-7e5b-4701-b9c9-8a92e65934ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:44.271179 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2365e29-7e5b-4701-b9c9-8a92e65934ea admin admin] PATH_INFO: `/v3/users/d7c3694876ec4ccd853163a5f9b1daf8` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:44.272909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2365e29-7e5b-4701-b9c9-8a92e65934ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c3694876ec4ccd853163a5f9b1daf8)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:44.274869 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2365e29-7e5b-4701-b9c9-8a92e65934ea admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:44.448188 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:44.488093 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c2365e29-7e5b-4701-b9c9-8a92e65934ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c3694876ec4ccd853163a5f9b1daf8'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:44.495746 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c2365e29-7e5b-4701-b9c9-8a92e65934ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c3694876ec4ccd853163a5f9b1daf8'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:44.496459 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c2365e29-7e5b-4701-b9c9-8a92e65934ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c3694876ec4ccd853163a5f9b1daf8'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:44.507940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c2365e29-7e5b-4701-b9c9-8a92e65934ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c3694876ec4ccd853163a5f9b1daf8'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:44.508604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c2365e29-7e5b-4701-b9c9-8a92e65934ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c3694876ec4ccd853163a5f9b1daf8'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:44.528518 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:44.614290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1011/2006] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 16:59:44 2022] DELETE /identity/v3/users/d7c3694876ec4ccd853163a5f9b1daf8 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:44.893869 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:44.997694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd43fd-3509-424a-9448-cc0743eae633 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:45.000073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-54dd43fd-3509-424a-9448-cc0743eae633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:45.002534 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:45.014229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd43fd-3509-424a-9448-cc0743eae633 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:45.034456 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:45.078938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45d7c8-7de0-41b9-85ef-74604e66431f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:45.079804 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45d7c8-7de0-41b9-85ef-74604e66431f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:45.080086 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45d7c8-7de0-41b9-85ef-74604e66431f admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:45.080449 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45d7c8-7de0-41b9-85ef-74604e66431f admin admin] PATH_INFO: `/v3/projects/9c768ae04dd049b4a5e41b6ca648ea58` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:45.081747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45d7c8-7de0-41b9-85ef-74604e66431f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c768ae04dd049b4a5e41b6ca648ea58)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:45.083670 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45d7c8-7de0-41b9-85ef-74604e66431f admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:45.206680 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-fe45d7c8-7de0-41b9-85ef-74604e66431f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c768ae04dd049b4a5e41b6ca648ea58', 'request_id': 'req-fe45d7c8-7de0-41b9-85ef-74604e66431f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:45.287621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-fe45d7c8-7de0-41b9-85ef-74604e66431f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c768ae04dd049b4a5e41b6ca648ea58', 'request_id': 'req-fe45d7c8-7de0-41b9-85ef-74604e66431f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:45.293775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-fe45d7c8-7de0-41b9-85ef-74604e66431f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c768ae04dd049b4a5e41b6ca648ea58', 'request_id': 'req-fe45d7c8-7de0-41b9-85ef-74604e66431f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:45.305389 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-fe45d7c8-7de0-41b9-85ef-74604e66431f admin admin] The token cache is being invalidate because project 9c768ae04dd049b4a5e41b6ca648ea58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 16:59:45.305667 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-fe45d7c8-7de0-41b9-85ef-74604e66431f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:45.306308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-fe45d7c8-7de0-41b9-85ef-74604e66431f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 16:59:45.308058 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 996/2007] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 16:59:44 2022] DELETE /identity/v3/projects/9c768ae04dd049b4a5e41b6ca648ea58 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 16:59:45.312653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6e210-49c8-4a10-b539-3bb64550377e None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:45.313039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6e210-49c8-4a10-b539-3bb64550377e None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:45.313332 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6e210-49c8-4a10-b539-3bb64550377e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:45.331613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-e5e6e210-49c8-4a10-b539-3bb64550377e None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:45.332828 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e5e6e210-49c8-4a10-b539-3bb64550377e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:45.392795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1012/2008] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:45.401862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1e663-64d7-446e-b5a1-80b46699f220 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:45.402155 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1e663-64d7-446e-b5a1-80b46699f220 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:45.402434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1e663-64d7-446e-b5a1-80b46699f220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:45.421552 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-10e1e663-64d7-446e-b5a1-80b46699f220 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:45.422755 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-10e1e663-64d7-446e-b5a1-80b46699f220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:45.431679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 997/2009] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:45.435954 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6e210-49c8-4a10-b539-3bb64550377e None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:45.446258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6e210-49c8-4a10-b539-3bb64550377e None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:45.450809 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8f5a4-21ac-436a-8b55-0576c18b20ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:45.451458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8f5a4-21ac-436a-8b55-0576c18b20ea admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:45.451745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8f5a4-21ac-436a-8b55-0576c18b20ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:45.452028 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8f5a4-21ac-436a-8b55-0576c18b20ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:45.452812 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8f5a4-21ac-436a-8b55-0576c18b20ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 16:59:45.453130 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8f5a4-21ac-436a-8b55-0576c18b20ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:45.454728 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a8f5a4-21ac-436a-8b55-0576c18b20ea admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:45.466085 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1013/2010] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 16:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 16:59:45.470147 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1e663-64d7-446e-b5a1-80b46699f220 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:45.479757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1e663-64d7-446e-b5a1-80b46699f220 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:45.484488 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbff4cd-ec5a-4570-8cc9-f896d7005fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:45.485124 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbff4cd-ec5a-4570-8cc9-f896d7005fdb admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:45.485428 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbff4cd-ec5a-4570-8cc9-f896d7005fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:45.485699 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbff4cd-ec5a-4570-8cc9-f896d7005fdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:45.486411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbff4cd-ec5a-4570-8cc9-f896d7005fdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:45.488340 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbff4cd-ec5a-4570-8cc9-f896d7005fdb admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:45.558238 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 998/2011] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 16:59:45 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:45.561651 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8f5a4-21ac-436a-8b55-0576c18b20ea admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:45.572675 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8f5a4-21ac-436a-8b55-0576c18b20ea admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:45.626746 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de0533-f696-4934-a43a-8372e25fd10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:45.627405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de0533-f696-4934-a43a-8372e25fd10e admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:45.627693 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de0533-f696-4934-a43a-8372e25fd10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:45.627974 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de0533-f696-4934-a43a-8372e25fd10e admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:45.628704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de0533-f696-4934-a43a-8372e25fd10e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:45.630615 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de0533-f696-4934-a43a-8372e25fd10e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:45.710056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1014/2012] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 16:59:45 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 16:59:45.714043 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbff4cd-ec5a-4570-8cc9-f896d7005fdb admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:45.724388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbff4cd-ec5a-4570-8cc9-f896d7005fdb admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:45.728942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a7c0b-7655-4f0d-aae3-00b456a4ab06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:45.729589 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a7c0b-7655-4f0d-aae3-00b456a4ab06 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:45.729970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a7c0b-7655-4f0d-aae3-00b456a4ab06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:45.730250 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a7c0b-7655-4f0d-aae3-00b456a4ab06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:45.730979 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a7c0b-7655-4f0d-aae3-00b456a4ab06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:45.732625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a7c0b-7655-4f0d-aae3-00b456a4ab06 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:45.743638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 999/2013] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:45.747260 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de0533-f696-4934-a43a-8372e25fd10e admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:45.757759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de0533-f696-4934-a43a-8372e25fd10e admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:45.762662 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf50c5f-0692-4e52-9fe2-da7b1007040e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:45.763311 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf50c5f-0692-4e52-9fe2-da7b1007040e admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:45.763600 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf50c5f-0692-4e52-9fe2-da7b1007040e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:45.763879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf50c5f-0692-4e52-9fe2-da7b1007040e admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:45.764681 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf50c5f-0692-4e52-9fe2-da7b1007040e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:45.766294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf50c5f-0692-4e52-9fe2-da7b1007040e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:45.777288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1015/2014] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 16:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 16:59:45.780933 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a7c0b-7655-4f0d-aae3-00b456a4ab06 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:45.791250 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a7c0b-7655-4f0d-aae3-00b456a4ab06 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:45.795974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc2cb3-8ad1-4388-b5fd-743601057e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:45.796878 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc2cb3-8ad1-4388-b5fd-743601057e77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:45.797167 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc2cb3-8ad1-4388-b5fd-743601057e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:45.797442 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc2cb3-8ad1-4388-b5fd-743601057e77 admin admin] PATH_INFO: `/v3/projects/e491322c9bb146359268dcd649f24662/users/1fe59d1f996e4abdb8a90b7444133e1c/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:45.812462 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc2cb3-8ad1-4388-b5fd-743601057e77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e491322c9bb146359268dcd649f24662, user_id=1fe59d1f996e4abdb8a90b7444133e1c, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:45.815121 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc2cb3-8ad1-4388-b5fd-743601057e77 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:45.881579 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1000/2015] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 16:59:45 2022] PUT /identity/v3/projects/e491322c9bb146359268dcd649f24662/users/1fe59d1f996e4abdb8a90b7444133e1c/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 16:59:45.886551 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee319e-0a98-485c-94df-21f8938f158c None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:45.886848 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee319e-0a98-485c-94df-21f8938f158c None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:45.887129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee319e-0a98-485c-94df-21f8938f158c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:45.904710 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-26ee319e-0a98-485c-94df-21f8938f158c None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:45.905904 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-26ee319e-0a98-485c-94df-21f8938f158c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:45.950980 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:45.964522 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1016/2016] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:45.973912 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc2cb3-8ad1-4388-b5fd-743601057e77 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:45.976271 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-49bc2cb3-8ad1-4388-b5fd-743601057e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:46.017870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:46.033790 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc2cb3-8ad1-4388-b5fd-743601057e77 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:46.037608 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a4b11-d1e3-4c52-a45d-12b71f2aed37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:46.038764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a4b11-d1e3-4c52-a45d-12b71f2aed37 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:46.039048 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a4b11-d1e3-4c52-a45d-12b71f2aed37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:46.039321 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a4b11-d1e3-4c52-a45d-12b71f2aed37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:46.049892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a4b11-d1e3-4c52-a45d-12b71f2aed37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:46.051365 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a4b11-d1e3-4c52-a45d-12b71f2aed37 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:46.062494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1001/2017] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:46.066047 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee319e-0a98-485c-94df-21f8938f158c None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:46.067517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-26ee319e-0a98-485c-94df-21f8938f158c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:46.126411 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee319e-0a98-485c-94df-21f8938f158c None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:46.129975 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53119a07-fc15-41a0-80b0-2a5818d56008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:46.130668 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53119a07-fc15-41a0-80b0-2a5818d56008 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:46.130982 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53119a07-fc15-41a0-80b0-2a5818d56008 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:46.131283 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53119a07-fc15-41a0-80b0-2a5818d56008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:46.133162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-53119a07-fc15-41a0-80b0-2a5818d56008 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:46.198216 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53119a07-fc15-41a0-80b0-2a5818d56008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:46.199687 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53119a07-fc15-41a0-80b0-2a5818d56008 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:46.211910 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1017/2018] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:47.316901 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66447f1f-4709-4b8d-8ac5-728738b87be0 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:47.317721 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66447f1f-4709-4b8d-8ac5-728738b87be0 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:47.318039 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66447f1f-4709-4b8d-8ac5-728738b87be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:47.363433 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-66447f1f-4709-4b8d-8ac5-728738b87be0 None None] MFA Rules not processed for user `1fe59d1f996e4abdb8a90b7444133e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 16:59:47.364719 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-66447f1f-4709-4b8d-8ac5-728738b87be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:47.439033 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1002/2019] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 16:59:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 16:59:47.449936 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53119a07-fc15-41a0-80b0-2a5818d56008 service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 16:59:47.451391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-53119a07-fc15-41a0-80b0-2a5818d56008 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 16:59:47.462315 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53119a07-fc15-41a0-80b0-2a5818d56008 service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 16:59:47.466314 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297f868-5565-4edb-8c20-71e244f46108 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 16:59:47.466967 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297f868-5565-4edb-8c20-71e244f46108 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 16:59:47.467255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297f868-5565-4edb-8c20-71e244f46108 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 16:59:47.467536 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297f868-5565-4edb-8c20-71e244f46108 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 16:59:47.476646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297f868-5565-4edb-8c20-71e244f46108 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 16:59:47.478504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297f868-5565-4edb-8c20-71e244f46108 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 16:59:47.488706 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1018/2020] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 16:59:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 16:59:57.436959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=41 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 16:59:57.484400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=60 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:01.796592 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19821327-ccdb-497d-8b1d-fe9d016275b1 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:01.797111 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19821327-ccdb-497d-8b1d-fe9d016275b1 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:01.797213 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19821327-ccdb-497d-8b1d-fe9d016275b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:01.815954 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-19821327-ccdb-497d-8b1d-fe9d016275b1 None None] MFA Rules not processed for user `1fe59d1f996e4abdb8a90b7444133e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:01.817477 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-19821327-ccdb-497d-8b1d-fe9d016275b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:01.824613 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1003/2021] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:02.927994 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297f868-5565-4edb-8c20-71e244f46108 service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:02.930093 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d297f868-5565-4edb-8c20-71e244f46108 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:02.961432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297f868-5565-4edb-8c20-71e244f46108 service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:02.966082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78ee16-c7f2-435c-b8e3-a56bfc0184d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:02.967305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78ee16-c7f2-435c-b8e3-a56bfc0184d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:02.967838 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78ee16-c7f2-435c-b8e3-a56bfc0184d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:02.968213 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78ee16-c7f2-435c-b8e3-a56bfc0184d9 admin admin] PATH_INFO: `/v3/users/b339b5033d4340c5b07e22af783c4df2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:02.969664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78ee16-c7f2-435c-b8e3-a56bfc0184d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b339b5033d4340c5b07e22af783c4df2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:02.971955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78ee16-c7f2-435c-b8e3-a56bfc0184d9 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:03.241872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19821327-ccdb-497d-8b1d-fe9d016275b1 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:03.243888 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-19821327-ccdb-497d-8b1d-fe9d016275b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:03.264966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19821327-ccdb-497d-8b1d-fe9d016275b1 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:03.267046 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ca78ee16-c7f2-435c-b8e3-a56bfc0184d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b339b5033d4340c5b07e22af783c4df2'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:03.272738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb33c6-00e4-472b-a78c-ca79419f28c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:03.278348 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb33c6-00e4-472b-a78c-ca79419f28c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:03.278348 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb33c6-00e4-472b-a78c-ca79419f28c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:03.278348 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb33c6-00e4-472b-a78c-ca79419f28c9 admin admin] PATH_INFO: `/v3/users/43cdf1e065d543f783a15eb53e6f3830` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:03.278661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ca78ee16-c7f2-435c-b8e3-a56bfc0184d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b339b5033d4340c5b07e22af783c4df2'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:03.278759 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb33c6-00e4-472b-a78c-ca79419f28c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43cdf1e065d543f783a15eb53e6f3830)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:03.278857 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ca78ee16-c7f2-435c-b8e3-a56bfc0184d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b339b5033d4340c5b07e22af783c4df2'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:03.279198 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eb33c6-00e4-472b-a78c-ca79419f28c9 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:03.290223 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ca78ee16-c7f2-435c-b8e3-a56bfc0184d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b339b5033d4340c5b07e22af783c4df2'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:03.291102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ca78ee16-c7f2-435c-b8e3-a56bfc0184d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b339b5033d4340c5b07e22af783c4df2'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:03.383024 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1019/2022] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:02 2022] DELETE /identity/v3/users/b339b5033d4340c5b07e22af783c4df2 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:03.389104 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66994b96-192e-4b41-8e6c-5419461cb4bf None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:03.389104 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66994b96-192e-4b41-8e6c-5419461cb4bf None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:03.389104 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66994b96-192e-4b41-8e6c-5419461cb4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:03.405265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-66994b96-192e-4b41-8e6c-5419461cb4bf None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:03.406450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-66994b96-192e-4b41-8e6c-5419461cb4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:03.465809 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1020/2023] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:00:03.475007 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66994b96-192e-4b41-8e6c-5419461cb4bf None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:03.476469 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-66994b96-192e-4b41-8e6c-5419461cb4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:03.552201 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66994b96-192e-4b41-8e6c-5419461cb4bf None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:03.557874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261ff11-b824-485f-9791-31eb74db8415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:03.558801 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261ff11-b824-485f-9791-31eb74db8415 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:03.559155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261ff11-b824-485f-9791-31eb74db8415 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:03.559815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261ff11-b824-485f-9791-31eb74db8415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:03.561787 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-c1eb33c6-00e4-472b-a78c-ca79419f28c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43cdf1e065d543f783a15eb53e6f3830'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:03.562624 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-c1eb33c6-00e4-472b-a78c-ca79419f28c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43cdf1e065d543f783a15eb53e6f3830'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:03.574690 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261ff11-b824-485f-9791-31eb74db8415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:03.576244 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261ff11-b824-485f-9791-31eb74db8415 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:03.588869 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1021/2024] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:00:03.642013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-c1eb33c6-00e4-472b-a78c-ca79419f28c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43cdf1e065d543f783a15eb53e6f3830'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:03.642668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-c1eb33c6-00e4-472b-a78c-ca79419f28c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43cdf1e065d543f783a15eb53e6f3830'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:03.658349 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-c1eb33c6-00e4-472b-a78c-ca79419f28c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43cdf1e065d543f783a15eb53e6f3830'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:03.673469 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1004/2025] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:03 2022] DELETE /identity/v3/users/43cdf1e065d543f783a15eb53e6f3830 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:00:03.677954 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a38f25-a0d1-4c83-9b6e-d85fbfa89e3d None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:03.679089 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a38f25-a0d1-4c83-9b6e-d85fbfa89e3d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:03.679446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a38f25-a0d1-4c83-9b6e-d85fbfa89e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:03.705999 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-c9a38f25-a0d1-4c83-9b6e-d85fbfa89e3d None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:03.707353 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c9a38f25-a0d1-4c83-9b6e-d85fbfa89e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:03.720009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:03.777943 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1022/2026] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:00:03.787448 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb33c6-00e4-472b-a78c-ca79419f28c9 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:03.788906 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-c1eb33c6-00e4-472b-a78c-ca79419f28c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:03.865829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb33c6-00e4-472b-a78c-ca79419f28c9 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:03.872226 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5ea29-0905-4178-9ea1-8921602d8283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:03.873105 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5ea29-0905-4178-9ea1-8921602d8283 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:03.877045 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5ea29-0905-4178-9ea1-8921602d8283 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:03.877045 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5ea29-0905-4178-9ea1-8921602d8283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:03.888611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5ea29-0905-4178-9ea1-8921602d8283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:03.890522 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5ea29-0905-4178-9ea1-8921602d8283 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:03.913786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1005/2027] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:00:04.174400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a38f25-a0d1-4c83-9b6e-d85fbfa89e3d None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:04.175976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c9a38f25-a0d1-4c83-9b6e-d85fbfa89e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:04.190297 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a38f25-a0d1-4c83-9b6e-d85fbfa89e3d None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:04.195024 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d0286-e3b4-4d08-a462-1d14ca7c52f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:04.195884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d0286-e3b4-4d08-a462-1d14ca7c52f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:04.196227 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d0286-e3b4-4d08-a462-1d14ca7c52f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:04.196528 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d0286-e3b4-4d08-a462-1d14ca7c52f5 admin admin] PATH_INFO: `/v3/projects/2d837d4589624e0699d0715f2f4ad133` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:04.197749 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d0286-e3b4-4d08-a462-1d14ca7c52f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d837d4589624e0699d0715f2f4ad133)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:04.199692 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d0286-e3b4-4d08-a462-1d14ca7c52f5 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:04.409788 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-140d0286-e3b4-4d08-a462-1d14ca7c52f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d837d4589624e0699d0715f2f4ad133', 'request_id': 'req-140d0286-e3b4-4d08-a462-1d14ca7c52f5'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:04.515707 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5ea29-0905-4178-9ea1-8921602d8283 service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:04.517439 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-62e5ea29-0905-4178-9ea1-8921602d8283 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:04.533699 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5ea29-0905-4178-9ea1-8921602d8283 service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:04.536718 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-140d0286-e3b4-4d08-a462-1d14ca7c52f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d837d4589624e0699d0715f2f4ad133', 'request_id': 'req-140d0286-e3b4-4d08-a462-1d14ca7c52f5'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:04.548096 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-140d0286-e3b4-4d08-a462-1d14ca7c52f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d837d4589624e0699d0715f2f4ad133', 'request_id': 'req-140d0286-e3b4-4d08-a462-1d14ca7c52f5'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:04.580194 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-140d0286-e3b4-4d08-a462-1d14ca7c52f5 admin admin] The token cache is being invalidate because project 2d837d4589624e0699d0715f2f4ad133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:04.580558 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-140d0286-e3b4-4d08-a462-1d14ca7c52f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:04.581313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-140d0286-e3b4-4d08-a462-1d14ca7c52f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:04.583081 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1023/2028] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:04 2022] DELETE /identity/v3/projects/2d837d4589624e0699d0715f2f4ad133 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:04.587514 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d0286-e3b4-4d08-a462-1d14ca7c52f5 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:04.592855 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-140d0286-e3b4-4d08-a462-1d14ca7c52f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:04.624007 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bb315-207b-4449-859a-bff2c42fe1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:04.631596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bb315-207b-4449-859a-bff2c42fe1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:04.631596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bb315-207b-4449-859a-bff2c42fe1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:04.631596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bb315-207b-4449-859a-bff2c42fe1b9 admin admin] PATH_INFO: `/v3/projects/34cde55dd2ae4e84a03c205b34d16c46` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:04.631596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bb315-207b-4449-859a-bff2c42fe1b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34cde55dd2ae4e84a03c205b34d16c46)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:04.631596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bb315-207b-4449-859a-bff2c42fe1b9 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:04.654919 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:04.694155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d0286-e3b4-4d08-a462-1d14ca7c52f5 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:04.700348 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff57ed7-45e6-43a1-be64-0a92db5d281c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:04.701260 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff57ed7-45e6-43a1-be64-0a92db5d281c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:04.701593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff57ed7-45e6-43a1-be64-0a92db5d281c admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:04.701919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff57ed7-45e6-43a1-be64-0a92db5d281c admin admin] PATH_INFO: `/v3/users/cd3ccc8930f04e22bb45413854720c43` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:04.703308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff57ed7-45e6-43a1-be64-0a92db5d281c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd3ccc8930f04e22bb45413854720c43)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:04.705479 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff57ed7-45e6-43a1-be64-0a92db5d281c admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:04.749519 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f95bb315-207b-4449-859a-bff2c42fe1b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34cde55dd2ae4e84a03c205b34d16c46', 'request_id': 'req-f95bb315-207b-4449-859a-bff2c42fe1b9'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:04.828342 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f95bb315-207b-4449-859a-bff2c42fe1b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34cde55dd2ae4e84a03c205b34d16c46', 'request_id': 'req-f95bb315-207b-4449-859a-bff2c42fe1b9'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:04.834127 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f95bb315-207b-4449-859a-bff2c42fe1b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34cde55dd2ae4e84a03c205b34d16c46', 'request_id': 'req-f95bb315-207b-4449-859a-bff2c42fe1b9'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:04.845686 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f95bb315-207b-4449-859a-bff2c42fe1b9 admin admin] The token cache is being invalidate because project 34cde55dd2ae4e84a03c205b34d16c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:04.845976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f95bb315-207b-4449-859a-bff2c42fe1b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:04.846658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f95bb315-207b-4449-859a-bff2c42fe1b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:04.848327 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1006/2029] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:04 2022] DELETE /identity/v3/projects/34cde55dd2ae4e84a03c205b34d16c46 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:00:04.852969 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09801e-5acd-4a7b-b4f3-fee29e2009dd None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:04.855077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09801e-5acd-4a7b-b4f3-fee29e2009dd None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:04.855077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09801e-5acd-4a7b-b4f3-fee29e2009dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:04.872268 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-dc09801e-5acd-4a7b-b4f3-fee29e2009dd None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:04.873489 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-dc09801e-5acd-4a7b-b4f3-fee29e2009dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:04.908170 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:04.913067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-0ff57ed7-45e6-43a1-be64-0a92db5d281c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd3ccc8930f04e22bb45413854720c43'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:04.919978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-0ff57ed7-45e6-43a1-be64-0a92db5d281c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd3ccc8930f04e22bb45413854720c43'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:04.920751 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-0ff57ed7-45e6-43a1-be64-0a92db5d281c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd3ccc8930f04e22bb45413854720c43'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:04.933302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-0ff57ed7-45e6-43a1-be64-0a92db5d281c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd3ccc8930f04e22bb45413854720c43'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:04.934032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-0ff57ed7-45e6-43a1-be64-0a92db5d281c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd3ccc8930f04e22bb45413854720c43'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:04.941383 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1007/2030] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:00:04.943085 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fef713-11c3-48d7-8009-dfc91ce86fbf None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:04.943435 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fef713-11c3-48d7-8009-dfc91ce86fbf None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:04.943648 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fef713-11c3-48d7-8009-dfc91ce86fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:04.963410 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-85fef713-11c3-48d7-8009-dfc91ce86fbf None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:04.964674 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-85fef713-11c3-48d7-8009-dfc91ce86fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:04.972480 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1008/2031] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:00:04.976764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fef713-11c3-48d7-8009-dfc91ce86fbf None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:04.985592 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fef713-11c3-48d7-8009-dfc91ce86fbf None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:04.990267 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da072b72-bbcf-4309-9ac3-a7a7441ad4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:04.990881 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da072b72-bbcf-4309-9ac3-a7a7441ad4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:04.991246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da072b72-bbcf-4309-9ac3-a7a7441ad4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:04.991525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da072b72-bbcf-4309-9ac3-a7a7441ad4f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:04.992472 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da072b72-bbcf-4309-9ac3-a7a7441ad4f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:00:04.992778 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da072b72-bbcf-4309-9ac3-a7a7441ad4f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:04.994921 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da072b72-bbcf-4309-9ac3-a7a7441ad4f2 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:05.002076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1024/2032] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:04 2022] DELETE /identity/v3/users/cd3ccc8930f04e22bb45413854720c43 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:00:05.014370 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1009/2033] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 17:00:05.018908 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff57ed7-45e6-43a1-be64-0a92db5d281c admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:05.081608 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff57ed7-45e6-43a1-be64-0a92db5d281c admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:05.086256 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9276d-bb8b-4f07-b7ec-d9dc63142c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:05.086852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9276d-bb8b-4f07-b7ec-d9dc63142c0d admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:05.087136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9276d-bb8b-4f07-b7ec-d9dc63142c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:05.087415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9276d-bb8b-4f07-b7ec-d9dc63142c0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:05.088197 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9276d-bb8b-4f07-b7ec-d9dc63142c0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:05.090204 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9276d-bb8b-4f07-b7ec-d9dc63142c0d admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:05.204665 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1025/2034] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:05 2022] POST /identity/v3/projects => generated 361 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:05.206936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da072b72-bbcf-4309-9ac3-a7a7441ad4f2 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:05.219504 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da072b72-bbcf-4309-9ac3-a7a7441ad4f2 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:05.281822 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f49501-715d-403c-ad25-a0455e9be22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:05.282495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f49501-715d-403c-ad25-a0455e9be22e admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:05.282783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f49501-715d-403c-ad25-a0455e9be22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:05.283063 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f49501-715d-403c-ad25-a0455e9be22e admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:05.283766 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f49501-715d-403c-ad25-a0455e9be22e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:05.285717 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f49501-715d-403c-ad25-a0455e9be22e admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:05.406471 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1010/2035] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:05 2022] POST /identity/v3/users => generated 281 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:05.412756 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9276d-bb8b-4f07-b7ec-d9dc63142c0d admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:05.423555 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9276d-bb8b-4f07-b7ec-d9dc63142c0d admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:05.428218 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27b409-eca9-4daf-964e-a8ee209a6beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:05.428882 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27b409-eca9-4daf-964e-a8ee209a6beb admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:05.429170 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27b409-eca9-4daf-964e-a8ee209a6beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:05.429451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27b409-eca9-4daf-964e-a8ee209a6beb admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:05.430194 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27b409-eca9-4daf-964e-a8ee209a6beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:05.432479 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27b409-eca9-4daf-964e-a8ee209a6beb admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:05.446827 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1026/2036] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:05.447318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f49501-715d-403c-ad25-a0455e9be22e admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:05.450468 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27b409-eca9-4daf-964e-a8ee209a6beb admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:05.455276 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-a7f49501-715d-403c-ad25-a0455e9be22e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:05.467558 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27b409-eca9-4daf-964e-a8ee209a6beb admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:05.473628 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956f2b3-07ac-4e97-808c-9b371e409ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:05.476243 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956f2b3-07ac-4e97-808c-9b371e409ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:05.476243 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956f2b3-07ac-4e97-808c-9b371e409ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:05.476243 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956f2b3-07ac-4e97-808c-9b371e409ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:05.476243 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956f2b3-07ac-4e97-808c-9b371e409ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:05.481128 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956f2b3-07ac-4e97-808c-9b371e409ab5 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:05.487555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f49501-715d-403c-ad25-a0455e9be22e admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:05.499767 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdc670-7139-469d-9fd9-af36ac5462c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:05.500684 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdc670-7139-469d-9fd9-af36ac5462c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:05.501054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdc670-7139-469d-9fd9-af36ac5462c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:05.501228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdc670-7139-469d-9fd9-af36ac5462c4 admin admin] PATH_INFO: `/v3/projects/8c3fec0814aa4eb2b395237eba0eb7be` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:05.502597 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdc670-7139-469d-9fd9-af36ac5462c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c3fec0814aa4eb2b395237eba0eb7be)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:05.508563 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1027/2037] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:05.508694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdc670-7139-469d-9fd9-af36ac5462c4 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:05.516619 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:05.526939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956f2b3-07ac-4e97-808c-9b371e409ab5 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:05.537160 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956f2b3-07ac-4e97-808c-9b371e409ab5 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:05.544196 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417c3e2-aaf8-4232-8d2b-dc3cafd63ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:05.546552 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417c3e2-aaf8-4232-8d2b-dc3cafd63ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:05.546552 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417c3e2-aaf8-4232-8d2b-dc3cafd63ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:05.546552 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417c3e2-aaf8-4232-8d2b-dc3cafd63ce7 admin admin] PATH_INFO: `/v3/projects/bd7d92f234fa41e4b16e371d250013eb/users/c2224727985c4acb902ce5e63e215e3e/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:05.561244 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417c3e2-aaf8-4232-8d2b-dc3cafd63ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7d92f234fa41e4b16e371d250013eb, user_id=c2224727985c4acb902ce5e63e215e3e, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:05.563946 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417c3e2-aaf8-4232-8d2b-dc3cafd63ce7 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:05.661393 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1028/2038] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:05 2022] PUT /identity/v3/projects/bd7d92f234fa41e4b16e371d250013eb/users/c2224727985c4acb902ce5e63e215e3e/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:05.672261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca06d5-2aaa-4fe2-888c-8b38e01165b4 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:05.672553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca06d5-2aaa-4fe2-888c-8b38e01165b4 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:05.672829 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca06d5-2aaa-4fe2-888c-8b38e01165b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:05.673066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0abdc670-7139-469d-9fd9-af36ac5462c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c3fec0814aa4eb2b395237eba0eb7be', 'request_id': 'req-0abdc670-7139-469d-9fd9-af36ac5462c4'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:05.698403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-36ca06d5-2aaa-4fe2-888c-8b38e01165b4 None None] MFA Rules not processed for user `c2224727985c4acb902ce5e63e215e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:05.699672 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-36ca06d5-2aaa-4fe2-888c-8b38e01165b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:05.748984 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:05.770802 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1029/2039] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:05.779992 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0abdc670-7139-469d-9fd9-af36ac5462c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c3fec0814aa4eb2b395237eba0eb7be', 'request_id': 'req-0abdc670-7139-469d-9fd9-af36ac5462c4'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:05.785988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0abdc670-7139-469d-9fd9-af36ac5462c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c3fec0814aa4eb2b395237eba0eb7be', 'request_id': 'req-0abdc670-7139-469d-9fd9-af36ac5462c4'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:05.810189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0abdc670-7139-469d-9fd9-af36ac5462c4 admin admin] The token cache is being invalidate because project 8c3fec0814aa4eb2b395237eba0eb7be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:05.810734 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0abdc670-7139-469d-9fd9-af36ac5462c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:05.814017 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0abdc670-7139-469d-9fd9-af36ac5462c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:05.814671 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca06d5-2aaa-4fe2-888c-8b38e01165b4 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:05.816180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1011/2040] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:05 2022] DELETE /identity/v3/projects/8c3fec0814aa4eb2b395237eba0eb7be => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:05.816949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-36ca06d5-2aaa-4fe2-888c-8b38e01165b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:05.821059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb27b42-6b97-4365-884a-941a2f29afbb None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:05.821562 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb27b42-6b97-4365-884a-941a2f29afbb None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:05.822005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb27b42-6b97-4365-884a-941a2f29afbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:05.848297 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-bfb27b42-6b97-4365-884a-941a2f29afbb None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:05.849686 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-bfb27b42-6b97-4365-884a-941a2f29afbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:05.894754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca06d5-2aaa-4fe2-888c-8b38e01165b4 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:05.898426 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918c05f-f114-4cb3-8f05-c8c3ff269f5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:05.899072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918c05f-f114-4cb3-8f05-c8c3ff269f5e service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:05.899354 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918c05f-f114-4cb3-8f05-c8c3ff269f5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:05.899816 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918c05f-f114-4cb3-8f05-c8c3ff269f5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:05.902245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-4918c05f-f114-4cb3-8f05-c8c3ff269f5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:05.915688 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918c05f-f114-4cb3-8f05-c8c3ff269f5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:05.917905 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918c05f-f114-4cb3-8f05-c8c3ff269f5e service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:05.921454 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1012/2041] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:00:05.927580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1030/2042] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:00:05.929155 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec07ea-b8ca-4b13-a776-d16af0774384 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:05.929613 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec07ea-b8ca-4b13-a776-d16af0774384 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:05.929902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec07ea-b8ca-4b13-a776-d16af0774384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:05.943032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918c05f-f114-4cb3-8f05-c8c3ff269f5e service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:05.944648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-4918c05f-f114-4cb3-8f05-c8c3ff269f5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:05.949925 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-21ec07ea-b8ca-4b13-a776-d16af0774384 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:05.951123 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-21ec07ea-b8ca-4b13-a776-d16af0774384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:05.960097 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918c05f-f114-4cb3-8f05-c8c3ff269f5e service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:05.971032 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1013/2043] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:05.971032 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec07ea-b8ca-4b13-a776-d16af0774384 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:05.974643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9254efb-b4fe-438d-bf7f-db2c7b896b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:05.974889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec07ea-b8ca-4b13-a776-d16af0774384 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:05.975586 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9254efb-b4fe-438d-bf7f-db2c7b896b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:05.975922 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9254efb-b4fe-438d-bf7f-db2c7b896b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:05.976236 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9254efb-b4fe-438d-bf7f-db2c7b896b3b admin admin] PATH_INFO: `/v3/users/c2224727985c4acb902ce5e63e215e3e` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:05.977457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9254efb-b4fe-438d-bf7f-db2c7b896b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2224727985c4acb902ce5e63e215e3e)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:05.979537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9254efb-b4fe-438d-bf7f-db2c7b896b3b admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:05.979698 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c91917-688e-4f57-aa91-6d5cbb3b373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:05.980366 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c91917-688e-4f57-aa91-6d5cbb3b373e admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:05.980650 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c91917-688e-4f57-aa91-6d5cbb3b373e admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:05.980963 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c91917-688e-4f57-aa91-6d5cbb3b373e admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:05.981694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c91917-688e-4f57-aa91-6d5cbb3b373e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:00:05.982000 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c91917-688e-4f57-aa91-6d5cbb3b373e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:05.983571 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c91917-688e-4f57-aa91-6d5cbb3b373e admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:05.996456 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1014/2044] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:00:06.000452 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c91917-688e-4f57-aa91-6d5cbb3b373e admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:06.010994 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c91917-688e-4f57-aa91-6d5cbb3b373e admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:06.016008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6542d-baca-48d5-8b4b-97b154b13b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:06.016740 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6542d-baca-48d5-8b4b-97b154b13b6d admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:06.017044 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6542d-baca-48d5-8b4b-97b154b13b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:06.017331 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6542d-baca-48d5-8b4b-97b154b13b6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:06.018064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6542d-baca-48d5-8b4b-97b154b13b6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:06.020085 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6542d-baca-48d5-8b4b-97b154b13b6d admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:06.105798 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1015/2045] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:05 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:00:06.109843 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6542d-baca-48d5-8b4b-97b154b13b6d admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:06.170654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6542d-baca-48d5-8b4b-97b154b13b6d admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:06.174453 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe9fc5-db8e-47cc-b7f2-c9bd0b419281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:06.175116 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe9fc5-db8e-47cc-b7f2-c9bd0b419281 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:06.175399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe9fc5-db8e-47cc-b7f2-c9bd0b419281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:06.175682 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe9fc5-db8e-47cc-b7f2-c9bd0b419281 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:06.176407 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe9fc5-db8e-47cc-b7f2-c9bd0b419281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:06.178365 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe9fc5-db8e-47cc-b7f2-c9bd0b419281 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:06.204687 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-a9254efb-b4fe-438d-bf7f-db2c7b896b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2224727985c4acb902ce5e63e215e3e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:06.211452 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-a9254efb-b4fe-438d-bf7f-db2c7b896b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2224727985c4acb902ce5e63e215e3e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:06.212179 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-a9254efb-b4fe-438d-bf7f-db2c7b896b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2224727985c4acb902ce5e63e215e3e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:06.224232 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-a9254efb-b4fe-438d-bf7f-db2c7b896b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2224727985c4acb902ce5e63e215e3e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:06.224860 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-a9254efb-b4fe-438d-bf7f-db2c7b896b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2224727985c4acb902ce5e63e215e3e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:06.247082 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1016/2046] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:06 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:00:06.251077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe9fc5-db8e-47cc-b7f2-c9bd0b419281 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:06.252741 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-1dfe9fc5-db8e-47cc-b7f2-c9bd0b419281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:06.265303 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe9fc5-db8e-47cc-b7f2-c9bd0b419281 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:06.267516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:06.271535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb86bec-e756-4b88-8765-ab9fb323e692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:06.272192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb86bec-e756-4b88-8765-ab9fb323e692 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:06.272506 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb86bec-e756-4b88-8765-ab9fb323e692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:06.272796 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb86bec-e756-4b88-8765-ab9fb323e692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:06.273498 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb86bec-e756-4b88-8765-ab9fb323e692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:06.275072 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb86bec-e756-4b88-8765-ab9fb323e692 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:06.285914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1017/2047] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:00:06.289746 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb86bec-e756-4b88-8765-ab9fb323e692 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:06.298933 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb86bec-e756-4b88-8765-ab9fb323e692 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:06.303673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f756e-b95c-469c-9815-e26ff8373597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:06.304309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f756e-b95c-469c-9815-e26ff8373597 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:06.304594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f756e-b95c-469c-9815-e26ff8373597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:06.304873 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f756e-b95c-469c-9815-e26ff8373597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:06.305573 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f756e-b95c-469c-9815-e26ff8373597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:06.307130 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f756e-b95c-469c-9815-e26ff8373597 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:06.317468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1018/2048] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:00:06.321360 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f756e-b95c-469c-9815-e26ff8373597 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:06.327735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1031/2049] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:05 2022] DELETE /identity/v3/users/c2224727985c4acb902ce5e63e215e3e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:00:06.331625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f756e-b95c-469c-9815-e26ff8373597 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:06.334912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01902202-5cad-44a4-8d31-b529d880eb37 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:06.335392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01902202-5cad-44a4-8d31-b529d880eb37 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:06.336530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01902202-5cad-44a4-8d31-b529d880eb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:06.353999 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-01902202-5cad-44a4-8d31-b529d880eb37 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:06.355551 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-01902202-5cad-44a4-8d31-b529d880eb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:06.390359 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805207a-1f52-47db-8712-e691e9135ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:06.391367 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805207a-1f52-47db-8712-e691e9135ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:06.391663 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805207a-1f52-47db-8712-e691e9135ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:06.391952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805207a-1f52-47db-8712-e691e9135ae2 admin admin] PATH_INFO: `/v3/projects/90ac46fce3e44d40b6fdd37e30968900/users/642e8eb5e8a142bbb71e8333d45d9dd1/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:06.411204 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805207a-1f52-47db-8712-e691e9135ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ac46fce3e44d40b6fdd37e30968900, user_id=642e8eb5e8a142bbb71e8333d45d9dd1, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:06.413953 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805207a-1f52-47db-8712-e691e9135ae2 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:06.417026 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1032/2050] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:06.426938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01902202-5cad-44a4-8d31-b529d880eb37 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:06.428289 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-01902202-5cad-44a4-8d31-b529d880eb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:06.434126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:06.486104 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01902202-5cad-44a4-8d31-b529d880eb37 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:06.489811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174d5ba-d850-4f83-a315-688c9ae2c78b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:06.490528 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174d5ba-d850-4f83-a315-688c9ae2c78b service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:06.490731 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174d5ba-d850-4f83-a315-688c9ae2c78b service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:06.491006 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174d5ba-d850-4f83-a315-688c9ae2c78b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:06.500463 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174d5ba-d850-4f83-a315-688c9ae2c78b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:06.501932 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174d5ba-d850-4f83-a315-688c9ae2c78b service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:06.512050 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1033/2051] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:00:06.528912 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1019/2052] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:06 2022] PUT /identity/v3/projects/90ac46fce3e44d40b6fdd37e30968900/users/642e8eb5e8a142bbb71e8333d45d9dd1/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:00:06.539272 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42706af9-24de-44a5-a213-cffb2fc28b10 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:06.539832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42706af9-24de-44a5-a213-cffb2fc28b10 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:06.540196 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42706af9-24de-44a5-a213-cffb2fc28b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:06.569331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-42706af9-24de-44a5-a213-cffb2fc28b10 None None] MFA Rules not processed for user `642e8eb5e8a142bbb71e8333d45d9dd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:06.570716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-42706af9-24de-44a5-a213-cffb2fc28b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:06.646064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1034/2053] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:06.650910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805207a-1f52-47db-8712-e691e9135ae2 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:06.713153 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805207a-1f52-47db-8712-e691e9135ae2 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:06.718078 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0705a-f872-41eb-a504-1da8c007e67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:06.718744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0705a-f872-41eb-a504-1da8c007e67d admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:06.719031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0705a-f872-41eb-a504-1da8c007e67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:06.719310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0705a-f872-41eb-a504-1da8c007e67d admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:06.720076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0705a-f872-41eb-a504-1da8c007e67d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:06.722042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0705a-f872-41eb-a504-1da8c007e67d admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:06.821319 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1020/2054] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:06 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:00:06.822827 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42706af9-24de-44a5-a213-cffb2fc28b10 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:06.835449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42706af9-24de-44a5-a213-cffb2fc28b10 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:06.903233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112d354-688d-440a-9a28-d9947f64b601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:06.903996 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112d354-688d-440a-9a28-d9947f64b601 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:06.904333 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112d354-688d-440a-9a28-d9947f64b601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:06.904733 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112d354-688d-440a-9a28-d9947f64b601 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:06.905452 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112d354-688d-440a-9a28-d9947f64b601 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:06.907391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112d354-688d-440a-9a28-d9947f64b601 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:06.941078 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0705a-f872-41eb-a504-1da8c007e67d admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:06.944161 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-19e0705a-f872-41eb-a504-1da8c007e67d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:06.957621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0705a-f872-41eb-a504-1da8c007e67d admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:06.962273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c359229-3911-4a64-94c7-215f8a1eb3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:06.963240 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c359229-3911-4a64-94c7-215f8a1eb3f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:06.963508 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c359229-3911-4a64-94c7-215f8a1eb3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:06.963825 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c359229-3911-4a64-94c7-215f8a1eb3f3 admin admin] PATH_INFO: `/v3/projects/bd7d92f234fa41e4b16e371d250013eb` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:06.965158 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c359229-3911-4a64-94c7-215f8a1eb3f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd7d92f234fa41e4b16e371d250013eb)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:06.967047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c359229-3911-4a64-94c7-215f8a1eb3f3 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:06.995260 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:07.013382 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1035/2055] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:06 2022] POST /identity/v3/users => generated 299 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:07.017236 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112d354-688d-440a-9a28-d9947f64b601 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:07.029958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112d354-688d-440a-9a28-d9947f64b601 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:07.035047 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e97754-a417-4447-a662-976bbd2b1856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:07.035745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e97754-a417-4447-a662-976bbd2b1856 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:07.036034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e97754-a417-4447-a662-976bbd2b1856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:07.036353 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e97754-a417-4447-a662-976bbd2b1856 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:07.037100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e97754-a417-4447-a662-976bbd2b1856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:07.038755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e97754-a417-4447-a662-976bbd2b1856 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:07.049565 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1036/2056] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:07.053747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e97754-a417-4447-a662-976bbd2b1856 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:07.063931 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e97754-a417-4447-a662-976bbd2b1856 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:07.070528 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db572714-3201-476f-ae2b-566cfffbd5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:07.071880 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db572714-3201-476f-ae2b-566cfffbd5a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:07.072786 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db572714-3201-476f-ae2b-566cfffbd5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:07.073127 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db572714-3201-476f-ae2b-566cfffbd5a3 admin admin] PATH_INFO: `/v3/projects/cb66eecaeb304be1ba3b75d2b4d36776/users/6df8a3f79c55499ba3a57548c8afe7c0/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:07.085960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3c359229-3911-4a64-94c7-215f8a1eb3f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7d92f234fa41e4b16e371d250013eb', 'request_id': 'req-3c359229-3911-4a64-94c7-215f8a1eb3f3'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:07.093482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:07.096857 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db572714-3201-476f-ae2b-566cfffbd5a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb66eecaeb304be1ba3b75d2b4d36776, user_id=6df8a3f79c55499ba3a57548c8afe7c0, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:07.116155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db572714-3201-476f-ae2b-566cfffbd5a3 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:07.156048 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3c359229-3911-4a64-94c7-215f8a1eb3f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7d92f234fa41e4b16e371d250013eb', 'request_id': 'req-3c359229-3911-4a64-94c7-215f8a1eb3f3'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:07.161846 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3c359229-3911-4a64-94c7-215f8a1eb3f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7d92f234fa41e4b16e371d250013eb', 'request_id': 'req-3c359229-3911-4a64-94c7-215f8a1eb3f3'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:07.173093 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3c359229-3911-4a64-94c7-215f8a1eb3f3 admin admin] The token cache is being invalidate because project bd7d92f234fa41e4b16e371d250013eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:07.173417 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3c359229-3911-4a64-94c7-215f8a1eb3f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:07.174108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3c359229-3911-4a64-94c7-215f8a1eb3f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:07.175644 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1021/2057] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:06 2022] DELETE /identity/v3/projects/bd7d92f234fa41e4b16e371d250013eb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:07.180183 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc2b41-635c-482a-b5fd-9cefa2895540 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:07.180468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc2b41-635c-482a-b5fd-9cefa2895540 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:07.180742 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc2b41-635c-482a-b5fd-9cefa2895540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:07.198344 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-9dbc2b41-635c-482a-b5fd-9cefa2895540 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:07.199579 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-9dbc2b41-635c-482a-b5fd-9cefa2895540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:07.211373 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1037/2058] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:07 2022] PUT /identity/v3/projects/cb66eecaeb304be1ba3b75d2b4d36776/users/6df8a3f79c55499ba3a57548c8afe7c0/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:07.215302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db572714-3201-476f-ae2b-566cfffbd5a3 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:07.217065 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-db572714-3201-476f-ae2b-566cfffbd5a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:07.258291 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1022/2059] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:00:07.267537 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dda388-64ec-4ce6-b82c-0e27f9975dca None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:07.267830 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dda388-64ec-4ce6-b82c-0e27f9975dca None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:07.268122 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dda388-64ec-4ce6-b82c-0e27f9975dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:07.284583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db572714-3201-476f-ae2b-566cfffbd5a3 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:07.286058 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-97dda388-64ec-4ce6-b82c-0e27f9975dca None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:07.287259 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-97dda388-64ec-4ce6-b82c-0e27f9975dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:07.289951 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378bcef-1c7d-41c7-994e-fe387095ee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:07.290704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378bcef-1c7d-41c7-994e-fe387095ee61 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:07.291023 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378bcef-1c7d-41c7-994e-fe387095ee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:07.291299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378bcef-1c7d-41c7-994e-fe387095ee61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:07.292033 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378bcef-1c7d-41c7-994e-fe387095ee61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:07.293660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378bcef-1c7d-41c7-994e-fe387095ee61 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:07.295720 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1023/2060] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:00:07.299709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dda388-64ec-4ce6-b82c-0e27f9975dca None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:07.303845 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1038/2061] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:00:07.308413 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378bcef-1c7d-41c7-994e-fe387095ee61 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:07.312208 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dda388-64ec-4ce6-b82c-0e27f9975dca None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:07.317267 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867066ea-a273-4771-8b12-d1e88f120e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:07.317949 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867066ea-a273-4771-8b12-d1e88f120e69 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:07.318232 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867066ea-a273-4771-8b12-d1e88f120e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:07.318504 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867066ea-a273-4771-8b12-d1e88f120e69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:07.319054 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378bcef-1c7d-41c7-994e-fe387095ee61 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:07.319251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867066ea-a273-4771-8b12-d1e88f120e69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:00:07.319578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867066ea-a273-4771-8b12-d1e88f120e69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:07.321364 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867066ea-a273-4771-8b12-d1e88f120e69 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:07.324889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb66ab5-e75b-4aba-915a-793f556eee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:07.325776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb66ab5-e75b-4aba-915a-793f556eee6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:07.326055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb66ab5-e75b-4aba-915a-793f556eee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:07.326332 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb66ab5-e75b-4aba-915a-793f556eee6b admin admin] PATH_INFO: `/v3/projects/cb66eecaeb304be1ba3b75d2b4d36776/users/6df8a3f79c55499ba3a57548c8afe7c0/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:07.331212 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb66ab5-e75b-4aba-915a-793f556eee6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb66eecaeb304be1ba3b75d2b4d36776, user_id=6df8a3f79c55499ba3a57548c8afe7c0, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:07.333904 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb66ab5-e75b-4aba-915a-793f556eee6b admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:07.335826 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1024/2062] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 17:00:07.340226 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867066ea-a273-4771-8b12-d1e88f120e69 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:07.344896 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1039/2063] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:07 2022] PUT /identity/v3/projects/cb66eecaeb304be1ba3b75d2b4d36776/users/6df8a3f79c55499ba3a57548c8afe7c0/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:07.350530 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867066ea-a273-4771-8b12-d1e88f120e69 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:07.355888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8f780-d982-4003-8db2-c00b20298206 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:07.356217 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8f780-d982-4003-8db2-c00b20298206 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:07.356508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8f780-d982-4003-8db2-c00b20298206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:07.384312 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-e9c8f780-d982-4003-8db2-c00b20298206 None None] MFA Rules not processed for user `6df8a3f79c55499ba3a57548c8afe7c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:07.386076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e9c8f780-d982-4003-8db2-c00b20298206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:07.405849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9ec21-5791-409b-8d4d-8b6a83d0b23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:07.406507 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9ec21-5791-409b-8d4d-8b6a83d0b23f admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:07.406791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9ec21-5791-409b-8d4d-8b6a83d0b23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:07.407070 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9ec21-5791-409b-8d4d-8b6a83d0b23f admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:07.407767 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9ec21-5791-409b-8d4d-8b6a83d0b23f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:07.409721 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9ec21-5791-409b-8d4d-8b6a83d0b23f admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:07.461834 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1040/2064] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:00:07.474377 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8f780-d982-4003-8db2-c00b20298206 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:07.479055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e9c8f780-d982-4003-8db2-c00b20298206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:07.507386 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1025/2065] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:07 2022] POST /identity/v3/projects => generated 371 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:00:07.508467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9ec21-5791-409b-8d4d-8b6a83d0b23f admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:07.525595 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:07.543894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8f780-d982-4003-8db2-c00b20298206 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:07.552414 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:07.570315 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9ec21-5791-409b-8d4d-8b6a83d0b23f admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:07.575006 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc42c2-bd65-41dc-896b-2c3dae7a4408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:07.575789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc42c2-bd65-41dc-896b-2c3dae7a4408 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:07.576082 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc42c2-bd65-41dc-896b-2c3dae7a4408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:07.576389 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc42c2-bd65-41dc-896b-2c3dae7a4408 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:07.577078 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc42c2-bd65-41dc-896b-2c3dae7a4408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:07.578980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc42c2-bd65-41dc-896b-2c3dae7a4408 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:07.591760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b631c77-e2ea-4c5c-995f-8098f930c20e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:07.592460 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b631c77-e2ea-4c5c-995f-8098f930c20e service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:07.593041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b631c77-e2ea-4c5c-995f-8098f930c20e service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:07.593369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b631c77-e2ea-4c5c-995f-8098f930c20e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:07.652082 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1026/2066] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:07 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:00:07.656361 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b631c77-e2ea-4c5c-995f-8098f930c20e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:07.657915 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b631c77-e2ea-4c5c-995f-8098f930c20e service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:07.658156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc42c2-bd65-41dc-896b-2c3dae7a4408 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:07.668224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1041/2067] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:00:07.669459 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc42c2-bd65-41dc-896b-2c3dae7a4408 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:07.679156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d03c06-1518-4db1-a85e-f8f15d5d73e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:07.679156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d03c06-1518-4db1-a85e-f8f15d5d73e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:07.679156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d03c06-1518-4db1-a85e-f8f15d5d73e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:07.679156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d03c06-1518-4db1-a85e-f8f15d5d73e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:07.679498 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d03c06-1518-4db1-a85e-f8f15d5d73e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:07.679498 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d03c06-1518-4db1-a85e-f8f15d5d73e6 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:07.689042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1027/2068] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:00:07.692782 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b631c77-e2ea-4c5c-995f-8098f930c20e service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:07.704752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b631c77-e2ea-4c5c-995f-8098f930c20e service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:07.708318 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25abbba-bd10-4766-9195-c4c2600f77ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:07.708920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25abbba-bd10-4766-9195-c4c2600f77ae admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:07.709208 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25abbba-bd10-4766-9195-c4c2600f77ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:07.709496 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25abbba-bd10-4766-9195-c4c2600f77ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:07.710236 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25abbba-bd10-4766-9195-c4c2600f77ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:07.711839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25abbba-bd10-4766-9195-c4c2600f77ae admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:07.722137 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1042/2069] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:07.726329 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d03c06-1518-4db1-a85e-f8f15d5d73e6 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:07.736825 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d03c06-1518-4db1-a85e-f8f15d5d73e6 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:07.741581 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6a568-7e9a-4a9b-850e-e8622a7b9db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:07.742532 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6a568-7e9a-4a9b-850e-e8622a7b9db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:07.742881 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6a568-7e9a-4a9b-850e-e8622a7b9db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:07.743226 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6a568-7e9a-4a9b-850e-e8622a7b9db1 admin admin] PATH_INFO: `/v3/projects/758e7e6253194fc08cb019db02e3f4a0/users/aa1bc0b3ee7c4963b61a699f35a41052/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:07.759665 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6a568-7e9a-4a9b-850e-e8622a7b9db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758e7e6253194fc08cb019db02e3f4a0, user_id=aa1bc0b3ee7c4963b61a699f35a41052, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:07.762423 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6a568-7e9a-4a9b-850e-e8622a7b9db1 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:07.797854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25abbba-bd10-4766-9195-c4c2600f77ae admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:07.808367 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25abbba-bd10-4766-9195-c4c2600f77ae admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:07.813028 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3be14e-4f9d-428d-b997-f81c04b79a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:07.813878 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3be14e-4f9d-428d-b997-f81c04b79a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:07.814161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3be14e-4f9d-428d-b997-f81c04b79a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:07.814442 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3be14e-4f9d-428d-b997-f81c04b79a79 admin admin] PATH_INFO: `/v3/users/642e8eb5e8a142bbb71e8333d45d9dd1` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:07.815640 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3be14e-4f9d-428d-b997-f81c04b79a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=642e8eb5e8a142bbb71e8333d45d9dd1)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:07.817575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3be14e-4f9d-428d-b997-f81c04b79a79 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:07.846140 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1028/2070] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:07 2022] PUT /identity/v3/projects/758e7e6253194fc08cb019db02e3f4a0/users/aa1bc0b3ee7c4963b61a699f35a41052/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:07.857831 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572b6a4-1534-4059-8961-7acaf3a9549d None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:07.858122 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572b6a4-1534-4059-8961-7acaf3a9549d None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:07.858399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572b6a4-1534-4059-8961-7acaf3a9549d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:07.885547 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-0572b6a4-1534-4059-8961-7acaf3a9549d None None] MFA Rules not processed for user `aa1bc0b3ee7c4963b61a699f35a41052`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:07.886771 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0572b6a4-1534-4059-8961-7acaf3a9549d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:07.966563 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1029/2071] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:00:07.967497 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572b6a4-1534-4059-8961-7acaf3a9549d None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:08.050377 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572b6a4-1534-4059-8961-7acaf3a9549d None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:08.055380 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbdf39-bab1-4f5d-ba33-5f40ac74d044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:08.056041 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbdf39-bab1-4f5d-ba33-5f40ac74d044 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:08.056404 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbdf39-bab1-4f5d-ba33-5f40ac74d044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:08.057181 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbdf39-bab1-4f5d-ba33-5f40ac74d044 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:08.057893 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbdf39-bab1-4f5d-ba33-5f40ac74d044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:08.060158 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbdf39-bab1-4f5d-ba33-5f40ac74d044 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:08.060925 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-1e3be14e-4f9d-428d-b997-f81c04b79a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '642e8eb5e8a142bbb71e8333d45d9dd1'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:08.063421 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:08.068905 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-1e3be14e-4f9d-428d-b997-f81c04b79a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '642e8eb5e8a142bbb71e8333d45d9dd1'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:08.069791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-1e3be14e-4f9d-428d-b997-f81c04b79a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '642e8eb5e8a142bbb71e8333d45d9dd1'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:08.083837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-1e3be14e-4f9d-428d-b997-f81c04b79a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '642e8eb5e8a142bbb71e8333d45d9dd1'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:08.084651 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-1e3be14e-4f9d-428d-b997-f81c04b79a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '642e8eb5e8a142bbb71e8333d45d9dd1'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:08.148040 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1030/2072] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:07 2022] POST /identity/v3/projects => generated 375 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:00:08.149381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbdf39-bab1-4f5d-ba33-5f40ac74d044 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:08.151566 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-86dbdf39-bab1-4f5d-ba33-5f40ac74d044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:08.169210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1043/2073] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:07 2022] DELETE /identity/v3/users/642e8eb5e8a142bbb71e8333d45d9dd1 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:00:08.173815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de25682-50b1-45c2-9694-f2aed2e2d290 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:08.174323 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de25682-50b1-45c2-9694-f2aed2e2d290 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:08.174885 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de25682-50b1-45c2-9694-f2aed2e2d290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:08.193427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-3de25682-50b1-45c2-9694-f2aed2e2d290 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:08.194731 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3de25682-50b1-45c2-9694-f2aed2e2d290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:08.219694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:08.236438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbdf39-bab1-4f5d-ba33-5f40ac74d044 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:08.285730 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1044/2074] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:00:08.310013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de25682-50b1-45c2-9694-f2aed2e2d290 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:08.311731 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3de25682-50b1-45c2-9694-f2aed2e2d290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:08.362525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4510cc3-62a2-4fd2-b491-f4f7be7679df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:08.363227 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4510cc3-62a2-4fd2-b491-f4f7be7679df admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:08.363515 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4510cc3-62a2-4fd2-b491-f4f7be7679df admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:08.363881 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4510cc3-62a2-4fd2-b491-f4f7be7679df admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:08.364563 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4510cc3-62a2-4fd2-b491-f4f7be7679df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:08.366645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4510cc3-62a2-4fd2-b491-f4f7be7679df admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:08.388683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de25682-50b1-45c2-9694-f2aed2e2d290 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:08.397978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a746059-eb68-43cf-827a-4d3566cc1c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:08.397978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a746059-eb68-43cf-827a-4d3566cc1c61 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:08.397978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a746059-eb68-43cf-827a-4d3566cc1c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:08.397978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a746059-eb68-43cf-827a-4d3566cc1c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:08.403505 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a746059-eb68-43cf-827a-4d3566cc1c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:08.404982 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a746059-eb68-43cf-827a-4d3566cc1c61 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:08.414695 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1045/2075] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:00:08.497831 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1031/2076] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:08 2022] POST /identity/v3/users => generated 294 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:00:08.499180 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a746059-eb68-43cf-827a-4d3566cc1c61 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:08.512286 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a746059-eb68-43cf-827a-4d3566cc1c61 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:08.528302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd73629-9c78-4659-92d7-077e1bfa4ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:08.528963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd73629-9c78-4659-92d7-077e1bfa4ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:08.529251 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd73629-9c78-4659-92d7-077e1bfa4ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:08.530070 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd73629-9c78-4659-92d7-077e1bfa4ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:08.530980 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd73629-9c78-4659-92d7-077e1bfa4ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:08.533082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd73629-9c78-4659-92d7-077e1bfa4ab2 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:08.548156 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1046/2077] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:00:08.564206 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4510cc3-62a2-4fd2-b491-f4f7be7679df admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:08.568400 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4510cc3-62a2-4fd2-b491-f4f7be7679df admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:08.574054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aad226-2dc4-4d0f-b3f7-4b1840fae20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:08.575059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aad226-2dc4-4d0f-b3f7-4b1840fae20c admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:08.575410 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aad226-2dc4-4d0f-b3f7-4b1840fae20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:08.575753 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aad226-2dc4-4d0f-b3f7-4b1840fae20c admin admin] PATH_INFO: `/v3/projects/97b3662fafe8447da389fb410f934e98/users/746cafe1473d47ae9cf5760ce2c41377/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:08.596414 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aad226-2dc4-4d0f-b3f7-4b1840fae20c admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b3662fafe8447da389fb410f934e98, user_id=746cafe1473d47ae9cf5760ce2c41377, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:08.599599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aad226-2dc4-4d0f-b3f7-4b1840fae20c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:08.684793 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1032/2078] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:08 2022] PUT /identity/v3/projects/97b3662fafe8447da389fb410f934e98/users/746cafe1473d47ae9cf5760ce2c41377/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:08.685785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd73629-9c78-4659-92d7-077e1bfa4ab2 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:08.704373 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd73629-9c78-4659-92d7-077e1bfa4ab2 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:08.785799 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482ed1b-1be4-467c-a886-522271daa710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:08.786484 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482ed1b-1be4-467c-a886-522271daa710 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:08.786770 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482ed1b-1be4-467c-a886-522271daa710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:08.787052 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482ed1b-1be4-467c-a886-522271daa710 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:08.787808 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482ed1b-1be4-467c-a886-522271daa710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:08.789506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482ed1b-1be4-467c-a886-522271daa710 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:08.801495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1047/2079] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:00:08.805853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aad226-2dc4-4d0f-b3f7-4b1840fae20c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:08.817693 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aad226-2dc4-4d0f-b3f7-4b1840fae20c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:08.822999 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c427b-3dd9-4a1d-a07c-7ef52e43deda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:08.823993 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c427b-3dd9-4a1d-a07c-7ef52e43deda admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:08.824368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c427b-3dd9-4a1d-a07c-7ef52e43deda admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:08.824708 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c427b-3dd9-4a1d-a07c-7ef52e43deda admin admin] PATH_INFO: `/v3/projects/97b3662fafe8447da389fb410f934e98/users/746cafe1473d47ae9cf5760ce2c41377/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:08.826786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c427b-3dd9-4a1d-a07c-7ef52e43deda admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b3662fafe8447da389fb410f934e98, user_id=746cafe1473d47ae9cf5760ce2c41377, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:08.829722 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c427b-3dd9-4a1d-a07c-7ef52e43deda admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:08.850852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1033/2080] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:08 2022] PUT /identity/v3/projects/97b3662fafe8447da389fb410f934e98/users/746cafe1473d47ae9cf5760ce2c41377/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:08.851440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482ed1b-1be4-467c-a886-522271daa710 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:08.852411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94ae3b-3952-437a-be16-ce9ff4daa547 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:08.853118 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94ae3b-3952-437a-be16-ce9ff4daa547 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:08.854005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94ae3b-3952-437a-be16-ce9ff4daa547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:08.854601 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-9482ed1b-1be4-467c-a886-522271daa710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:08.884148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-9c94ae3b-3952-437a-be16-ce9ff4daa547 None None] MFA Rules not processed for user `746cafe1473d47ae9cf5760ce2c41377`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:08.885645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-9c94ae3b-3952-437a-be16-ce9ff4daa547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:08.896059 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482ed1b-1be4-467c-a886-522271daa710 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:08.929215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:08.957126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:08.966759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e8785-b5ae-4066-b839-76e814c9072a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:08.967636 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e8785-b5ae-4066-b839-76e814c9072a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:08.968858 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e8785-b5ae-4066-b839-76e814c9072a admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:08.968858 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e8785-b5ae-4066-b839-76e814c9072a admin admin] PATH_INFO: `/v3/projects/90ac46fce3e44d40b6fdd37e30968900` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:08.969763 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e8785-b5ae-4066-b839-76e814c9072a admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ac46fce3e44d40b6fdd37e30968900)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:08.971892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e8785-b5ae-4066-b839-76e814c9072a admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:08.976264 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1034/2081] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:09.015982 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94ae3b-3952-437a-be16-ce9ff4daa547 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:09.018785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-9c94ae3b-3952-437a-be16-ce9ff4daa547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:09.097405 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94ae3b-3952-437a-be16-ce9ff4daa547 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:09.112678 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-925e8785-b5ae-4066-b839-76e814c9072a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ac46fce3e44d40b6fdd37e30968900', 'request_id': 'req-925e8785-b5ae-4066-b839-76e814c9072a'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:09.159473 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e6c20-fa02-4500-a03c-7d46a67110aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:09.159473 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e6c20-fa02-4500-a03c-7d46a67110aa service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:09.159473 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e6c20-fa02-4500-a03c-7d46a67110aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:09.159473 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e6c20-fa02-4500-a03c-7d46a67110aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:09.159831 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-720e6c20-fa02-4500-a03c-7d46a67110aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:09.184740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-925e8785-b5ae-4066-b839-76e814c9072a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ac46fce3e44d40b6fdd37e30968900', 'request_id': 'req-925e8785-b5ae-4066-b839-76e814c9072a'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:09.191507 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-925e8785-b5ae-4066-b839-76e814c9072a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ac46fce3e44d40b6fdd37e30968900', 'request_id': 'req-925e8785-b5ae-4066-b839-76e814c9072a'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:09.202273 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-925e8785-b5ae-4066-b839-76e814c9072a admin admin] The token cache is being invalidate because project 90ac46fce3e44d40b6fdd37e30968900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:09.202631 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-925e8785-b5ae-4066-b839-76e814c9072a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:09.203503 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-925e8785-b5ae-4066-b839-76e814c9072a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:09.205179 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1048/2082] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:08 2022] DELETE /identity/v3/projects/90ac46fce3e44d40b6fdd37e30968900 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:09.209014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e8785-b5ae-4066-b839-76e814c9072a admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:09.210359 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-925e8785-b5ae-4066-b839-76e814c9072a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:09.220634 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e6c20-fa02-4500-a03c-7d46a67110aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:09.222249 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e6c20-fa02-4500-a03c-7d46a67110aa service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:09.231551 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1035/2083] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:00:09.287305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e8785-b5ae-4066-b839-76e814c9072a admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:09.292387 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7fb60-9d87-4618-8f06-438596a8ef73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:09.293269 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7fb60-9d87-4618-8f06-438596a8ef73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:09.300756 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7fb60-9d87-4618-8f06-438596a8ef73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:09.300756 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7fb60-9d87-4618-8f06-438596a8ef73 admin admin] PATH_INFO: `/v3/users/6df8a3f79c55499ba3a57548c8afe7c0` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:09.300756 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7fb60-9d87-4618-8f06-438596a8ef73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df8a3f79c55499ba3a57548c8afe7c0)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:09.300756 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7fb60-9d87-4618-8f06-438596a8ef73 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:09.571483 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fab7fb60-9d87-4618-8f06-438596a8ef73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df8a3f79c55499ba3a57548c8afe7c0'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:09.578780 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fab7fb60-9d87-4618-8f06-438596a8ef73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df8a3f79c55499ba3a57548c8afe7c0'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:09.579538 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fab7fb60-9d87-4618-8f06-438596a8ef73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df8a3f79c55499ba3a57548c8afe7c0'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:09.591541 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fab7fb60-9d87-4618-8f06-438596a8ef73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df8a3f79c55499ba3a57548c8afe7c0'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:09.592210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fab7fb60-9d87-4618-8f06-438596a8ef73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df8a3f79c55499ba3a57548c8afe7c0'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:09.710512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1049/2084] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:09 2022] DELETE /identity/v3/users/6df8a3f79c55499ba3a57548c8afe7c0 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:00:10.298284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e6c20-fa02-4500-a03c-7d46a67110aa service cinder] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:10.314344 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e6c20-fa02-4500-a03c-7d46a67110aa service cinder] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:10.404283 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:10.421716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd427c37-00ee-4c3c-aa84-ec56cbf7bbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:10.422666 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd427c37-00ee-4c3c-aa84-ec56cbf7bbae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:10.423003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd427c37-00ee-4c3c-aa84-ec56cbf7bbae admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:10.423316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd427c37-00ee-4c3c-aa84-ec56cbf7bbae admin admin] PATH_INFO: `/v3/projects/cb66eecaeb304be1ba3b75d2b4d36776` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:10.424624 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd427c37-00ee-4c3c-aa84-ec56cbf7bbae admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb66eecaeb304be1ba3b75d2b4d36776)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:10.426508 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd427c37-00ee-4c3c-aa84-ec56cbf7bbae admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:10.603508 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-bd427c37-00ee-4c3c-aa84-ec56cbf7bbae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb66eecaeb304be1ba3b75d2b4d36776', 'request_id': 'req-bd427c37-00ee-4c3c-aa84-ec56cbf7bbae'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:10.710425 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-bd427c37-00ee-4c3c-aa84-ec56cbf7bbae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb66eecaeb304be1ba3b75d2b4d36776', 'request_id': 'req-bd427c37-00ee-4c3c-aa84-ec56cbf7bbae'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:10.717723 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-bd427c37-00ee-4c3c-aa84-ec56cbf7bbae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb66eecaeb304be1ba3b75d2b4d36776', 'request_id': 'req-bd427c37-00ee-4c3c-aa84-ec56cbf7bbae'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:10.730098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-bd427c37-00ee-4c3c-aa84-ec56cbf7bbae admin admin] The token cache is being invalidate because project cb66eecaeb304be1ba3b75d2b4d36776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:10.730384 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-bd427c37-00ee-4c3c-aa84-ec56cbf7bbae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:10.731055 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-bd427c37-00ee-4c3c-aa84-ec56cbf7bbae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:10.732941 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1036/2085] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:10 2022] DELETE /identity/v3/projects/cb66eecaeb304be1ba3b75d2b4d36776 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:10.737664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733a42b-cdd6-4769-976c-ae7027e7e37a None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:10.738193 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733a42b-cdd6-4769-976c-ae7027e7e37a None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:10.738295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733a42b-cdd6-4769-976c-ae7027e7e37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:10.744726 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:10.756961 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-6733a42b-cdd6-4769-976c-ae7027e7e37a None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:10.758182 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-6733a42b-cdd6-4769-976c-ae7027e7e37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:10.818282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1050/2086] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:00:10.826954 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc5aba-db80-4e63-8274-b7a02b926203 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:10.827223 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc5aba-db80-4e63-8274-b7a02b926203 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:10.827502 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc5aba-db80-4e63-8274-b7a02b926203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:10.846600 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-0acc5aba-db80-4e63-8274-b7a02b926203 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:10.847816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0acc5aba-db80-4e63-8274-b7a02b926203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:10.855955 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1037/2087] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:10.860316 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733a42b-cdd6-4769-976c-ae7027e7e37a None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:10.870920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733a42b-cdd6-4769-976c-ae7027e7e37a None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:10.876027 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1a154-bfa0-4425-bc4d-305719c580a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:10.876717 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1a154-bfa0-4425-bc4d-305719c580a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:10.877001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1a154-bfa0-4425-bc4d-305719c580a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:10.877280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1a154-bfa0-4425-bc4d-305719c580a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:10.878038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1a154-bfa0-4425-bc4d-305719c580a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:00:10.878515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1a154-bfa0-4425-bc4d-305719c580a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:10.880233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1a154-bfa0-4425-bc4d-305719c580a4 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:10.892845 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1051/2088] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:00:10.898629 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc5aba-db80-4e63-8274-b7a02b926203 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:10.908668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc5aba-db80-4e63-8274-b7a02b926203 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:10.915313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ca710-5b13-4819-85bc-727c0b0f783a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:10.916057 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ca710-5b13-4819-85bc-727c0b0f783a admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:10.918382 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ca710-5b13-4819-85bc-727c0b0f783a admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:10.918382 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ca710-5b13-4819-85bc-727c0b0f783a admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:10.918382 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ca710-5b13-4819-85bc-727c0b0f783a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:10.919317 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ca710-5b13-4819-85bc-727c0b0f783a admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:11.020093 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1038/2089] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:10 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:11.024279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1a154-bfa0-4425-bc4d-305719c580a4 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:11.035241 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1a154-bfa0-4425-bc4d-305719c580a4 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:11.102958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbb008-aa72-49cd-a29b-05ef49a43944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:11.103528 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbb008-aa72-49cd-a29b-05ef49a43944 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:11.103801 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbb008-aa72-49cd-a29b-05ef49a43944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:11.104074 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbb008-aa72-49cd-a29b-05ef49a43944 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:11.104870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbb008-aa72-49cd-a29b-05ef49a43944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:11.106806 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbb008-aa72-49cd-a29b-05ef49a43944 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:11.175376 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1052/2090] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:11 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:11.176821 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ca710-5b13-4819-85bc-727c0b0f783a admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:11.195192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ca710-5b13-4819-85bc-727c0b0f783a admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:11.207729 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ceb05-0725-46d1-8c5a-b04544405490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:11.214264 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ceb05-0725-46d1-8c5a-b04544405490 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:11.214264 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ceb05-0725-46d1-8c5a-b04544405490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:11.214264 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ceb05-0725-46d1-8c5a-b04544405490 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:11.214264 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ceb05-0725-46d1-8c5a-b04544405490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:11.214264 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ceb05-0725-46d1-8c5a-b04544405490 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:11.234880 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1039/2091] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:11.238852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbb008-aa72-49cd-a29b-05ef49a43944 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:11.250371 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbb008-aa72-49cd-a29b-05ef49a43944 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:11.256312 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79eaa8-7b3b-46b9-9aa3-096556826515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:11.257051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79eaa8-7b3b-46b9-9aa3-096556826515 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:11.257415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79eaa8-7b3b-46b9-9aa3-096556826515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:11.257764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79eaa8-7b3b-46b9-9aa3-096556826515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:11.258570 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79eaa8-7b3b-46b9-9aa3-096556826515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:11.260441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79eaa8-7b3b-46b9-9aa3-096556826515 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:11.271767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1053/2092] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:11.275975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ceb05-0725-46d1-8c5a-b04544405490 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:11.288121 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ceb05-0725-46d1-8c5a-b04544405490 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:11.295816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486746d-8203-49f0-9525-47c392fb6246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:11.297320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486746d-8203-49f0-9525-47c392fb6246 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:11.297320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486746d-8203-49f0-9525-47c392fb6246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:11.301674 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5486746d-8203-49f0-9525-47c392fb6246 admin admin] PATH_INFO: `/v3/projects/96b2b583541c48d5a45e4e63fd6c01fb/users/660e364dc474422f832d2a1b3ee079c9/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:11.315890 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486746d-8203-49f0-9525-47c392fb6246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b2b583541c48d5a45e4e63fd6c01fb, user_id=660e364dc474422f832d2a1b3ee079c9, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:11.318675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5486746d-8203-49f0-9525-47c392fb6246 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:11.421443 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1040/2093] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:11 2022] PUT /identity/v3/projects/96b2b583541c48d5a45e4e63fd6c01fb/users/660e364dc474422f832d2a1b3ee079c9/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:00:11.438815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f4f2a-14e1-4d66-bb89-1c3ed405b2f9 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:11.438815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f4f2a-14e1-4d66-bb89-1c3ed405b2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:11.438815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f4f2a-14e1-4d66-bb89-1c3ed405b2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:11.474336 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-010f4f2a-14e1-4d66-bb89-1c3ed405b2f9 None None] MFA Rules not processed for user `660e364dc474422f832d2a1b3ee079c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:11.475668 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-010f4f2a-14e1-4d66-bb89-1c3ed405b2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:11.550484 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1054/2094] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:11.555064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486746d-8203-49f0-9525-47c392fb6246 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:11.632066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5486746d-8203-49f0-9525-47c392fb6246 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:11.636867 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723241dc-7573-44da-8a96-7b9138679eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:11.637521 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723241dc-7573-44da-8a96-7b9138679eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:11.637926 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723241dc-7573-44da-8a96-7b9138679eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:11.638488 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723241dc-7573-44da-8a96-7b9138679eb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:11.639265 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723241dc-7573-44da-8a96-7b9138679eb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:11.641232 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723241dc-7573-44da-8a96-7b9138679eb6 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:11.662532 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:11.772950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1041/2095] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:11 2022] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:00:11.774101 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f4f2a-14e1-4d66-bb89-1c3ed405b2f9 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:11.785480 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f4f2a-14e1-4d66-bb89-1c3ed405b2f9 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:11.843677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a9a60-a34d-4a19-8c96-17d86bb0f078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:11.844421 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a9a60-a34d-4a19-8c96-17d86bb0f078 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:11.844715 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a9a60-a34d-4a19-8c96-17d86bb0f078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:11.844996 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a9a60-a34d-4a19-8c96-17d86bb0f078 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:11.845827 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a9a60-a34d-4a19-8c96-17d86bb0f078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:11.847836 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a9a60-a34d-4a19-8c96-17d86bb0f078 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:11.971003 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1055/2096] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:11 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:00:11.973846 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723241dc-7573-44da-8a96-7b9138679eb6 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:11.984209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723241dc-7573-44da-8a96-7b9138679eb6 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:11.991183 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d098bb9-6393-4c70-8e72-7ed0f23db089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:11.991854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d098bb9-6393-4c70-8e72-7ed0f23db089 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:11.992167 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d098bb9-6393-4c70-8e72-7ed0f23db089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:11.992453 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d098bb9-6393-4c70-8e72-7ed0f23db089 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:11.993200 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d098bb9-6393-4c70-8e72-7ed0f23db089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:11.994879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d098bb9-6393-4c70-8e72-7ed0f23db089 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:12.006527 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1042/2097] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:12.014260 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a9a60-a34d-4a19-8c96-17d86bb0f078 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:12.027870 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a9a60-a34d-4a19-8c96-17d86bb0f078 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:12.033390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bf451-015f-44e9-9d53-e4fae0b4ec5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:12.034345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bf451-015f-44e9-9d53-e4fae0b4ec5a admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:12.034633 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bf451-015f-44e9-9d53-e4fae0b4ec5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:12.035077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bf451-015f-44e9-9d53-e4fae0b4ec5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:12.035707 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382bf451-015f-44e9-9d53-e4fae0b4ec5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:12.037405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382bf451-015f-44e9-9d53-e4fae0b4ec5a admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:12.048812 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1056/2098] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:12.053340 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d098bb9-6393-4c70-8e72-7ed0f23db089 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:12.065932 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d098bb9-6393-4c70-8e72-7ed0f23db089 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:12.072707 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b87672-89d0-4e31-9664-b0c1b472eb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:12.073565 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b87672-89d0-4e31-9664-b0c1b472eb15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:12.074134 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b87672-89d0-4e31-9664-b0c1b472eb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:12.074134 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b87672-89d0-4e31-9664-b0c1b472eb15 admin admin] PATH_INFO: `/v3/projects/78f57852956e4c23982e47000ede5d0d/users/54a77f1ef93c4d2aad0e50a704384c4c/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:12.091833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b87672-89d0-4e31-9664-b0c1b472eb15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f57852956e4c23982e47000ede5d0d, user_id=54a77f1ef93c4d2aad0e50a704384c4c, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:12.094611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b87672-89d0-4e31-9664-b0c1b472eb15 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:12.151055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:12.179578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1043/2099] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:12 2022] PUT /identity/v3/projects/78f57852956e4c23982e47000ede5d0d/users/54a77f1ef93c4d2aad0e50a704384c4c/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:12.190988 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5d81f-7f48-4f43-934a-23bd3ca49368 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:12.191366 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5d81f-7f48-4f43-934a-23bd3ca49368 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:12.191724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5d81f-7f48-4f43-934a-23bd3ca49368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:12.220587 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-22a5d81f-7f48-4f43-934a-23bd3ca49368 None None] MFA Rules not processed for user `54a77f1ef93c4d2aad0e50a704384c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:12.221822 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-22a5d81f-7f48-4f43-934a-23bd3ca49368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:12.285801 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1057/2100] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:12.294062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b87672-89d0-4e31-9664-b0c1b472eb15 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:12.364939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b87672-89d0-4e31-9664-b0c1b472eb15 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:12.375490 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad319b-4203-4498-865b-8f0abf348907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:12.375490 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad319b-4203-4498-865b-8f0abf348907 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:12.375490 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad319b-4203-4498-865b-8f0abf348907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:12.375490 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad319b-4203-4498-865b-8f0abf348907 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:12.375833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad319b-4203-4498-865b-8f0abf348907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:12.375833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad319b-4203-4498-865b-8f0abf348907 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:12.489197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1044/2101] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:12 2022] POST /identity/v3/projects => generated 381 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:12.493356 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5d81f-7f48-4f43-934a-23bd3ca49368 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:12.504635 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5d81f-7f48-4f43-934a-23bd3ca49368 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:12.569851 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9280c-bd0e-4b7b-b47d-31dbe7380bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:12.570519 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9280c-bd0e-4b7b-b47d-31dbe7380bda admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:12.570805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9280c-bd0e-4b7b-b47d-31dbe7380bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:12.571098 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9280c-bd0e-4b7b-b47d-31dbe7380bda admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:12.571786 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9280c-bd0e-4b7b-b47d-31dbe7380bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:12.574398 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c9280c-bd0e-4b7b-b47d-31dbe7380bda admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:12.668954 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1058/2102] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:12 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:12.673856 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad319b-4203-4498-865b-8f0abf348907 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:12.686613 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad319b-4203-4498-865b-8f0abf348907 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:12.691140 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a0eb1-1316-4dd2-a6ba-f489a65d0257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:12.691909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a0eb1-1316-4dd2-a6ba-f489a65d0257 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:12.692328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a0eb1-1316-4dd2-a6ba-f489a65d0257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:12.692676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a0eb1-1316-4dd2-a6ba-f489a65d0257 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:12.693477 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a0eb1-1316-4dd2-a6ba-f489a65d0257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:12.696554 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a0eb1-1316-4dd2-a6ba-f489a65d0257 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:12.706799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1045/2103] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:00:12.711066 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9280c-bd0e-4b7b-b47d-31dbe7380bda admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:12.726269 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9280c-bd0e-4b7b-b47d-31dbe7380bda admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:12.729474 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06df28-6c96-4cd9-b499-eb2f1c77e93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:12.730381 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06df28-6c96-4cd9-b499-eb2f1c77e93c admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:12.730669 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06df28-6c96-4cd9-b499-eb2f1c77e93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:12.730951 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06df28-6c96-4cd9-b499-eb2f1c77e93c admin admin] PATH_INFO: `/v3/projects/b80d252411bc429d817eb07189494d6e/users/bfd80a6dba554156b37e462c04974924/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:12.739449 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a0eb1-1316-4dd2-a6ba-f489a65d0257 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:12.741297 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-5b1a0eb1-1316-4dd2-a6ba-f489a65d0257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:12.749873 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06df28-6c96-4cd9-b499-eb2f1c77e93c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b80d252411bc429d817eb07189494d6e, user_id=bfd80a6dba554156b37e462c04974924, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:12.753090 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06df28-6c96-4cd9-b499-eb2f1c77e93c admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:12.757257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a0eb1-1316-4dd2-a6ba-f489a65d0257 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:12.773425 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541214f-74e1-4252-93ab-7f9962867e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:12.774450 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541214f-74e1-4252-93ab-7f9962867e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:12.774764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541214f-74e1-4252-93ab-7f9962867e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:12.777355 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541214f-74e1-4252-93ab-7f9962867e06 admin admin] PATH_INFO: `/v3/users/aa1bc0b3ee7c4963b61a699f35a41052` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:12.783611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541214f-74e1-4252-93ab-7f9962867e06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa1bc0b3ee7c4963b61a699f35a41052)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:12.789399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541214f-74e1-4252-93ab-7f9962867e06 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:12.854159 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1059/2104] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:12 2022] PUT /identity/v3/projects/b80d252411bc429d817eb07189494d6e/users/bfd80a6dba554156b37e462c04974924/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:12.858115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06df28-6c96-4cd9-b499-eb2f1c77e93c admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:12.921631 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06df28-6c96-4cd9-b499-eb2f1c77e93c admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:12.926687 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034c33b-de6a-4e47-ab32-c70da0289821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:12.927355 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034c33b-de6a-4e47-ab32-c70da0289821 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:12.927699 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034c33b-de6a-4e47-ab32-c70da0289821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:12.927990 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034c33b-de6a-4e47-ab32-c70da0289821 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:12.928777 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034c33b-de6a-4e47-ab32-c70da0289821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:12.930413 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034c33b-de6a-4e47-ab32-c70da0289821 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:12.942326 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1060/2105] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:00:12.946653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034c33b-de6a-4e47-ab32-c70da0289821 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:12.956494 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034c33b-de6a-4e47-ab32-c70da0289821 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:12.961126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aaa3b-9be6-40f9-b78a-0ba787ae7494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:12.961987 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aaa3b-9be6-40f9-b78a-0ba787ae7494 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:12.962279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aaa3b-9be6-40f9-b78a-0ba787ae7494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:12.962541 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aaa3b-9be6-40f9-b78a-0ba787ae7494 admin admin] PATH_INFO: `/v3/projects/b80d252411bc429d817eb07189494d6e/users/bfd80a6dba554156b37e462c04974924/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:12.965048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5aaa3b-9be6-40f9-b78a-0ba787ae7494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b80d252411bc429d817eb07189494d6e, user_id=bfd80a6dba554156b37e462c04974924, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:12.967700 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5aaa3b-9be6-40f9-b78a-0ba787ae7494 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:12.981045 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1061/2106] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:12 2022] PUT /identity/v3/projects/b80d252411bc429d817eb07189494d6e/users/bfd80a6dba554156b37e462c04974924/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:00:12.991094 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2246e-a2ef-45e0-84b4-824d807ae3f7 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:12.991389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2246e-a2ef-45e0-84b4-824d807ae3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:12.991674 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2246e-a2ef-45e0-84b4-824d807ae3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:13.020955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-edb2246e-a2ef-45e0-84b4-824d807ae3f7 None None] MFA Rules not processed for user `bfd80a6dba554156b37e462c04974924`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:13.021182 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-edb2246e-a2ef-45e0-84b4-824d807ae3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:13.066145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:13.077279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-5541214f-74e1-4252-93ab-7f9962867e06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa1bc0b3ee7c4963b61a699f35a41052'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:13.077951 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-5541214f-74e1-4252-93ab-7f9962867e06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa1bc0b3ee7c4963b61a699f35a41052'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:13.113184 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1062/2107] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:00:13.126040 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2246e-a2ef-45e0-84b4-824d807ae3f7 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:13.127411 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-edb2246e-a2ef-45e0-84b4-824d807ae3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:13.136704 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-5541214f-74e1-4252-93ab-7f9962867e06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa1bc0b3ee7c4963b61a699f35a41052'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:13.137383 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-5541214f-74e1-4252-93ab-7f9962867e06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa1bc0b3ee7c4963b61a699f35a41052'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:13.150379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-5541214f-74e1-4252-93ab-7f9962867e06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa1bc0b3ee7c4963b61a699f35a41052'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:13.163081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1046/2108] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:12 2022] DELETE /identity/v3/users/aa1bc0b3ee7c4963b61a699f35a41052 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:13.167510 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5776c-d51c-4770-a246-eeb611f56d3d None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:13.167796 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5776c-d51c-4770-a246-eeb611f56d3d None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:13.168068 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5776c-d51c-4770-a246-eeb611f56d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:13.173886 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:13.185568 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2246e-a2ef-45e0-84b4-824d807ae3f7 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:13.191905 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-65b5776c-d51c-4770-a246-eeb611f56d3d None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:13.193149 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-65b5776c-d51c-4770-a246-eeb611f56d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:13.233095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596ac2e-6eb5-4ce0-8944-95b7a3dc74fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:13.233835 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596ac2e-6eb5-4ce0-8944-95b7a3dc74fd service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:13.234147 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596ac2e-6eb5-4ce0-8944-95b7a3dc74fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:13.234417 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596ac2e-6eb5-4ce0-8944-95b7a3dc74fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:13.236309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3596ac2e-6eb5-4ce0-8944-95b7a3dc74fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:13.253117 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1047/2109] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:13.263482 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5776c-d51c-4770-a246-eeb611f56d3d None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:13.264916 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-65b5776c-d51c-4770-a246-eeb611f56d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:13.296886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596ac2e-6eb5-4ce0-8944-95b7a3dc74fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:13.298345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596ac2e-6eb5-4ce0-8944-95b7a3dc74fd service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:13.307963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1063/2110] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:00:13.323263 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5776c-d51c-4770-a246-eeb611f56d3d None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:13.327364 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fc09d-6e15-4baf-85ba-3c60d99b2d56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:13.328064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fc09d-6e15-4baf-85ba-3c60d99b2d56 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:13.328371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fc09d-6e15-4baf-85ba-3c60d99b2d56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:13.328649 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fc09d-6e15-4baf-85ba-3c60d99b2d56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:13.337941 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fc09d-6e15-4baf-85ba-3c60d99b2d56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:13.339386 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fc09d-6e15-4baf-85ba-3c60d99b2d56 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:13.349040 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1048/2111] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:00:13.396906 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:13.780785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596ac2e-6eb5-4ce0-8944-95b7a3dc74fd service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:13.782269 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3596ac2e-6eb5-4ce0-8944-95b7a3dc74fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:13.798575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596ac2e-6eb5-4ce0-8944-95b7a3dc74fd service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:13.803804 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fec7d3-ce9f-4ee0-ad0d-2da2973e0198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:13.804746 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fec7d3-ce9f-4ee0-ad0d-2da2973e0198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:13.805066 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fec7d3-ce9f-4ee0-ad0d-2da2973e0198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:13.805363 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fec7d3-ce9f-4ee0-ad0d-2da2973e0198 admin admin] PATH_INFO: `/v3/projects/758e7e6253194fc08cb019db02e3f4a0` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:13.806556 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fec7d3-ce9f-4ee0-ad0d-2da2973e0198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=758e7e6253194fc08cb019db02e3f4a0)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:13.809042 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fec7d3-ce9f-4ee0-ad0d-2da2973e0198 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:13.966728 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-72fec7d3-ce9f-4ee0-ad0d-2da2973e0198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758e7e6253194fc08cb019db02e3f4a0', 'request_id': 'req-72fec7d3-ce9f-4ee0-ad0d-2da2973e0198'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:14.042472 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-72fec7d3-ce9f-4ee0-ad0d-2da2973e0198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758e7e6253194fc08cb019db02e3f4a0', 'request_id': 'req-72fec7d3-ce9f-4ee0-ad0d-2da2973e0198'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:14.049482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-72fec7d3-ce9f-4ee0-ad0d-2da2973e0198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758e7e6253194fc08cb019db02e3f4a0', 'request_id': 'req-72fec7d3-ce9f-4ee0-ad0d-2da2973e0198'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:14.059811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-72fec7d3-ce9f-4ee0-ad0d-2da2973e0198 admin admin] The token cache is being invalidate because project 758e7e6253194fc08cb019db02e3f4a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:14.060097 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-72fec7d3-ce9f-4ee0-ad0d-2da2973e0198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:14.060748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-72fec7d3-ce9f-4ee0-ad0d-2da2973e0198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:14.062281 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1064/2112] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:13 2022] DELETE /identity/v3/projects/758e7e6253194fc08cb019db02e3f4a0 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:14.066227 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fc09d-6e15-4baf-85ba-3c60d99b2d56 service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:14.076716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fc09d-6e15-4baf-85ba-3c60d99b2d56 service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:14.133036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a168a5b-f62e-4c5a-8d0a-9c19a155a79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:14.133915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a168a5b-f62e-4c5a-8d0a-9c19a155a79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:14.134198 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a168a5b-f62e-4c5a-8d0a-9c19a155a79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:14.134469 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a168a5b-f62e-4c5a-8d0a-9c19a155a79f admin admin] PATH_INFO: `/v3/users/746cafe1473d47ae9cf5760ce2c41377` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:14.135681 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a168a5b-f62e-4c5a-8d0a-9c19a155a79f admin admin] RBAC: Authorizing `identity:delete_user(user_id=746cafe1473d47ae9cf5760ce2c41377)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:14.137615 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a168a5b-f62e-4c5a-8d0a-9c19a155a79f admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:14.333557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-7a168a5b-f62e-4c5a-8d0a-9c19a155a79f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '746cafe1473d47ae9cf5760ce2c41377'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:14.334204 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-7a168a5b-f62e-4c5a-8d0a-9c19a155a79f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '746cafe1473d47ae9cf5760ce2c41377'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:14.335910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:14.441456 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-7a168a5b-f62e-4c5a-8d0a-9c19a155a79f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '746cafe1473d47ae9cf5760ce2c41377'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:14.442166 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-7a168a5b-f62e-4c5a-8d0a-9c19a155a79f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '746cafe1473d47ae9cf5760ce2c41377'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:14.455235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-7a168a5b-f62e-4c5a-8d0a-9c19a155a79f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '746cafe1473d47ae9cf5760ce2c41377'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:14.476929 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1049/2113] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:14 2022] DELETE /identity/v3/users/746cafe1473d47ae9cf5760ce2c41377 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:14.892935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fec7d3-ce9f-4ee0-ad0d-2da2973e0198 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:14.894373 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-72fec7d3-ce9f-4ee0-ad0d-2da2973e0198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:14.907621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fec7d3-ce9f-4ee0-ad0d-2da2973e0198 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:14.940362 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:14.967351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242c0ba-3df7-4e0f-a13b-bf816164e9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:14.968372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242c0ba-3df7-4e0f-a13b-bf816164e9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:14.968661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242c0ba-3df7-4e0f-a13b-bf816164e9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:14.968954 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242c0ba-3df7-4e0f-a13b-bf816164e9a9 admin admin] PATH_INFO: `/v3/projects/97b3662fafe8447da389fb410f934e98` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:14.970205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242c0ba-3df7-4e0f-a13b-bf816164e9a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b3662fafe8447da389fb410f934e98)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:14.972254 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242c0ba-3df7-4e0f-a13b-bf816164e9a9 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:15.071533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-b242c0ba-3df7-4e0f-a13b-bf816164e9a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b3662fafe8447da389fb410f934e98', 'request_id': 'req-b242c0ba-3df7-4e0f-a13b-bf816164e9a9'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:15.142328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-b242c0ba-3df7-4e0f-a13b-bf816164e9a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b3662fafe8447da389fb410f934e98', 'request_id': 'req-b242c0ba-3df7-4e0f-a13b-bf816164e9a9'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:15.149334 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-b242c0ba-3df7-4e0f-a13b-bf816164e9a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b3662fafe8447da389fb410f934e98', 'request_id': 'req-b242c0ba-3df7-4e0f-a13b-bf816164e9a9'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:15.160822 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-b242c0ba-3df7-4e0f-a13b-bf816164e9a9 admin admin] The token cache is being invalidate because project 97b3662fafe8447da389fb410f934e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:15.161116 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-b242c0ba-3df7-4e0f-a13b-bf816164e9a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:15.161765 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-b242c0ba-3df7-4e0f-a13b-bf816164e9a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:15.165509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1065/2114] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:14 2022] DELETE /identity/v3/projects/97b3662fafe8447da389fb410f934e98 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:15.169521 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2af5d-c966-4de4-88f6-4bae6237f9f2 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:15.169993 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2af5d-c966-4de4-88f6-4bae6237f9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:15.170099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2af5d-c966-4de4-88f6-4bae6237f9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:15.187695 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-a1a2af5d-c966-4de4-88f6-4bae6237f9f2 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:15.188935 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-a1a2af5d-c966-4de4-88f6-4bae6237f9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:15.248309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1050/2115] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:15.256343 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aafef6-e8cc-4baf-b6d2-e89052ff79a7 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:15.256646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aafef6-e8cc-4baf-b6d2-e89052ff79a7 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:15.256935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aafef6-e8cc-4baf-b6d2-e89052ff79a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:15.277283 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-27aafef6-e8cc-4baf-b6d2-e89052ff79a7 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:15.278477 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-27aafef6-e8cc-4baf-b6d2-e89052ff79a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:15.286820 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1066/2116] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:15.291150 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2af5d-c966-4de4-88f6-4bae6237f9f2 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:15.301119 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2af5d-c966-4de4-88f6-4bae6237f9f2 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:15.305721 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c377ef-3bf9-408e-b8bb-97b9648f182a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:15.306371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c377ef-3bf9-408e-b8bb-97b9648f182a admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:15.306697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c377ef-3bf9-408e-b8bb-97b9648f182a admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:15.306979 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c377ef-3bf9-408e-b8bb-97b9648f182a admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:15.307715 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c377ef-3bf9-408e-b8bb-97b9648f182a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:00:15.308024 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c377ef-3bf9-408e-b8bb-97b9648f182a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:15.309645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c377ef-3bf9-408e-b8bb-97b9648f182a admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:15.322689 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1051/2117] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 17:00:15.327182 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aafef6-e8cc-4baf-b6d2-e89052ff79a7 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:15.339148 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aafef6-e8cc-4baf-b6d2-e89052ff79a7 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:15.343845 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cac8c6-e2c1-4aef-b6f6-1cd42b2665d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:15.344531 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cac8c6-e2c1-4aef-b6f6-1cd42b2665d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:15.344824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cac8c6-e2c1-4aef-b6f6-1cd42b2665d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:15.345106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cac8c6-e2c1-4aef-b6f6-1cd42b2665d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:15.345816 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cac8c6-e2c1-4aef-b6f6-1cd42b2665d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:15.347862 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cac8c6-e2c1-4aef-b6f6-1cd42b2665d8 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:15.426114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1067/2118] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:15 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:15.435738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c377ef-3bf9-408e-b8bb-97b9648f182a admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:15.445871 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c377ef-3bf9-408e-b8bb-97b9648f182a admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:15.503780 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6dc859-afdf-4bc2-adfc-e684af020873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:15.504485 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dc859-afdf-4bc2-adfc-e684af020873 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:15.504773 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dc859-afdf-4bc2-adfc-e684af020873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:15.505051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dc859-afdf-4bc2-adfc-e684af020873 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:15.505759 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6dc859-afdf-4bc2-adfc-e684af020873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:15.507809 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6dc859-afdf-4bc2-adfc-e684af020873 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:15.616225 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1052/2119] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:15 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:00:15.620728 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cac8c6-e2c1-4aef-b6f6-1cd42b2665d8 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:15.631675 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cac8c6-e2c1-4aef-b6f6-1cd42b2665d8 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:15.636878 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820af65c-7703-4e94-8f59-150996915241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:15.637627 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820af65c-7703-4e94-8f59-150996915241 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:15.637915 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820af65c-7703-4e94-8f59-150996915241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:15.638196 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820af65c-7703-4e94-8f59-150996915241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:15.638938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820af65c-7703-4e94-8f59-150996915241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:15.640591 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820af65c-7703-4e94-8f59-150996915241 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:15.651000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1068/2120] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:15.655253 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6dc859-afdf-4bc2-adfc-e684af020873 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:15.664918 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6dc859-afdf-4bc2-adfc-e684af020873 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:15.669437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd838d-52da-4768-99c2-02361c15836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:15.670078 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd838d-52da-4768-99c2-02361c15836e admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:15.670378 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd838d-52da-4768-99c2-02361c15836e admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:15.670644 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd838d-52da-4768-99c2-02361c15836e admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:15.671367 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd838d-52da-4768-99c2-02361c15836e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:15.672982 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd838d-52da-4768-99c2-02361c15836e admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:15.683161 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1053/2121] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:15.687093 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820af65c-7703-4e94-8f59-150996915241 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:15.701996 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820af65c-7703-4e94-8f59-150996915241 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:15.706558 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c35c1-0852-452e-82c3-56f3f42d4566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:15.707434 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c35c1-0852-452e-82c3-56f3f42d4566 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:15.707715 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c35c1-0852-452e-82c3-56f3f42d4566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:15.707990 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c35c1-0852-452e-82c3-56f3f42d4566 admin admin] PATH_INFO: `/v3/projects/104e58fc342e464891050799b1564872/users/825b121539554c35a5af5bc2ef00394f/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:15.722166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c35c1-0852-452e-82c3-56f3f42d4566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=104e58fc342e464891050799b1564872, user_id=825b121539554c35a5af5bc2ef00394f, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:15.724880 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c35c1-0852-452e-82c3-56f3f42d4566 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:15.881420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1069/2122] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:15 2022] PUT /identity/v3/projects/104e58fc342e464891050799b1564872/users/825b121539554c35a5af5bc2ef00394f/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:15.897645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8048f9f-a73c-4027-a253-c186b17c6997 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:15.897939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8048f9f-a73c-4027-a253-c186b17c6997 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:15.898219 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8048f9f-a73c-4027-a253-c186b17c6997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:15.924504 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-b8048f9f-a73c-4027-a253-c186b17c6997 None None] MFA Rules not processed for user `825b121539554c35a5af5bc2ef00394f`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:15.925754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b8048f9f-a73c-4027-a253-c186b17c6997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:15.944392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:15.989369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1054/2123] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:16.000581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c35c1-0852-452e-82c3-56f3f42d4566 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:16.002422 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-0b2c35c1-0852-452e-82c3-56f3f42d4566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:16.070893 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c35c1-0852-452e-82c3-56f3f42d4566 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:16.074534 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae770c8-976c-4c2d-9967-b24aa5f2dc77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:16.075180 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae770c8-976c-4c2d-9967-b24aa5f2dc77 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:16.075563 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae770c8-976c-4c2d-9967-b24aa5f2dc77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:16.075852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae770c8-976c-4c2d-9967-b24aa5f2dc77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:16.084326 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae770c8-976c-4c2d-9967-b24aa5f2dc77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:16.085762 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae770c8-976c-4c2d-9967-b24aa5f2dc77 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:16.095027 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1070/2124] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:00:20.458697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8048f9f-a73c-4027-a253-c186b17c6997 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:20.468696 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8048f9f-a73c-4027-a253-c186b17c6997 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:20.472469 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3e0af-4e9b-4779-bcc6-f7121976abc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:20.473205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3e0af-4e9b-4779-bcc6-f7121976abc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:20.473550 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3e0af-4e9b-4779-bcc6-f7121976abc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:20.473839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3e0af-4e9b-4779-bcc6-f7121976abc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:20.475736 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-fdd3e0af-4e9b-4779-bcc6-f7121976abc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:20.535021 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3e0af-4e9b-4779-bcc6-f7121976abc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:20.536495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3e0af-4e9b-4779-bcc6-f7121976abc2 service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:20.546080 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1055/2125] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:00:22.821143 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae770c8-976c-4c2d-9967-b24aa5f2dc77 service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:22.822684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-1ae770c8-976c-4c2d-9967-b24aa5f2dc77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:22.835668 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae770c8-976c-4c2d-9967-b24aa5f2dc77 service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:22.836667 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:22.839997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d7525-0407-4d56-bbfd-48316b0bbe14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:22.840740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d7525-0407-4d56-bbfd-48316b0bbe14 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:22.841073 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d7525-0407-4d56-bbfd-48316b0bbe14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:22.841352 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d7525-0407-4d56-bbfd-48316b0bbe14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:22.847511 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3d2d7525-0407-4d56-bbfd-48316b0bbe14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:22.910422 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d7525-0407-4d56-bbfd-48316b0bbe14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:22.911892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d7525-0407-4d56-bbfd-48316b0bbe14 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:22.923359 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1071/2126] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:00:24.157531 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be169f46-da54-4f11-83f9-30310c73c0e3 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:24.158001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be169f46-da54-4f11-83f9-30310c73c0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:24.158221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be169f46-da54-4f11-83f9-30310c73c0e3 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:24.159715 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1056/2127] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 17:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 17:00:24.170465 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d03fb8-da4a-4e26-96ef-2a5eacdcc397 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:24.171238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d03fb8-da4a-4e26-96ef-2a5eacdcc397 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:24.171785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d03fb8-da4a-4e26-96ef-2a5eacdcc397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:24.189214 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-66d03fb8-da4a-4e26-96ef-2a5eacdcc397 None None] MFA Rules not processed for user `5a79a71fa89446c3abbb4fdbf2c93aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:24.190442 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-66d03fb8-da4a-4e26-96ef-2a5eacdcc397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:24.257103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1072/2128] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 17:00:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:24.268554 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be169f46-da54-4f11-83f9-30310c73c0e3 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:24.270315 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-be169f46-da54-4f11-83f9-30310c73c0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:24.302947 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d03fb8-da4a-4e26-96ef-2a5eacdcc397 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:24.304373 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be169f46-da54-4f11-83f9-30310c73c0e3 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:24.305927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-66d03fb8-da4a-4e26-96ef-2a5eacdcc397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:24.318825 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b895eb-3a9f-4d78-8ff9-437bb99db758 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79a71fa89446c3abbb4fdbf2c93aac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:24.320716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b895eb-3a9f-4d78-8ff9-437bb99db758 service placement] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:24.321333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b895eb-3a9f-4d78-8ff9-437bb99db758 service placement] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:24.321823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b895eb-3a9f-4d78-8ff9-437bb99db758 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:24.335522 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b895eb-3a9f-4d78-8ff9-437bb99db758 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:24.338528 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b895eb-3a9f-4d78-8ff9-437bb99db758 service placement] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:24.352184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1057/2129] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:00:24.409825 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d03fb8-da4a-4e26-96ef-2a5eacdcc397 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:24.415005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff713663-bd43-4f4d-8742-0cf66410fdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:24.416058 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff713663-bd43-4f4d-8742-0cf66410fdc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:24.416378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff713663-bd43-4f4d-8742-0cf66410fdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:24.416664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff713663-bd43-4f4d-8742-0cf66410fdc4 admin admin] PATH_INFO: `/v3/users/38bf6bb46b3b406fb4e9d19ce2af32e4` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:24.417910 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff713663-bd43-4f4d-8742-0cf66410fdc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38bf6bb46b3b406fb4e9d19ce2af32e4)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:24.419903 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff713663-bd43-4f4d-8742-0cf66410fdc4 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:24.600252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:24.608971 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ff713663-bd43-4f4d-8742-0cf66410fdc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38bf6bb46b3b406fb4e9d19ce2af32e4'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:24.615751 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ff713663-bd43-4f4d-8742-0cf66410fdc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38bf6bb46b3b406fb4e9d19ce2af32e4'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:24.616316 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ff713663-bd43-4f4d-8742-0cf66410fdc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38bf6bb46b3b406fb4e9d19ce2af32e4'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:24.628695 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ff713663-bd43-4f4d-8742-0cf66410fdc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38bf6bb46b3b406fb4e9d19ce2af32e4'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:24.629350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ff713663-bd43-4f4d-8742-0cf66410fdc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38bf6bb46b3b406fb4e9d19ce2af32e4'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:24.686347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1073/2130] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:24 2022] DELETE /identity/v3/users/38bf6bb46b3b406fb4e9d19ce2af32e4 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:00:24.943627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b895eb-3a9f-4d78-8ff9-437bb99db758 service placement] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:24.956072 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b895eb-3a9f-4d78-8ff9-437bb99db758 service placement] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:25.015687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a367323-c4b7-4ee7-8810-c2af20a8d89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:25.016578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a367323-c4b7-4ee7-8810-c2af20a8d89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:25.016858 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a367323-c4b7-4ee7-8810-c2af20a8d89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:25.017129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a367323-c4b7-4ee7-8810-c2af20a8d89a admin admin] PATH_INFO: `/v3/projects/33e40ecd191c45888263248c1764dc26` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:25.018332 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a367323-c4b7-4ee7-8810-c2af20a8d89a admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e40ecd191c45888263248c1764dc26)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:25.020348 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a367323-c4b7-4ee7-8810-c2af20a8d89a admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:25.161577 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:25.163235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3a367323-c4b7-4ee7-8810-c2af20a8d89a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e40ecd191c45888263248c1764dc26', 'request_id': 'req-3a367323-c4b7-4ee7-8810-c2af20a8d89a'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:25.238988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3a367323-c4b7-4ee7-8810-c2af20a8d89a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e40ecd191c45888263248c1764dc26', 'request_id': 'req-3a367323-c4b7-4ee7-8810-c2af20a8d89a'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:25.245081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3a367323-c4b7-4ee7-8810-c2af20a8d89a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e40ecd191c45888263248c1764dc26', 'request_id': 'req-3a367323-c4b7-4ee7-8810-c2af20a8d89a'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:25.257540 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3a367323-c4b7-4ee7-8810-c2af20a8d89a admin admin] The token cache is being invalidate because project 33e40ecd191c45888263248c1764dc26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:25.257852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3a367323-c4b7-4ee7-8810-c2af20a8d89a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:25.258468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3a367323-c4b7-4ee7-8810-c2af20a8d89a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:25.260016 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1058/2131] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:24 2022] DELETE /identity/v3/projects/33e40ecd191c45888263248c1764dc26 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:25.263887 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff713663-bd43-4f4d-8742-0cf66410fdc4 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:25.265349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-ff713663-bd43-4f4d-8742-0cf66410fdc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:25.279241 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff713663-bd43-4f4d-8742-0cf66410fdc4 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:25.335394 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb0f9f-b01f-49b9-aaf2-512b969781bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:25.336289 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb0f9f-b01f-49b9-aaf2-512b969781bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:25.336581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb0f9f-b01f-49b9-aaf2-512b969781bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:25.336864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb0f9f-b01f-49b9-aaf2-512b969781bb admin admin] PATH_INFO: `/v3/users/b08fc853a4e547b7a0d886e4a7aa4949` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:25.338066 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb0f9f-b01f-49b9-aaf2-512b969781bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08fc853a4e547b7a0d886e4a7aa4949)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:25.340587 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb0f9f-b01f-49b9-aaf2-512b969781bb admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:25.514477 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-75bb0f9f-b01f-49b9-aaf2-512b969781bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08fc853a4e547b7a0d886e4a7aa4949'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:25.521174 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-75bb0f9f-b01f-49b9-aaf2-512b969781bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08fc853a4e547b7a0d886e4a7aa4949'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:25.521852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-75bb0f9f-b01f-49b9-aaf2-512b969781bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08fc853a4e547b7a0d886e4a7aa4949'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:25.534427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-75bb0f9f-b01f-49b9-aaf2-512b969781bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08fc853a4e547b7a0d886e4a7aa4949'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:25.535065 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-75bb0f9f-b01f-49b9-aaf2-512b969781bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08fc853a4e547b7a0d886e4a7aa4949'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:25.633207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1074/2132] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:25 2022] DELETE /identity/v3/users/b08fc853a4e547b7a0d886e4a7aa4949 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:00:25.877192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a367323-c4b7-4ee7-8810-c2af20a8d89a admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:25.878603 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-3a367323-c4b7-4ee7-8810-c2af20a8d89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:25.894180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a367323-c4b7-4ee7-8810-c2af20a8d89a admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:25.961628 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b09abc-e07c-4ca9-a676-0598613023a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:25.962586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b09abc-e07c-4ca9-a676-0598613023a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:25.962870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b09abc-e07c-4ca9-a676-0598613023a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:25.963150 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b09abc-e07c-4ca9-a676-0598613023a1 admin admin] PATH_INFO: `/v3/projects/0e25e5d811364fe2a1abbbe41e1e9547` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:25.964587 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b09abc-e07c-4ca9-a676-0598613023a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e25e5d811364fe2a1abbbe41e1e9547)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:25.967351 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b09abc-e07c-4ca9-a676-0598613023a1 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:26.091240 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-94b09abc-e07c-4ca9-a676-0598613023a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e25e5d811364fe2a1abbbe41e1e9547', 'request_id': 'req-94b09abc-e07c-4ca9-a676-0598613023a1'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:26.170071 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-94b09abc-e07c-4ca9-a676-0598613023a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e25e5d811364fe2a1abbbe41e1e9547', 'request_id': 'req-94b09abc-e07c-4ca9-a676-0598613023a1'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:26.175976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-94b09abc-e07c-4ca9-a676-0598613023a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e25e5d811364fe2a1abbbe41e1e9547', 'request_id': 'req-94b09abc-e07c-4ca9-a676-0598613023a1'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:26.188013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-94b09abc-e07c-4ca9-a676-0598613023a1 admin admin] The token cache is being invalidate because project 0e25e5d811364fe2a1abbbe41e1e9547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:26.188320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-94b09abc-e07c-4ca9-a676-0598613023a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:26.188967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-94b09abc-e07c-4ca9-a676-0598613023a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:26.190490 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1059/2133] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:25 2022] DELETE /identity/v3/projects/0e25e5d811364fe2a1abbbe41e1e9547 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:26.195513 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596f65d-f412-4552-a074-bcdae1ca6ab9 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:26.195804 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596f65d-f412-4552-a074-bcdae1ca6ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:26.196085 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596f65d-f412-4552-a074-bcdae1ca6ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:26.214018 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-c596f65d-f412-4552-a074-bcdae1ca6ab9 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:26.215858 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c596f65d-f412-4552-a074-bcdae1ca6ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:26.244023 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:26.279384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1075/2134] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:26.287061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb0938-f2d9-4a54-a6a4-11b9df5e02d6 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:26.287544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb0938-f2d9-4a54-a6a4-11b9df5e02d6 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:26.287888 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb0938-f2d9-4a54-a6a4-11b9df5e02d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:26.309636 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-2cfb0938-f2d9-4a54-a6a4-11b9df5e02d6 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:26.311160 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-2cfb0938-f2d9-4a54-a6a4-11b9df5e02d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:26.320185 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1060/2135] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:26.327542 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596f65d-f412-4552-a074-bcdae1ca6ab9 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:26.337879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596f65d-f412-4552-a074-bcdae1ca6ab9 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:26.343514 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda62d5-4012-4faa-9d8c-8fa846c22516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:26.344241 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda62d5-4012-4faa-9d8c-8fa846c22516 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:26.344530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda62d5-4012-4faa-9d8c-8fa846c22516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:26.344809 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda62d5-4012-4faa-9d8c-8fa846c22516 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:26.345558 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda62d5-4012-4faa-9d8c-8fa846c22516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:00:26.346766 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda62d5-4012-4faa-9d8c-8fa846c22516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:26.347490 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda62d5-4012-4faa-9d8c-8fa846c22516 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:26.360391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1076/2136] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:00:26.365016 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb0938-f2d9-4a54-a6a4-11b9df5e02d6 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:26.374886 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb0938-f2d9-4a54-a6a4-11b9df5e02d6 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:26.379545 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515be27f-7029-4d4c-8a2b-f60cb2218f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:26.380357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515be27f-7029-4d4c-8a2b-f60cb2218f4c admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:26.380640 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515be27f-7029-4d4c-8a2b-f60cb2218f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:26.380912 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515be27f-7029-4d4c-8a2b-f60cb2218f4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:26.381623 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515be27f-7029-4d4c-8a2b-f60cb2218f4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:26.383685 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515be27f-7029-4d4c-8a2b-f60cb2218f4c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:26.477109 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1061/2137] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:26 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:00:26.481323 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda62d5-4012-4faa-9d8c-8fa846c22516 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:26.491624 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda62d5-4012-4faa-9d8c-8fa846c22516 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:26.547082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3b825-9e71-40bf-a5a2-768b5b586fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:26.547676 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3b825-9e71-40bf-a5a2-768b5b586fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:26.547965 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3b825-9e71-40bf-a5a2-768b5b586fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:26.548279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3b825-9e71-40bf-a5a2-768b5b586fd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:26.548991 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3b825-9e71-40bf-a5a2-768b5b586fd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:26.550914 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3b825-9e71-40bf-a5a2-768b5b586fd1 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:26.652733 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1077/2138] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:26 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:26.656881 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515be27f-7029-4d4c-8a2b-f60cb2218f4c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:26.667252 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515be27f-7029-4d4c-8a2b-f60cb2218f4c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:26.671912 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79172024-e085-4208-890d-523cbcd52756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:26.672618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79172024-e085-4208-890d-523cbcd52756 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:26.672885 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79172024-e085-4208-890d-523cbcd52756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:26.673165 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79172024-e085-4208-890d-523cbcd52756 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:26.673893 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79172024-e085-4208-890d-523cbcd52756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:26.675489 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79172024-e085-4208-890d-523cbcd52756 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:26.686304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1062/2139] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:00:26.690228 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3b825-9e71-40bf-a5a2-768b5b586fd1 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:26.700720 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3b825-9e71-40bf-a5a2-768b5b586fd1 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:26.705350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdd0f9-5228-425e-8ada-8012eeb2cb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:26.705989 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdd0f9-5228-425e-8ada-8012eeb2cb74 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:26.706272 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdd0f9-5228-425e-8ada-8012eeb2cb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:26.706551 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdd0f9-5228-425e-8ada-8012eeb2cb74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:26.707386 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdd0f9-5228-425e-8ada-8012eeb2cb74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:26.709016 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdd0f9-5228-425e-8ada-8012eeb2cb74 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:26.719304 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1078/2140] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:26.723333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79172024-e085-4208-890d-523cbcd52756 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:26.735874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79172024-e085-4208-890d-523cbcd52756 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:26.741719 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb5922-cd3f-4a3a-b28c-37b9f5a997a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:26.742619 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb5922-cd3f-4a3a-b28c-37b9f5a997a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:26.742904 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb5922-cd3f-4a3a-b28c-37b9f5a997a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:26.743185 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb5922-cd3f-4a3a-b28c-37b9f5a997a3 admin admin] PATH_INFO: `/v3/projects/a001e3dc0f254a94881fb5be215106b2/users/09bf47f5279a4020a9986f2591b97e7d/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:26.766422 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb5922-cd3f-4a3a-b28c-37b9f5a997a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a001e3dc0f254a94881fb5be215106b2, user_id=09bf47f5279a4020a9986f2591b97e7d, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:26.772188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb5922-cd3f-4a3a-b28c-37b9f5a997a3 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:26.865853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1063/2141] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:26 2022] PUT /identity/v3/projects/a001e3dc0f254a94881fb5be215106b2/users/09bf47f5279a4020a9986f2591b97e7d/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:26.875833 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35640f12-51e0-4797-9881-05641b6779ba None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:26.876729 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35640f12-51e0-4797-9881-05641b6779ba None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:26.876729 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35640f12-51e0-4797-9881-05641b6779ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:26.904150 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-35640f12-51e0-4797-9881-05641b6779ba None None] MFA Rules not processed for user `09bf47f5279a4020a9986f2591b97e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:26.905318 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-35640f12-51e0-4797-9881-05641b6779ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:26.971363 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1079/2142] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:26.975770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb5922-cd3f-4a3a-b28c-37b9f5a997a3 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:26.980459 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:27.038985 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb5922-cd3f-4a3a-b28c-37b9f5a997a3 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:27.044263 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2880a-b2b0-4bcd-96da-9f5fdb6f5cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:27.044920 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2880a-b2b0-4bcd-96da-9f5fdb6f5cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:27.045201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2880a-b2b0-4bcd-96da-9f5fdb6f5cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:27.045479 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2880a-b2b0-4bcd-96da-9f5fdb6f5cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:27.046193 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2880a-b2b0-4bcd-96da-9f5fdb6f5cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:27.048192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2880a-b2b0-4bcd-96da-9f5fdb6f5cd1 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:27.155419 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1064/2143] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:26 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:27.161106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35640f12-51e0-4797-9881-05641b6779ba None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:27.177516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35640f12-51e0-4797-9881-05641b6779ba None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:27.203959 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:27.237334 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc915c-f622-4aba-a11a-1fa43086c4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:27.238071 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc915c-f622-4aba-a11a-1fa43086c4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:27.238367 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc915c-f622-4aba-a11a-1fa43086c4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:27.238661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc915c-f622-4aba-a11a-1fa43086c4e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:27.239380 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc915c-f622-4aba-a11a-1fa43086c4e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:27.241484 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc915c-f622-4aba-a11a-1fa43086c4e1 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:27.482264 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1080/2144] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:27 2022] POST /identity/v3/users => generated 298 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:27.486203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2880a-b2b0-4bcd-96da-9f5fdb6f5cd1 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:27.496887 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2880a-b2b0-4bcd-96da-9f5fdb6f5cd1 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:27.501612 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b719f-343e-4542-a77e-8a792083a741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:27.507694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b719f-343e-4542-a77e-8a792083a741 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:27.507694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b719f-343e-4542-a77e-8a792083a741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:27.507694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b719f-343e-4542-a77e-8a792083a741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:27.507694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b719f-343e-4542-a77e-8a792083a741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:27.507694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b719f-343e-4542-a77e-8a792083a741 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:27.516492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1065/2145] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:27.520595 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc915c-f622-4aba-a11a-1fa43086c4e1 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:27.531310 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc915c-f622-4aba-a11a-1fa43086c4e1 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:27.535954 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f46bbb-c274-4c33-bf6b-43f4f710982b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:27.539666 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f46bbb-c274-4c33-bf6b-43f4f710982b admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:27.539666 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f46bbb-c274-4c33-bf6b-43f4f710982b admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:27.539666 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f46bbb-c274-4c33-bf6b-43f4f710982b admin admin] PATH_INFO: `/v3/projects/b4a6d325d480409e889a556d18915fad/users/bd514f11c3bb479f962b6ef6729a4bd1/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:27.552972 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f46bbb-c274-4c33-bf6b-43f4f710982b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4a6d325d480409e889a556d18915fad, user_id=bd514f11c3bb479f962b6ef6729a4bd1, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:27.555609 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f46bbb-c274-4c33-bf6b-43f4f710982b admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:27.662128 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1081/2146] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:27 2022] PUT /identity/v3/projects/b4a6d325d480409e889a556d18915fad/users/bd514f11c3bb479f962b6ef6729a4bd1/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:27.665989 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b719f-343e-4542-a77e-8a792083a741 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:27.675837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b719f-343e-4542-a77e-8a792083a741 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:27.731032 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae94d0-4917-4cce-9833-8c3f6f63fa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:27.731983 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae94d0-4917-4cce-9833-8c3f6f63fa3c admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:27.732304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae94d0-4917-4cce-9833-8c3f6f63fa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:27.732583 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae94d0-4917-4cce-9833-8c3f6f63fa3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:27.733313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae94d0-4917-4cce-9833-8c3f6f63fa3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:27.734920 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae94d0-4917-4cce-9833-8c3f6f63fa3c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:27.744693 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1066/2147] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:27.748836 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f46bbb-c274-4c33-bf6b-43f4f710982b admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:27.759116 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f46bbb-c274-4c33-bf6b-43f4f710982b admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:27.764167 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75def17a-9e52-4152-99a8-74c26541bee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:27.765026 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75def17a-9e52-4152-99a8-74c26541bee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:27.765307 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75def17a-9e52-4152-99a8-74c26541bee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:27.765581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75def17a-9e52-4152-99a8-74c26541bee1 admin admin] PATH_INFO: `/v3/projects/b4a6d325d480409e889a556d18915fad/users/bd514f11c3bb479f962b6ef6729a4bd1/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:27.767513 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75def17a-9e52-4152-99a8-74c26541bee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4a6d325d480409e889a556d18915fad, user_id=bd514f11c3bb479f962b6ef6729a4bd1, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:27.770216 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75def17a-9e52-4152-99a8-74c26541bee1 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:27.781373 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1082/2148] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:27 2022] PUT /identity/v3/projects/b4a6d325d480409e889a556d18915fad/users/bd514f11c3bb479f962b6ef6729a4bd1/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:27.795513 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10d93d-ecba-49ac-b27c-40265b902a4d None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:27.795805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10d93d-ecba-49ac-b27c-40265b902a4d None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:27.796086 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10d93d-ecba-49ac-b27c-40265b902a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:27.821480 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-1f10d93d-ecba-49ac-b27c-40265b902a4d None None] MFA Rules not processed for user `bd514f11c3bb479f962b6ef6729a4bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:27.822686 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-1f10d93d-ecba-49ac-b27c-40265b902a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:27.886013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:27.891543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1067/2149] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:27.902952 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75def17a-9e52-4152-99a8-74c26541bee1 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:27.905259 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-75def17a-9e52-4152-99a8-74c26541bee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:27.962012 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75def17a-9e52-4152-99a8-74c26541bee1 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:27.966657 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04014ab3-648c-4279-be0d-cc495140d613 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:27.967205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04014ab3-648c-4279-be0d-cc495140d613 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:27.967487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04014ab3-648c-4279-be0d-cc495140d613 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:27.967759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04014ab3-648c-4279-be0d-cc495140d613 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:28.043491 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04014ab3-648c-4279-be0d-cc495140d613 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:28.045038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04014ab3-648c-4279-be0d-cc495140d613 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:28.054533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1083/2150] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:00:35.323962 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10d93d-ecba-49ac-b27c-40265b902a4d None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:35.328658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-1f10d93d-ecba-49ac-b27c-40265b902a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:35.408567 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10d93d-ecba-49ac-b27c-40265b902a4d None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:35.413249 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949defc-7627-4310-83e4-a4daa4b01f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:35.414139 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949defc-7627-4310-83e4-a4daa4b01f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:35.414424 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949defc-7627-4310-83e4-a4daa4b01f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:35.414699 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949defc-7627-4310-83e4-a4daa4b01f25 admin admin] PATH_INFO: `/v3/users/825b121539554c35a5af5bc2ef00394f` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:35.415932 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949defc-7627-4310-83e4-a4daa4b01f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=825b121539554c35a5af5bc2ef00394f)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:35.417917 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949defc-7627-4310-83e4-a4daa4b01f25 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:35.641117 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3949defc-7627-4310-83e4-a4daa4b01f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '825b121539554c35a5af5bc2ef00394f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:35.641956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3949defc-7627-4310-83e4-a4daa4b01f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '825b121539554c35a5af5bc2ef00394f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:35.750085 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3949defc-7627-4310-83e4-a4daa4b01f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '825b121539554c35a5af5bc2ef00394f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:35.751701 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3949defc-7627-4310-83e4-a4daa4b01f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '825b121539554c35a5af5bc2ef00394f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:35.766483 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3949defc-7627-4310-83e4-a4daa4b01f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '825b121539554c35a5af5bc2ef00394f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:35.779380 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1068/2151] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:35 2022] DELETE /identity/v3/users/825b121539554c35a5af5bc2ef00394f => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:35.783935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e512f00-d64c-4a30-8aa9-5a83a79a7c6f None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:35.784412 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e512f00-d64c-4a30-8aa9-5a83a79a7c6f None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:35.784668 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e512f00-d64c-4a30-8aa9-5a83a79a7c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:35.802040 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-2e512f00-d64c-4a30-8aa9-5a83a79a7c6f None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:35.805268 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2e512f00-d64c-4a30-8aa9-5a83a79a7c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:35.833864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:35.862374 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1084/2152] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:35.872637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949defc-7627-4310-83e4-a4daa4b01f25 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:35.874046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-3949defc-7627-4310-83e4-a4daa4b01f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:35.932739 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949defc-7627-4310-83e4-a4daa4b01f25 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:35.937507 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bc654-9b9e-4197-8b51-9ddfe2e3237e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:35.938149 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bc654-9b9e-4197-8b51-9ddfe2e3237e service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:35.938432 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bc654-9b9e-4197-8b51-9ddfe2e3237e service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:35.938709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bc654-9b9e-4197-8b51-9ddfe2e3237e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:35.947813 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191bc654-9b9e-4197-8b51-9ddfe2e3237e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:35.949277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191bc654-9b9e-4197-8b51-9ddfe2e3237e service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:35.958973 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1069/2153] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:00:36.625410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e512f00-d64c-4a30-8aa9-5a83a79a7c6f None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:36.627012 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2e512f00-d64c-4a30-8aa9-5a83a79a7c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:36.643908 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e512f00-d64c-4a30-8aa9-5a83a79a7c6f None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:36.648766 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354aae4-3c54-4dd2-8068-460c48cc254d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:36.654100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354aae4-3c54-4dd2-8068-460c48cc254d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:36.654100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354aae4-3c54-4dd2-8068-460c48cc254d admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:36.654100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354aae4-3c54-4dd2-8068-460c48cc254d admin admin] PATH_INFO: `/v3/projects/104e58fc342e464891050799b1564872` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:36.654100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354aae4-3c54-4dd2-8068-460c48cc254d admin admin] RBAC: Authorizing `identity:delete_project(project_id=104e58fc342e464891050799b1564872)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:36.654573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354aae4-3c54-4dd2-8068-460c48cc254d admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:36.851390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d354aae4-3c54-4dd2-8068-460c48cc254d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '104e58fc342e464891050799b1564872', 'request_id': 'req-d354aae4-3c54-4dd2-8068-460c48cc254d'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:36.940042 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d354aae4-3c54-4dd2-8068-460c48cc254d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '104e58fc342e464891050799b1564872', 'request_id': 'req-d354aae4-3c54-4dd2-8068-460c48cc254d'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:36.947121 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d354aae4-3c54-4dd2-8068-460c48cc254d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '104e58fc342e464891050799b1564872', 'request_id': 'req-d354aae4-3c54-4dd2-8068-460c48cc254d'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:36.964992 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d354aae4-3c54-4dd2-8068-460c48cc254d admin admin] The token cache is being invalidate because project 104e58fc342e464891050799b1564872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:36.965313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d354aae4-3c54-4dd2-8068-460c48cc254d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:36.966547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d354aae4-3c54-4dd2-8068-460c48cc254d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:36.968095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1085/2154] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:36 2022] DELETE /identity/v3/projects/104e58fc342e464891050799b1564872 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:38.189600 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bc654-9b9e-4197-8b51-9ddfe2e3237e service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:38.191120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-191bc654-9b9e-4197-8b51-9ddfe2e3237e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:38.207035 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bc654-9b9e-4197-8b51-9ddfe2e3237e service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:38.225453 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:38.265201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1d59c-cac8-4840-ba0a-f6fec7a4e1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:38.266117 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1d59c-cac8-4840-ba0a-f6fec7a4e1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:38.266404 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1d59c-cac8-4840-ba0a-f6fec7a4e1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:38.266684 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1d59c-cac8-4840-ba0a-f6fec7a4e1b3 admin admin] PATH_INFO: `/v3/users/40f071637428488e81f2343719f7963a` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:38.267879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1d59c-cac8-4840-ba0a-f6fec7a4e1b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f071637428488e81f2343719f7963a)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:38.269848 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1d59c-cac8-4840-ba0a-f6fec7a4e1b3 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:38.556997 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-d1c1d59c-cac8-4840-ba0a-f6fec7a4e1b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f071637428488e81f2343719f7963a'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:38.557663 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-d1c1d59c-cac8-4840-ba0a-f6fec7a4e1b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f071637428488e81f2343719f7963a'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:38.623730 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-d1c1d59c-cac8-4840-ba0a-f6fec7a4e1b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f071637428488e81f2343719f7963a'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:38.624748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-d1c1d59c-cac8-4840-ba0a-f6fec7a4e1b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f071637428488e81f2343719f7963a'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:38.645978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-d1c1d59c-cac8-4840-ba0a-f6fec7a4e1b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f071637428488e81f2343719f7963a'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:38.659889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1070/2155] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:38 2022] DELETE /identity/v3/users/40f071637428488e81f2343719f7963a => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:38.665152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24f826-11f4-437c-91f9-380abe45f6c0 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:38.665783 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24f826-11f4-437c-91f9-380abe45f6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:38.666148 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24f826-11f4-437c-91f9-380abe45f6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:38.685287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-5d24f826-11f4-437c-91f9-380abe45f6c0 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:38.686521 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-5d24f826-11f4-437c-91f9-380abe45f6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:38.745674 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1086/2156] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:38.755703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1d59c-cac8-4840-ba0a-f6fec7a4e1b3 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:38.757220 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-d1c1d59c-cac8-4840-ba0a-f6fec7a4e1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:38.819096 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1d59c-cac8-4840-ba0a-f6fec7a4e1b3 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:38.822863 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40917f-0420-4198-a4e9-007dcc185c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:38.823509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40917f-0420-4198-a4e9-007dcc185c35 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:38.823797 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40917f-0420-4198-a4e9-007dcc185c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:38.824076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40917f-0420-4198-a4e9-007dcc185c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:38.834367 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40917f-0420-4198-a4e9-007dcc185c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:38.835967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40917f-0420-4198-a4e9-007dcc185c35 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:38.845978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1071/2157] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:00:39.334739 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24f826-11f4-437c-91f9-380abe45f6c0 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:39.336492 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-5d24f826-11f4-437c-91f9-380abe45f6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:39.350469 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24f826-11f4-437c-91f9-380abe45f6c0 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:39.355637 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad348c-9d0b-45a3-ab66-6340eb018e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:39.357155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad348c-9d0b-45a3-ab66-6340eb018e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:39.357436 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad348c-9d0b-45a3-ab66-6340eb018e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:39.358184 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad348c-9d0b-45a3-ab66-6340eb018e6f admin admin] PATH_INFO: `/v3/projects/3f421ea852dd45819e64fb070a612739` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:39.359499 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad348c-9d0b-45a3-ab66-6340eb018e6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f421ea852dd45819e64fb070a612739)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:39.365862 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad348c-9d0b-45a3-ab66-6340eb018e6f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:39.511671 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-93ad348c-9d0b-45a3-ab66-6340eb018e6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f421ea852dd45819e64fb070a612739', 'request_id': 'req-93ad348c-9d0b-45a3-ab66-6340eb018e6f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:39.516288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:39.607588 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-93ad348c-9d0b-45a3-ab66-6340eb018e6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f421ea852dd45819e64fb070a612739', 'request_id': 'req-93ad348c-9d0b-45a3-ab66-6340eb018e6f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:39.614799 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-93ad348c-9d0b-45a3-ab66-6340eb018e6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f421ea852dd45819e64fb070a612739', 'request_id': 'req-93ad348c-9d0b-45a3-ab66-6340eb018e6f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:39.625660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-93ad348c-9d0b-45a3-ab66-6340eb018e6f admin admin] The token cache is being invalidate because project 3f421ea852dd45819e64fb070a612739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:39.625978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-93ad348c-9d0b-45a3-ab66-6340eb018e6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:39.626628 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-93ad348c-9d0b-45a3-ab66-6340eb018e6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:39.628254 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1087/2158] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:39 2022] DELETE /identity/v3/projects/3f421ea852dd45819e64fb070a612739 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:39.632249 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40917f-0420-4198-a4e9-007dcc185c35 service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:39.642512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40917f-0420-4198-a4e9-007dcc185c35 service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:39.689160 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:39.712796 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5c616-d3e5-4553-b60e-6751b5e1cda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:39.713827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5c616-d3e5-4553-b60e-6751b5e1cda1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:39.714239 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5c616-d3e5-4553-b60e-6751b5e1cda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:39.715083 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5c616-d3e5-4553-b60e-6751b5e1cda1 admin admin] PATH_INFO: `/v3/users/c8e7ba62ab5c4c438d0bdaa7e6f06345` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:39.717785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5c616-d3e5-4553-b60e-6751b5e1cda1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8e7ba62ab5c4c438d0bdaa7e6f06345)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:39.720515 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5c616-d3e5-4553-b60e-6751b5e1cda1 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:39.928179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-79a5c616-d3e5-4553-b60e-6751b5e1cda1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8e7ba62ab5c4c438d0bdaa7e6f06345'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:39.928832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-79a5c616-d3e5-4553-b60e-6751b5e1cda1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8e7ba62ab5c4c438d0bdaa7e6f06345'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:40.035155 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-79a5c616-d3e5-4553-b60e-6751b5e1cda1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8e7ba62ab5c4c438d0bdaa7e6f06345'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:40.035790 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-79a5c616-d3e5-4553-b60e-6751b5e1cda1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8e7ba62ab5c4c438d0bdaa7e6f06345'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:40.054878 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-79a5c616-d3e5-4553-b60e-6751b5e1cda1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8e7ba62ab5c4c438d0bdaa7e6f06345'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:40.077068 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1072/2159] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:39 2022] DELETE /identity/v3/users/c8e7ba62ab5c4c438d0bdaa7e6f06345 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:41.115681 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad348c-9d0b-45a3-ab66-6340eb018e6f admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:41.117649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-93ad348c-9d0b-45a3-ab66-6340eb018e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:41.134746 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad348c-9d0b-45a3-ab66-6340eb018e6f admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:41.191715 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5c616-d3e5-4553-b60e-6751b5e1cda1 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:41.193775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-79a5c616-d3e5-4553-b60e-6751b5e1cda1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:41.219560 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d44c6-d618-4680-90aa-280d40e4dd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:41.220246 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d44c6-d618-4680-90aa-280d40e4dd87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:41.220535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d44c6-d618-4680-90aa-280d40e4dd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:41.220817 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d44c6-d618-4680-90aa-280d40e4dd87 admin admin] PATH_INFO: `/v3/projects/b956e081c24c41199ec35469542aeeff` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:41.222225 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d44c6-d618-4680-90aa-280d40e4dd87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b956e081c24c41199ec35469542aeeff)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:41.224438 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d44c6-d618-4680-90aa-280d40e4dd87 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:41.282959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5c616-d3e5-4553-b60e-6751b5e1cda1 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:41.288376 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9370a-dac4-4d8b-983a-7f4a63160c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:41.289430 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9370a-dac4-4d8b-983a-7f4a63160c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:41.289957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9370a-dac4-4d8b-983a-7f4a63160c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:41.290187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9370a-dac4-4d8b-983a-7f4a63160c21 admin admin] PATH_INFO: `/v3/users/660e364dc474422f832d2a1b3ee079c9` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:41.291551 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9370a-dac4-4d8b-983a-7f4a63160c21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=660e364dc474422f832d2a1b3ee079c9)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:41.293655 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9370a-dac4-4d8b-983a-7f4a63160c21 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:41.577219 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f4d9370a-dac4-4d8b-983a-7f4a63160c21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '660e364dc474422f832d2a1b3ee079c9'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:41.577906 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f4d9370a-dac4-4d8b-983a-7f4a63160c21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '660e364dc474422f832d2a1b3ee079c9'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:41.580021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-058d44c6-d618-4680-90aa-280d40e4dd87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b956e081c24c41199ec35469542aeeff', 'request_id': 'req-058d44c6-d618-4680-90aa-280d40e4dd87'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:41.704465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f4d9370a-dac4-4d8b-983a-7f4a63160c21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '660e364dc474422f832d2a1b3ee079c9'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:41.705144 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f4d9370a-dac4-4d8b-983a-7f4a63160c21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '660e364dc474422f832d2a1b3ee079c9'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:41.712931 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:41.718525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f4d9370a-dac4-4d8b-983a-7f4a63160c21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '660e364dc474422f832d2a1b3ee079c9'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:41.731004 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1073/2160] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:41 2022] DELETE /identity/v3/users/660e364dc474422f832d2a1b3ee079c9 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:00:41.731842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9370a-dac4-4d8b-983a-7f4a63160c21 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:41.733226 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-f4d9370a-dac4-4d8b-983a-7f4a63160c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:41.758335 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-058d44c6-d618-4680-90aa-280d40e4dd87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b956e081c24c41199ec35469542aeeff', 'request_id': 'req-058d44c6-d618-4680-90aa-280d40e4dd87'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:41.766282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-058d44c6-d618-4680-90aa-280d40e4dd87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b956e081c24c41199ec35469542aeeff', 'request_id': 'req-058d44c6-d618-4680-90aa-280d40e4dd87'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:41.778192 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-058d44c6-d618-4680-90aa-280d40e4dd87 admin admin] The token cache is being invalidate because project b956e081c24c41199ec35469542aeeff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:41.778745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-058d44c6-d618-4680-90aa-280d40e4dd87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:41.779498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-058d44c6-d618-4680-90aa-280d40e4dd87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:41.784409 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1088/2161] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:41 2022] DELETE /identity/v3/projects/b956e081c24c41199ec35469542aeeff => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:41.784409 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d44c6-d618-4680-90aa-280d40e4dd87 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:41.784409 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-058d44c6-d618-4680-90aa-280d40e4dd87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:41.811015 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9370a-dac4-4d8b-983a-7f4a63160c21 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:41.816941 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007be6f-e067-40ca-9fe1-67f689b42d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:41.817830 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007be6f-e067-40ca-9fe1-67f689b42d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:41.818424 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007be6f-e067-40ca-9fe1-67f689b42d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:41.818424 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007be6f-e067-40ca-9fe1-67f689b42d9a admin admin] PATH_INFO: `/v3/users/5640de18fda644ee92c83852b53ef7da` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:41.819678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007be6f-e067-40ca-9fe1-67f689b42d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5640de18fda644ee92c83852b53ef7da)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:41.821653 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007be6f-e067-40ca-9fe1-67f689b42d9a admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:41.846239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d44c6-d618-4680-90aa-280d40e4dd87 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:41.872419 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:41.903817 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4784ab-1afb-4ac2-b264-a73f4ce95fd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:41.904507 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4784ab-1afb-4ac2-b264-a73f4ce95fd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:41.909860 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4784ab-1afb-4ac2-b264-a73f4ce95fd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:41.909860 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4784ab-1afb-4ac2-b264-a73f4ce95fd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:41.909860 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-ff4784ab-1afb-4ac2-b264-a73f4ce95fd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:41.995496 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4784ab-1afb-4ac2-b264-a73f4ce95fd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:42.000379 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4784ab-1afb-4ac2-b264-a73f4ce95fd4 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:42.018785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1089/2162] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:00:42.020634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7b80a-0088-462f-b02a-86b9f7b3f318 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:42.021094 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7b80a-0088-462f-b02a-86b9f7b3f318 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:42.021576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b7b80a-0088-462f-b02a-86b9f7b3f318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:42.082978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6007be6f-e067-40ca-9fe1-67f689b42d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5640de18fda644ee92c83852b53ef7da'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:42.085435 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-a3b7b80a-0088-462f-b02a-86b9f7b3f318 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:42.086775 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-a3b7b80a-0088-462f-b02a-86b9f7b3f318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:42.089412 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6007be6f-e067-40ca-9fe1-67f689b42d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5640de18fda644ee92c83852b53ef7da'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:42.098502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1090/2163] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:42.101647 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ef51f-5cca-483f-9f72-ee0ad875bcd4 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:42.102271 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ef51f-5cca-483f-9f72-ee0ad875bcd4 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:42.104997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ef51f-5cca-483f-9f72-ee0ad875bcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:42.132242 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-621ef51f-5cca-483f-9f72-ee0ad875bcd4 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:42.134298 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-621ef51f-5cca-483f-9f72-ee0ad875bcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:42.153878 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1091/2164] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:42.153878 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ef51f-5cca-483f-9f72-ee0ad875bcd4 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:42.153878 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-621ef51f-5cca-483f-9f72-ee0ad875bcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:42.198769 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6007be6f-e067-40ca-9fe1-67f689b42d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5640de18fda644ee92c83852b53ef7da'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:42.199533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6007be6f-e067-40ca-9fe1-67f689b42d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5640de18fda644ee92c83852b53ef7da'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:42.224817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6007be6f-e067-40ca-9fe1-67f689b42d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5640de18fda644ee92c83852b53ef7da'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:42.273830 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1074/2165] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:41 2022] DELETE /identity/v3/users/5640de18fda644ee92c83852b53ef7da => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:42.275415 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928a63c-a9a4-4c89-b83a-92085e5a9a0f None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:42.275887 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928a63c-a9a4-4c89-b83a-92085e5a9a0f None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:42.276409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928a63c-a9a4-4c89-b83a-92085e5a9a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:42.294556 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ef51f-5cca-483f-9f72-ee0ad875bcd4 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:42.322120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-c928a63c-a9a4-4c89-b83a-92085e5a9a0f None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:42.323837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-c928a63c-a9a4-4c89-b83a-92085e5a9a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:42.379719 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921764fe-ed59-468d-93b6-b5f4e2f6d973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:42.379719 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921764fe-ed59-468d-93b6-b5f4e2f6d973 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:42.379719 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921764fe-ed59-468d-93b6-b5f4e2f6d973 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:42.379719 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921764fe-ed59-468d-93b6-b5f4e2f6d973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:42.400564 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:42.415229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1075/2166] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:42.416889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72ce8e-d913-481f-af16-87bdf6176b81 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:42.417247 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72ce8e-d913-481f-af16-87bdf6176b81 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:42.417654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72ce8e-d913-481f-af16-87bdf6176b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:42.453127 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-0f72ce8e-d913-481f-af16-87bdf6176b81 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:42.455315 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0f72ce8e-d913-481f-af16-87bdf6176b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:42.470894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1076/2167] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:42.470894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72ce8e-d913-481f-af16-87bdf6176b81 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:42.479342 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72ce8e-d913-481f-af16-87bdf6176b81 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:42.480402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921764fe-ed59-468d-93b6-b5f4e2f6d973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:42.483071 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921764fe-ed59-468d-93b6-b5f4e2f6d973 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:42.492645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cc20b-beb4-4019-9438-39dbcf795b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:42.502939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cc20b-beb4-4019-9438-39dbcf795b56 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:42.502939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cc20b-beb4-4019-9438-39dbcf795b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:42.502939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cc20b-beb4-4019-9438-39dbcf795b56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:42.502939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cc20b-beb4-4019-9438-39dbcf795b56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:00:42.502939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cc20b-beb4-4019-9438-39dbcf795b56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:42.503366 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1092/2168] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:00:42.503366 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921764fe-ed59-468d-93b6-b5f4e2f6d973 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:42.503524 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cc20b-beb4-4019-9438-39dbcf795b56 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:42.511292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921764fe-ed59-468d-93b6-b5f4e2f6d973 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:42.517658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee7116-3c8d-4dc0-99f9-d973302c7305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:42.518416 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee7116-3c8d-4dc0-99f9-d973302c7305 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:42.518752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee7116-3c8d-4dc0-99f9-d973302c7305 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:42.519204 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1077/2169] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:00:42.519336 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee7116-3c8d-4dc0-99f9-d973302c7305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:42.523427 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cc20b-beb4-4019-9438-39dbcf795b56 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:42.535962 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee7116-3c8d-4dc0-99f9-d973302c7305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:42.537984 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cc20b-beb4-4019-9438-39dbcf795b56 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:42.538309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee7116-3c8d-4dc0-99f9-d973302c7305 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:42.543024 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6924c8-4560-40b0-be8e-b35de62673d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:42.544282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6924c8-4560-40b0-be8e-b35de62673d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:42.544572 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6924c8-4560-40b0-be8e-b35de62673d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:42.544843 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6924c8-4560-40b0-be8e-b35de62673d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:42.545672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6924c8-4560-40b0-be8e-b35de62673d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:42.547597 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6924c8-4560-40b0-be8e-b35de62673d6 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:42.576308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1093/2170] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:00:42.672045 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1078/2171] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:42 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:00:42.677734 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee7116-3c8d-4dc0-99f9-d973302c7305 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:42.695288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee7116-3c8d-4dc0-99f9-d973302c7305 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:42.771454 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b25b1f-9d7a-48c7-8d8d-8ba3ba97c0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:42.772157 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b25b1f-9d7a-48c7-8d8d-8ba3ba97c0dc admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:42.772448 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b25b1f-9d7a-48c7-8d8d-8ba3ba97c0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:42.772728 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b25b1f-9d7a-48c7-8d8d-8ba3ba97c0dc admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:42.773441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b25b1f-9d7a-48c7-8d8d-8ba3ba97c0dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:42.775637 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b25b1f-9d7a-48c7-8d8d-8ba3ba97c0dc admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:42.898478 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1094/2172] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:42 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:42.903577 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6924c8-4560-40b0-be8e-b35de62673d6 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:42.939635 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6924c8-4560-40b0-be8e-b35de62673d6 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:42.955086 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66926675-e944-427c-b554-18395780c703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:42.955086 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66926675-e944-427c-b554-18395780c703 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:42.955332 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66926675-e944-427c-b554-18395780c703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:42.957071 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66926675-e944-427c-b554-18395780c703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:42.957928 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66926675-e944-427c-b554-18395780c703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:42.962679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66926675-e944-427c-b554-18395780c703 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:42.974569 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:42.982563 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1079/2173] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:42.985854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b25b1f-9d7a-48c7-8d8d-8ba3ba97c0dc admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:42.997220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b25b1f-9d7a-48c7-8d8d-8ba3ba97c0dc admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:43.002154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf6975-3cfa-461b-92bc-e0c2f3e88c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:43.002834 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf6975-3cfa-461b-92bc-e0c2f3e88c04 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:43.003396 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf6975-3cfa-461b-92bc-e0c2f3e88c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:43.003704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf6975-3cfa-461b-92bc-e0c2f3e88c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:43.004501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf6975-3cfa-461b-92bc-e0c2f3e88c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:43.006138 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf6975-3cfa-461b-92bc-e0c2f3e88c04 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:43.032856 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66926675-e944-427c-b554-18395780c703 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:43.036467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1095/2174] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:43.046667 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66926675-e944-427c-b554-18395780c703 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:43.053493 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4fcbc-ff7e-4aa6-b0d2-008a5bb8c1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:43.055354 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4fcbc-ff7e-4aa6-b0d2-008a5bb8c1f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:43.055643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4fcbc-ff7e-4aa6-b0d2-008a5bb8c1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:43.055972 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4fcbc-ff7e-4aa6-b0d2-008a5bb8c1f5 admin admin] PATH_INFO: `/v3/projects/d2e54332e64e45a6b7989ed8b98f21ed/users/ca5171ef18034c6f922eaee7c8cd4f05/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:43.079771 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4fcbc-ff7e-4aa6-b0d2-008a5bb8c1f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e54332e64e45a6b7989ed8b98f21ed, user_id=ca5171ef18034c6f922eaee7c8cd4f05, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:43.083218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4fcbc-ff7e-4aa6-b0d2-008a5bb8c1f5 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:43.137909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf6975-3cfa-461b-92bc-e0c2f3e88c04 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:43.139889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-5caf6975-3cfa-461b-92bc-e0c2f3e88c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:43.162932 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf6975-3cfa-461b-92bc-e0c2f3e88c04 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:43.186584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1080/2175] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:43 2022] PUT /identity/v3/projects/d2e54332e64e45a6b7989ed8b98f21ed/users/ca5171ef18034c6f922eaee7c8cd4f05/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:43.189485 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bdb8c-f88a-4bd7-8852-546ff3549491 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:43.189799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bdb8c-f88a-4bd7-8852-546ff3549491 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:43.190082 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bdb8c-f88a-4bd7-8852-546ff3549491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:43.225972 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-653bdb8c-f88a-4bd7-8852-546ff3549491 None None] MFA Rules not processed for user `ca5171ef18034c6f922eaee7c8cd4f05`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:43.227586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-653bdb8c-f88a-4bd7-8852-546ff3549491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:43.250398 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f175548-f16f-4d92-9d73-820075826bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:43.251394 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f175548-f16f-4d92-9d73-820075826bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:43.251785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f175548-f16f-4d92-9d73-820075826bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:43.252197 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f175548-f16f-4d92-9d73-820075826bc4 admin admin] PATH_INFO: `/v3/projects/96b2b583541c48d5a45e4e63fd6c01fb` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:43.253793 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f175548-f16f-4d92-9d73-820075826bc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96b2b583541c48d5a45e4e63fd6c01fb)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:43.256469 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f175548-f16f-4d92-9d73-820075826bc4 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:43.344278 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1081/2176] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:00:43.345400 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bdb8c-f88a-4bd7-8852-546ff3549491 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:43.354181 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-653bdb8c-f88a-4bd7-8852-546ff3549491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:43.370825 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bdb8c-f88a-4bd7-8852-546ff3549491 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:43.375686 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fc253-7df7-4904-b846-5839a4d37ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:43.376670 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fc253-7df7-4904-b846-5839a4d37ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:43.377145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fc253-7df7-4904-b846-5839a4d37ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:43.377445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fc253-7df7-4904-b846-5839a4d37ce5 admin admin] PATH_INFO: `/v3/projects/ba479e7b130e45d4b224f9b7fad34740` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:43.378874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fc253-7df7-4904-b846-5839a4d37ce5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba479e7b130e45d4b224f9b7fad34740)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:43.381233 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fc253-7df7-4904-b846-5839a4d37ce5 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:43.418927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-5f175548-f16f-4d92-9d73-820075826bc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96b2b583541c48d5a45e4e63fd6c01fb', 'request_id': 'req-5f175548-f16f-4d92-9d73-820075826bc4'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:43.531641 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:43.533771 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-5f175548-f16f-4d92-9d73-820075826bc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96b2b583541c48d5a45e4e63fd6c01fb', 'request_id': 'req-5f175548-f16f-4d92-9d73-820075826bc4'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:43.541623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-5f175548-f16f-4d92-9d73-820075826bc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96b2b583541c48d5a45e4e63fd6c01fb', 'request_id': 'req-5f175548-f16f-4d92-9d73-820075826bc4'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:43.551440 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-9f7fc253-7df7-4904-b846-5839a4d37ce5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba479e7b130e45d4b224f9b7fad34740', 'request_id': 'req-9f7fc253-7df7-4904-b846-5839a4d37ce5'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:43.554772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-5f175548-f16f-4d92-9d73-820075826bc4 admin admin] The token cache is being invalidate because project 96b2b583541c48d5a45e4e63fd6c01fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:43.555081 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-5f175548-f16f-4d92-9d73-820075826bc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:43.555786 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-5f175548-f16f-4d92-9d73-820075826bc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:43.561156 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1096/2177] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:43 2022] DELETE /identity/v3/projects/96b2b583541c48d5a45e4e63fd6c01fb => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:00:43.561156 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f175548-f16f-4d92-9d73-820075826bc4 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:43.562233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-5f175548-f16f-4d92-9d73-820075826bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:43.627492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-9f7fc253-7df7-4904-b846-5839a4d37ce5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba479e7b130e45d4b224f9b7fad34740', 'request_id': 'req-9f7fc253-7df7-4904-b846-5839a4d37ce5'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:43.634137 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-9f7fc253-7df7-4904-b846-5839a4d37ce5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba479e7b130e45d4b224f9b7fad34740', 'request_id': 'req-9f7fc253-7df7-4904-b846-5839a4d37ce5'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:43.638738 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f175548-f16f-4d92-9d73-820075826bc4 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:43.655123 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-9f7fc253-7df7-4904-b846-5839a4d37ce5 admin admin] The token cache is being invalidate because project ba479e7b130e45d4b224f9b7fad34740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:43.655428 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-9f7fc253-7df7-4904-b846-5839a4d37ce5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:43.656554 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-9f7fc253-7df7-4904-b846-5839a4d37ce5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:43.658806 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1082/2178] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:43 2022] DELETE /identity/v3/projects/ba479e7b130e45d4b224f9b7fad34740 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:43.659524 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fc253-7df7-4904-b846-5839a4d37ce5 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:43.661145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-9f7fc253-7df7-4904-b846-5839a4d37ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:43.714408 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd4157-ee3c-4376-b8a9-01ca388151f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:43.715087 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd4157-ee3c-4376-b8a9-01ca388151f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:43.715408 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd4157-ee3c-4376-b8a9-01ca388151f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:43.715816 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd4157-ee3c-4376-b8a9-01ca388151f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:43.716790 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd4157-ee3c-4376-b8a9-01ca388151f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:43.718957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd4157-ee3c-4376-b8a9-01ca388151f7 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:43.762852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fc253-7df7-4904-b846-5839a4d37ce5 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:43.768031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80dce5-4915-4bdb-9988-b780306c7fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:43.769004 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80dce5-4915-4bdb-9988-b780306c7fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:43.769294 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80dce5-4915-4bdb-9988-b780306c7fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:43.769572 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80dce5-4915-4bdb-9988-b780306c7fde admin admin] PATH_INFO: `/v3/users/54a77f1ef93c4d2aad0e50a704384c4c` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:43.770911 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80dce5-4915-4bdb-9988-b780306c7fde admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a77f1ef93c4d2aad0e50a704384c4c)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:43.773132 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80dce5-4915-4bdb-9988-b780306c7fde admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:43.844153 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1097/2179] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:43 2022] POST /identity/v3/projects => generated 379 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:43.845445 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd4157-ee3c-4376-b8a9-01ca388151f7 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:43.847811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-addd4157-ee3c-4376-b8a9-01ca388151f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:43.914743 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd4157-ee3c-4376-b8a9-01ca388151f7 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:43.920324 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2aef7-2f19-4656-84f9-04eff1d85f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:43.921367 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2aef7-2f19-4656-84f9-04eff1d85f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:43.921654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2aef7-2f19-4656-84f9-04eff1d85f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:43.922082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2aef7-2f19-4656-84f9-04eff1d85f00 admin admin] PATH_INFO: `/v3/users/63648f16a35949379302d8d83dd83f4c` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:43.923335 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2aef7-2f19-4656-84f9-04eff1d85f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63648f16a35949379302d8d83dd83f4c)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:43.925318 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2aef7-2f19-4656-84f9-04eff1d85f00 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:43.962607 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:44.081630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ac80dce5-4915-4bdb-9988-b780306c7fde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a77f1ef93c4d2aad0e50a704384c4c'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:44.086057 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ac80dce5-4915-4bdb-9988-b780306c7fde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a77f1ef93c4d2aad0e50a704384c4c'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:44.176705 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-08b2aef7-2f19-4656-84f9-04eff1d85f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63648f16a35949379302d8d83dd83f4c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:44.195384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-08b2aef7-2f19-4656-84f9-04eff1d85f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63648f16a35949379302d8d83dd83f4c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:44.196665 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-08b2aef7-2f19-4656-84f9-04eff1d85f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63648f16a35949379302d8d83dd83f4c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:44.219516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-08b2aef7-2f19-4656-84f9-04eff1d85f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63648f16a35949379302d8d83dd83f4c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:44.220264 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-08b2aef7-2f19-4656-84f9-04eff1d85f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63648f16a35949379302d8d83dd83f4c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:44.224543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ac80dce5-4915-4bdb-9988-b780306c7fde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a77f1ef93c4d2aad0e50a704384c4c'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:44.225287 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ac80dce5-4915-4bdb-9988-b780306c7fde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a77f1ef93c4d2aad0e50a704384c4c'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:44.242198 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ac80dce5-4915-4bdb-9988-b780306c7fde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a77f1ef93c4d2aad0e50a704384c4c'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:44.260444 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1083/2180] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:43 2022] DELETE /identity/v3/users/54a77f1ef93c4d2aad0e50a704384c4c => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:44.261183 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80dce5-4915-4bdb-9988-b780306c7fde admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:44.262671 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-ac80dce5-4915-4bdb-9988-b780306c7fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:44.348514 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1098/2181] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:43 2022] DELETE /identity/v3/users/63648f16a35949379302d8d83dd83f4c => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:44.359729 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80dce5-4915-4bdb-9988-b780306c7fde admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:44.448856 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d99c8-908b-45aa-9909-733adb73444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:44.449917 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d99c8-908b-45aa-9909-733adb73444e admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:44.450463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d99c8-908b-45aa-9909-733adb73444e admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:44.450943 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d99c8-908b-45aa-9909-733adb73444e admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:44.451799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d99c8-908b-45aa-9909-733adb73444e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:44.455785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d99c8-908b-45aa-9909-733adb73444e admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:44.515487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964e886-989b-4798-ae9a-9546d3bb0c80 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:44.515970 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964e886-989b-4798-ae9a-9546d3bb0c80 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:44.516586 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964e886-989b-4798-ae9a-9546d3bb0c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:44.544290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-b964e886-989b-4798-ae9a-9546d3bb0c80 None None] MFA Rules not processed for user `1fe59d1f996e4abdb8a90b7444133e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:44.544290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-b964e886-989b-4798-ae9a-9546d3bb0c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:44.604733 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1099/2182] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:00:44.665441 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1084/2183] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:44 2022] POST /identity/v3/users => generated 296 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:44.666883 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964e886-989b-4798-ae9a-9546d3bb0c80 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:44.669002 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-b964e886-989b-4798-ae9a-9546d3bb0c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:44.684236 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964e886-989b-4798-ae9a-9546d3bb0c80 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:44.693145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abfed91-37a5-4ca8-a34b-bc2e01545cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:44.694222 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfed91-37a5-4ca8-a34b-bc2e01545cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:44.695571 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfed91-37a5-4ca8-a34b-bc2e01545cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:44.695834 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfed91-37a5-4ca8-a34b-bc2e01545cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:44.696642 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abfed91-37a5-4ca8-a34b-bc2e01545cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:44.698292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abfed91-37a5-4ca8-a34b-bc2e01545cc0 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:44.710852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1100/2184] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:44.718876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d99c8-908b-45aa-9909-733adb73444e admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:44.742340 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d99c8-908b-45aa-9909-733adb73444e admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:44.748223 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059be92-3706-4ff2-875b-bcc74a37ff28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:44.749143 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059be92-3706-4ff2-875b-bcc74a37ff28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:44.749434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059be92-3706-4ff2-875b-bcc74a37ff28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:44.749718 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059be92-3706-4ff2-875b-bcc74a37ff28 admin admin] PATH_INFO: `/v3/projects/15a1d91113a9453994a766470cc4e510/users/e77acc1594ae43d099a7d11abf5a7f2e/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:44.781738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059be92-3706-4ff2-875b-bcc74a37ff28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a1d91113a9453994a766470cc4e510, user_id=e77acc1594ae43d099a7d11abf5a7f2e, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:44.781738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059be92-3706-4ff2-875b-bcc74a37ff28 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:44.910244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1085/2185] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:44 2022] PUT /identity/v3/projects/15a1d91113a9453994a766470cc4e510/users/e77acc1594ae43d099a7d11abf5a7f2e/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:44.911871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abfed91-37a5-4ca8-a34b-bc2e01545cc0 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:44.923471 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abfed91-37a5-4ca8-a34b-bc2e01545cc0 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:44.993872 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2fc04-d0f3-4f84-b808-da12ca3a6928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:44.994731 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2fc04-d0f3-4f84-b808-da12ca3a6928 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:44.998881 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2fc04-d0f3-4f84-b808-da12ca3a6928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:44.998881 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2fc04-d0f3-4f84-b808-da12ca3a6928 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:44.998881 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2fc04-d0f3-4f84-b808-da12ca3a6928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:44.998881 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2fc04-d0f3-4f84-b808-da12ca3a6928 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:45.025922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059be92-3706-4ff2-875b-bcc74a37ff28 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:45.044718 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1101/2186] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:45.045306 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059be92-3706-4ff2-875b-bcc74a37ff28 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:45.050249 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec8bde-95fb-49d5-b68d-9a1cfe91bcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:45.051465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec8bde-95fb-49d5-b68d-9a1cfe91bcaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:45.051975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec8bde-95fb-49d5-b68d-9a1cfe91bcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:45.052341 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec8bde-95fb-49d5-b68d-9a1cfe91bcaf admin admin] PATH_INFO: `/v3/projects/15a1d91113a9453994a766470cc4e510/users/e77acc1594ae43d099a7d11abf5a7f2e/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:45.054611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec8bde-95fb-49d5-b68d-9a1cfe91bcaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a1d91113a9453994a766470cc4e510, user_id=e77acc1594ae43d099a7d11abf5a7f2e, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:45.057940 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec8bde-95fb-49d5-b68d-9a1cfe91bcaf admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:45.070889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1086/2187] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:45 2022] PUT /identity/v3/projects/15a1d91113a9453994a766470cc4e510/users/e77acc1594ae43d099a7d11abf5a7f2e/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:00:45.081449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48e7d3-8fe6-4a99-98d1-ff3aa1696b5e None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:45.081742 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48e7d3-8fe6-4a99-98d1-ff3aa1696b5e None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:45.082024 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48e7d3-8fe6-4a99-98d1-ff3aa1696b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:45.112755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-1d48e7d3-8fe6-4a99-98d1-ff3aa1696b5e None None] MFA Rules not processed for user `e77acc1594ae43d099a7d11abf5a7f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:45.114052 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-1d48e7d3-8fe6-4a99-98d1-ff3aa1696b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:45.186771 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1102/2188] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:45.202191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec8bde-95fb-49d5-b68d-9a1cfe91bcaf admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:45.203510 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-23ec8bde-95fb-49d5-b68d-9a1cfe91bcaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:45.209192 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48e7d3-8fe6-4a99-98d1-ff3aa1696b5e None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:45.213489 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-1d48e7d3-8fe6-4a99-98d1-ff3aa1696b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:45.243274 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:45.324285 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec8bde-95fb-49d5-b68d-9a1cfe91bcaf admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:45.329517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142907d-124a-47d2-9a66-9499b9334f24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:45.334542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142907d-124a-47d2-9a66-9499b9334f24 service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:45.334542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142907d-124a-47d2-9a66-9499b9334f24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:45.334542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142907d-124a-47d2-9a66-9499b9334f24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:45.341021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48e7d3-8fe6-4a99-98d1-ff3aa1696b5e None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:45.349332 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142907d-124a-47d2-9a66-9499b9334f24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:45.352421 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142907d-124a-47d2-9a66-9499b9334f24 service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:45.352909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba36ad6-2bfa-4d87-b02d-a84e86ff0b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:45.353788 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba36ad6-2bfa-4d87-b02d-a84e86ff0b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:45.354074 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba36ad6-2bfa-4d87-b02d-a84e86ff0b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:45.354355 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba36ad6-2bfa-4d87-b02d-a84e86ff0b3d admin admin] PATH_INFO: `/v3/projects/78f57852956e4c23982e47000ede5d0d` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:45.357015 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba36ad6-2bfa-4d87-b02d-a84e86ff0b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f57852956e4c23982e47000ede5d0d)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:45.358962 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba36ad6-2bfa-4d87-b02d-a84e86ff0b3d admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:45.363175 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1087/2189] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:00:45.364026 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142907d-124a-47d2-9a66-9499b9334f24 service cinder] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:45.365489 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-c142907d-124a-47d2-9a66-9499b9334f24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:45.380731 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142907d-124a-47d2-9a66-9499b9334f24 service cinder] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:45.387852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346ab54-e4b1-4697-82a5-739017a439db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:45.392019 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346ab54-e4b1-4697-82a5-739017a439db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:45.392019 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346ab54-e4b1-4697-82a5-739017a439db admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:45.392019 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346ab54-e4b1-4697-82a5-739017a439db admin admin] PATH_INFO: `/v3/projects/099baa80ac294f21854a1318207cd647` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:45.392019 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346ab54-e4b1-4697-82a5-739017a439db admin admin] RBAC: Authorizing `identity:delete_project(project_id=099baa80ac294f21854a1318207cd647)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:45.394308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346ab54-e4b1-4697-82a5-739017a439db admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:45.441550 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:45.572735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fba36ad6-2bfa-4d87-b02d-a84e86ff0b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f57852956e4c23982e47000ede5d0d', 'request_id': 'req-fba36ad6-2bfa-4d87-b02d-a84e86ff0b3d'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:45.626995 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6346ab54-e4b1-4697-82a5-739017a439db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '099baa80ac294f21854a1318207cd647', 'request_id': 'req-6346ab54-e4b1-4697-82a5-739017a439db'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:45.698559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fba36ad6-2bfa-4d87-b02d-a84e86ff0b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f57852956e4c23982e47000ede5d0d', 'request_id': 'req-fba36ad6-2bfa-4d87-b02d-a84e86ff0b3d'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:45.710795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fba36ad6-2bfa-4d87-b02d-a84e86ff0b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f57852956e4c23982e47000ede5d0d', 'request_id': 'req-fba36ad6-2bfa-4d87-b02d-a84e86ff0b3d'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:45.726255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fba36ad6-2bfa-4d87-b02d-a84e86ff0b3d admin admin] The token cache is being invalidate because project 78f57852956e4c23982e47000ede5d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:45.726547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fba36ad6-2bfa-4d87-b02d-a84e86ff0b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:45.727234 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fba36ad6-2bfa-4d87-b02d-a84e86ff0b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:45.729155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1103/2190] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:45 2022] DELETE /identity/v3/projects/78f57852956e4c23982e47000ede5d0d => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:00:45.730367 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba36ad6-2bfa-4d87-b02d-a84e86ff0b3d admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:45.733686 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-fba36ad6-2bfa-4d87-b02d-a84e86ff0b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:45.807012 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba36ad6-2bfa-4d87-b02d-a84e86ff0b3d admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:45.828330 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6346ab54-e4b1-4697-82a5-739017a439db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '099baa80ac294f21854a1318207cd647', 'request_id': 'req-6346ab54-e4b1-4697-82a5-739017a439db'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:45.837234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6346ab54-e4b1-4697-82a5-739017a439db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '099baa80ac294f21854a1318207cd647', 'request_id': 'req-6346ab54-e4b1-4697-82a5-739017a439db'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:45.848981 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6346ab54-e4b1-4697-82a5-739017a439db admin admin] The token cache is being invalidate because project 099baa80ac294f21854a1318207cd647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:45.849269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6346ab54-e4b1-4697-82a5-739017a439db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:45.849930 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6346ab54-e4b1-4697-82a5-739017a439db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:45.851678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1088/2191] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:45 2022] DELETE /identity/v3/projects/099baa80ac294f21854a1318207cd647 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:45.852515 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346ab54-e4b1-4697-82a5-739017a439db admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:45.856533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6346ab54-e4b1-4697-82a5-739017a439db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:45.870439 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca89fa-9ea1-47b5-afaa-4b05d394a2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:45.871327 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca89fa-9ea1-47b5-afaa-4b05d394a2b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:45.872331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca89fa-9ea1-47b5-afaa-4b05d394a2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:45.872734 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca89fa-9ea1-47b5-afaa-4b05d394a2b7 admin admin] PATH_INFO: `/v3/users/575996511c464f37a8ab2c4369b29699` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:45.875833 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca89fa-9ea1-47b5-afaa-4b05d394a2b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=575996511c464f37a8ab2c4369b29699)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:45.878309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca89fa-9ea1-47b5-afaa-4b05d394a2b7 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:45.926826 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346ab54-e4b1-4697-82a5-739017a439db admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:45.931490 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08c8a6-178d-42d1-9a57-aaef979ad728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:45.932386 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08c8a6-178d-42d1-9a57-aaef979ad728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:45.932673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08c8a6-178d-42d1-9a57-aaef979ad728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:45.932953 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08c8a6-178d-42d1-9a57-aaef979ad728 admin admin] PATH_INFO: `/v3/users/bfd80a6dba554156b37e462c04974924` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:45.934738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08c8a6-178d-42d1-9a57-aaef979ad728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd80a6dba554156b37e462c04974924)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:45.936705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08c8a6-178d-42d1-9a57-aaef979ad728 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:46.107760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-a4ca89fa-9ea1-47b5-afaa-4b05d394a2b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '575996511c464f37a8ab2c4369b29699'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:46.115598 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-a4ca89fa-9ea1-47b5-afaa-4b05d394a2b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '575996511c464f37a8ab2c4369b29699'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:46.116341 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-a4ca89fa-9ea1-47b5-afaa-4b05d394a2b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '575996511c464f37a8ab2c4369b29699'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:46.127966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-a4ca89fa-9ea1-47b5-afaa-4b05d394a2b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '575996511c464f37a8ab2c4369b29699'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:46.128632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-a4ca89fa-9ea1-47b5-afaa-4b05d394a2b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '575996511c464f37a8ab2c4369b29699'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:46.250150 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-8c08c8a6-178d-42d1-9a57-aaef979ad728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd80a6dba554156b37e462c04974924'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:46.250800 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-8c08c8a6-178d-42d1-9a57-aaef979ad728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd80a6dba554156b37e462c04974924'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:46.277633 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1104/2192] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:45 2022] DELETE /identity/v3/users/575996511c464f37a8ab2c4369b29699 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:46.279480 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b821b-63b2-4874-876e-33006fc72dd5 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:46.279773 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b821b-63b2-4874-876e-33006fc72dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:46.280055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b821b-63b2-4874-876e-33006fc72dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:46.299329 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-a83b821b-63b2-4874-876e-33006fc72dd5 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:46.300513 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-a83b821b-63b2-4874-876e-33006fc72dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:46.358834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-8c08c8a6-178d-42d1-9a57-aaef979ad728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd80a6dba554156b37e462c04974924'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:46.359943 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-8c08c8a6-178d-42d1-9a57-aaef979ad728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd80a6dba554156b37e462c04974924'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:46.374222 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1105/2193] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:46.381274 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-8c08c8a6-178d-42d1-9a57-aaef979ad728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd80a6dba554156b37e462c04974924'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:46.382793 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b03874-e86b-43db-8fa7-c0377a08d67f None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:46.383085 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b03874-e86b-43db-8fa7-c0377a08d67f None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:46.383363 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b03874-e86b-43db-8fa7-c0377a08d67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:46.396186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1089/2194] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:45 2022] DELETE /identity/v3/users/bfd80a6dba554156b37e462c04974924 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:46.405525 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-76b03874-e86b-43db-8fa7-c0377a08d67f None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:46.407019 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-76b03874-e86b-43db-8fa7-c0377a08d67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:46.480170 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1106/2195] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:00:46.484888 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08c8a6-178d-42d1-9a57-aaef979ad728 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:46.495001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08c8a6-178d-42d1-9a57-aaef979ad728 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:46.503416 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de16b6d-26a8-44e8-83c6-1761c1030d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:46.504031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de16b6d-26a8-44e8-83c6-1761c1030d67 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:46.504401 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de16b6d-26a8-44e8-83c6-1761c1030d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:46.504671 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de16b6d-26a8-44e8-83c6-1761c1030d67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:46.505403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de16b6d-26a8-44e8-83c6-1761c1030d67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:00:46.505708 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de16b6d-26a8-44e8-83c6-1761c1030d67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:46.507614 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de16b6d-26a8-44e8-83c6-1761c1030d67 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:46.521239 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1090/2196] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:00:46.527136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b03874-e86b-43db-8fa7-c0377a08d67f None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:46.536494 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b03874-e86b-43db-8fa7-c0377a08d67f None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:46.541295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6013d-d3ef-439e-8774-89ed47b7bc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:46.541949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6013d-d3ef-439e-8774-89ed47b7bc99 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:46.542235 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6013d-d3ef-439e-8774-89ed47b7bc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:46.542510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6013d-d3ef-439e-8774-89ed47b7bc99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:46.543217 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6013d-d3ef-439e-8774-89ed47b7bc99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:46.545869 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6013d-d3ef-439e-8774-89ed47b7bc99 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:46.596916 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de16b6d-26a8-44e8-83c6-1761c1030d67 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:46.602754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0de16b6d-26a8-44e8-83c6-1761c1030d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:46.697165 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1107/2197] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:46 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:46.697165 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6013d-d3ef-439e-8774-89ed47b7bc99 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:46.697165 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c8a6013d-d3ef-439e-8774-89ed47b7bc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:46.714343 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de16b6d-26a8-44e8-83c6-1761c1030d67 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:46.782241 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6013d-d3ef-439e-8774-89ed47b7bc99 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:46.787325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795614a6-dbed-419b-b1e7-b87303ede9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:46.789333 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795614a6-dbed-419b-b1e7-b87303ede9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:46.789333 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795614a6-dbed-419b-b1e7-b87303ede9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:46.789333 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795614a6-dbed-419b-b1e7-b87303ede9fc admin admin] PATH_INFO: `/v3/projects/85dd6bf936e34faf84e53d142768a560` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:46.790583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795614a6-dbed-419b-b1e7-b87303ede9fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=85dd6bf936e34faf84e53d142768a560)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:46.792983 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795614a6-dbed-419b-b1e7-b87303ede9fc admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:46.796946 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fb282-91a9-4d18-b1f2-4d4b8df85a3b tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e77acc1594ae43d099a7d11abf5a7f2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a1d91113a9453994a766470cc4e510', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:46.797621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fb282-91a9-4d18-b1f2-4d4b8df85a3b tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:46.812389 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fb282-91a9-4d18-b1f2-4d4b8df85a3b tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:46.813066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fb282-91a9-4d18-b1f2-4d4b8df85a3b tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:46.814397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fb282-91a9-4d18-b1f2-4d4b8df85a3b tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:00:46.814770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fb282-91a9-4d18-b1f2-4d4b8df85a3b tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:46.816941 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fb282-91a9-4d18-b1f2-4d4b8df85a3b tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:46.831605 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1091/2198] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 17:00:46.831605 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fb282-91a9-4d18-b1f2-4d4b8df85a3b tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:46.846435 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fb282-91a9-4d18-b1f2-4d4b8df85a3b tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:46.851425 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d8335-4d66-43ec-8f22-f0eb4fdec538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:46.852266 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d8335-4d66-43ec-8f22-f0eb4fdec538 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:46.852619 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d8335-4d66-43ec-8f22-f0eb4fdec538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:46.852963 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d8335-4d66-43ec-8f22-f0eb4fdec538 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:46.853728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d8335-4d66-43ec-8f22-f0eb4fdec538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:46.856797 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d8335-4d66-43ec-8f22-f0eb4fdec538 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:46.887890 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:46.936642 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-795614a6-dbed-419b-b1e7-b87303ede9fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85dd6bf936e34faf84e53d142768a560', 'request_id': 'req-795614a6-dbed-419b-b1e7-b87303ede9fc'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:46.976354 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1092/2199] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:46 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:46.977868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d8335-4d66-43ec-8f22-f0eb4fdec538 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:46.990269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d8335-4d66-43ec-8f22-f0eb4fdec538 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:47.050994 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eeb06e-bf59-40f6-a585-8b5f2db5c1d1 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e77acc1594ae43d099a7d11abf5a7f2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a1d91113a9453994a766470cc4e510', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:47.051662 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eeb06e-bf59-40f6-a585-8b5f2db5c1d1 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:47.051952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eeb06e-bf59-40f6-a585-8b5f2db5c1d1 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:47.052272 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eeb06e-bf59-40f6-a585-8b5f2db5c1d1 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:47.052974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eeb06e-bf59-40f6-a585-8b5f2db5c1d1 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:47.054953 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eeb06e-bf59-40f6-a585-8b5f2db5c1d1 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:47.055596 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-795614a6-dbed-419b-b1e7-b87303ede9fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85dd6bf936e34faf84e53d142768a560', 'request_id': 'req-795614a6-dbed-419b-b1e7-b87303ede9fc'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:47.063285 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-795614a6-dbed-419b-b1e7-b87303ede9fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85dd6bf936e34faf84e53d142768a560', 'request_id': 'req-795614a6-dbed-419b-b1e7-b87303ede9fc'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:47.073810 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-795614a6-dbed-419b-b1e7-b87303ede9fc admin admin] The token cache is being invalidate because project 85dd6bf936e34faf84e53d142768a560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:47.074110 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-795614a6-dbed-419b-b1e7-b87303ede9fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:47.074840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-795614a6-dbed-419b-b1e7-b87303ede9fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:47.076504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1108/2200] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:46 2022] DELETE /identity/v3/projects/85dd6bf936e34faf84e53d142768a560 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:47.077277 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795614a6-dbed-419b-b1e7-b87303ede9fc admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:47.078671 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-795614a6-dbed-419b-b1e7-b87303ede9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:47.144412 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1093/2201] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:46 2022] POST /identity/v3/projects => generated 354 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:47.146009 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27784f-e53a-4516-9af4-b14e9174b83e None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:47.146305 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27784f-e53a-4516-9af4-b14e9174b83e None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:47.146585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27784f-e53a-4516-9af4-b14e9174b83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:47.155880 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795614a6-dbed-419b-b1e7-b87303ede9fc admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:47.166853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-eb27784f-e53a-4516-9af4-b14e9174b83e None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:47.169425 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-eb27784f-e53a-4516-9af4-b14e9174b83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:47.212515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb58af7-6388-41b2-bfed-b2a03457d6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:47.213186 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb58af7-6388-41b2-bfed-b2a03457d6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:47.213504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb58af7-6388-41b2-bfed-b2a03457d6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:47.213862 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb58af7-6388-41b2-bfed-b2a03457d6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:47.214935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb58af7-6388-41b2-bfed-b2a03457d6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:47.217231 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb58af7-6388-41b2-bfed-b2a03457d6f4 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:47.229124 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1094/2202] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:47.229519 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1109/2203] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:47.237058 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27784f-e53a-4516-9af4-b14e9174b83e None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:47.237256 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb58af7-6388-41b2-bfed-b2a03457d6f4 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:47.238468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-eb27784f-e53a-4516-9af4-b14e9174b83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:47.239494 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-ffb58af7-6388-41b2-bfed-b2a03457d6f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:47.250369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27784f-e53a-4516-9af4-b14e9174b83e None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:47.255579 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d6eca-6521-4f9f-ab2b-88686bcf6f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:47.258534 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d6eca-6521-4f9f-ab2b-88686bcf6f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:47.258534 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d6eca-6521-4f9f-ab2b-88686bcf6f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:47.258534 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d6eca-6521-4f9f-ab2b-88686bcf6f27 admin admin] PATH_INFO: `/v3/projects/b80d252411bc429d817eb07189494d6e` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:47.258534 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d6eca-6521-4f9f-ab2b-88686bcf6f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b80d252411bc429d817eb07189494d6e)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:47.260604 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d6eca-6521-4f9f-ab2b-88686bcf6f27 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:47.307106 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb58af7-6388-41b2-bfed-b2a03457d6f4 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:47.311973 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df58323-aa0f-4655-b4cf-64e7feddd656 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e77acc1594ae43d099a7d11abf5a7f2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a1d91113a9453994a766470cc4e510', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:47.312661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df58323-aa0f-4655-b4cf-64e7feddd656 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:47.312953 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df58323-aa0f-4655-b4cf-64e7feddd656 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:47.313303 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df58323-aa0f-4655-b4cf-64e7feddd656 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:47.313426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:47.314036 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df58323-aa0f-4655-b4cf-64e7feddd656 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:00:47.314369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df58323-aa0f-4655-b4cf-64e7feddd656 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:47.316332 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df58323-aa0f-4655-b4cf-64e7feddd656 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:47.328496 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1110/2204] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:00:47.329291 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df58323-aa0f-4655-b4cf-64e7feddd656 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:47.339295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df58323-aa0f-4655-b4cf-64e7feddd656 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:47.348417 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fc93c-00a8-45cb-a3b3-89033360b7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:47.349091 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fc93c-00a8-45cb-a3b3-89033360b7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:47.349378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fc93c-00a8-45cb-a3b3-89033360b7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:47.352550 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fc93c-00a8-45cb-a3b3-89033360b7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:47.352550 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fc93c-00a8-45cb-a3b3-89033360b7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:47.352550 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fc93c-00a8-45cb-a3b3-89033360b7b5 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:47.364677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1111/2205] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:47.365945 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de0474-e69d-4d59-b468-259a505f450c None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:47.366285 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de0474-e69d-4d59-b468-259a505f450c None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:47.366564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de0474-e69d-4d59-b468-259a505f450c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:47.384933 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-18de0474-e69d-4d59-b468-259a505f450c None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:47.386165 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-18de0474-e69d-4d59-b468-259a505f450c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:47.388204 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6f4d6eca-6521-4f9f-ab2b-88686bcf6f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b80d252411bc429d817eb07189494d6e', 'request_id': 'req-6f4d6eca-6521-4f9f-ab2b-88686bcf6f27'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:47.444737 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1112/2206] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:47.445574 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de0474-e69d-4d59-b468-259a505f450c None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:47.490135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6f4d6eca-6521-4f9f-ab2b-88686bcf6f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b80d252411bc429d817eb07189494d6e', 'request_id': 'req-6f4d6eca-6521-4f9f-ab2b-88686bcf6f27'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:47.496098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6f4d6eca-6521-4f9f-ab2b-88686bcf6f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b80d252411bc429d817eb07189494d6e', 'request_id': 'req-6f4d6eca-6521-4f9f-ab2b-88686bcf6f27'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:47.506021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de0474-e69d-4d59-b468-259a505f450c None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:47.508388 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6f4d6eca-6521-4f9f-ab2b-88686bcf6f27 admin admin] The token cache is being invalidate because project b80d252411bc429d817eb07189494d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:47.508677 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6f4d6eca-6521-4f9f-ab2b-88686bcf6f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:47.509395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-6f4d6eca-6521-4f9f-ab2b-88686bcf6f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:47.510848 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006e2ac-35af-434f-9531-4c36eb97b548 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e77acc1594ae43d099a7d11abf5a7f2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a1d91113a9453994a766470cc4e510', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:47.511059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1095/2207] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:47 2022] DELETE /identity/v3/projects/b80d252411bc429d817eb07189494d6e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:47.511874 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006e2ac-35af-434f-9531-4c36eb97b548 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:47.512835 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006e2ac-35af-434f-9531-4c36eb97b548 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:47.513128 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006e2ac-35af-434f-9531-4c36eb97b548 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] PATH_INFO: `/v3/projects/5c2b821ba53f4b599a10b90749eaf5be` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:47.515297 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006e2ac-35af-434f-9531-4c36eb97b548 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5c2b821ba53f4b599a10b90749eaf5be)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:47.516611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006e2ac-35af-434f-9531-4c36eb97b548 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:47.517791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d6eca-6521-4f9f-ab2b-88686bcf6f27 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:47.519290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6f4d6eca-6521-4f9f-ab2b-88686bcf6f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:47.532342 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d6eca-6521-4f9f-ab2b-88686bcf6f27 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:47.537038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750fce3-81cc-4d2f-8a98-6e6b8671f916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:47.537908 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750fce3-81cc-4d2f-8a98-6e6b8671f916 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:47.538185 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750fce3-81cc-4d2f-8a98-6e6b8671f916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:47.538462 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750fce3-81cc-4d2f-8a98-6e6b8671f916 admin admin] PATH_INFO: `/v3/projects/192cd893aa5540bfab54a6cfd0a050f6/users/b0755d8e0e044cd0b546682424edf928/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:47.553396 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750fce3-81cc-4d2f-8a98-6e6b8671f916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=192cd893aa5540bfab54a6cfd0a050f6, user_id=b0755d8e0e044cd0b546682424edf928, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:47.556167 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750fce3-81cc-4d2f-8a98-6e6b8671f916 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:47.654526 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1096/2208] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:47 2022] PUT /identity/v3/projects/192cd893aa5540bfab54a6cfd0a050f6/users/b0755d8e0e044cd0b546682424edf928/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:47.655306 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750fce3-81cc-4d2f-8a98-6e6b8671f916 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:47.664406 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-8750fce3-81cc-4d2f-8a98-6e6b8671f916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:47.669708 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-b006e2ac-35af-434f-9531-4c36eb97b548 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c2b821ba53f4b599a10b90749eaf5be', 'request_id': 'req-b006e2ac-35af-434f-9531-4c36eb97b548'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:47.729605 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750fce3-81cc-4d2f-8a98-6e6b8671f916 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:47.772598 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-b006e2ac-35af-434f-9531-4c36eb97b548 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c2b821ba53f4b599a10b90749eaf5be', 'request_id': 'req-b006e2ac-35af-434f-9531-4c36eb97b548'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:47.779721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-b006e2ac-35af-434f-9531-4c36eb97b548 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c2b821ba53f4b599a10b90749eaf5be', 'request_id': 'req-b006e2ac-35af-434f-9531-4c36eb97b548'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:47.785755 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2714f-a04f-447c-a323-0ac36a057a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:47.786416 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2714f-a04f-447c-a323-0ac36a057a49 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:47.786704 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2714f-a04f-447c-a323-0ac36a057a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:47.786982 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2714f-a04f-447c-a323-0ac36a057a49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:47.787796 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2714f-a04f-447c-a323-0ac36a057a49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:00:47.788124 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2714f-a04f-447c-a323-0ac36a057a49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:47.789754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2714f-a04f-447c-a323-0ac36a057a49 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:47.790301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-b006e2ac-35af-434f-9531-4c36eb97b548 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] The token cache is being invalidate because project 5c2b821ba53f4b599a10b90749eaf5be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:47.790591 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-b006e2ac-35af-434f-9531-4c36eb97b548 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:47.791400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-b006e2ac-35af-434f-9531-4c36eb97b548 tempest-VolumeQuotaClassesTest-200044114 tempest-VolumeQuotaClassesTest-200044114-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:47.793198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1113/2209] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:47 2022] DELETE /identity/v3/projects/5c2b821ba53f4b599a10b90749eaf5be => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:47.799100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292028e-dffc-4976-a08d-70093328dad8 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:47.799402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292028e-dffc-4976-a08d-70093328dad8 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:47.799689 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292028e-dffc-4976-a08d-70093328dad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:47.804799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1097/2210] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:00:47.806184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5c091-9b4d-4db6-842c-e2265fe4449d None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:47.806571 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5c091-9b4d-4db6-842c-e2265fe4449d None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:47.806975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5c091-9b4d-4db6-842c-e2265fe4449d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:47.827523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-c292028e-dffc-4976-a08d-70093328dad8 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:47.828810 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c292028e-dffc-4976-a08d-70093328dad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:47.838466 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1114/2211] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:47.839523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292028e-dffc-4976-a08d-70093328dad8 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:47.841995 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-37d5c091-9b4d-4db6-842c-e2265fe4449d None None] MFA Rules not processed for user `b0755d8e0e044cd0b546682424edf928`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:47.843369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-37d5c091-9b4d-4db6-842c-e2265fe4449d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:47.862845 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c292028e-dffc-4976-a08d-70093328dad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:47.878150 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292028e-dffc-4976-a08d-70093328dad8 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:47.884087 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac6d3a-1e51-4af1-b4c9-ece1e9e78f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:47.885185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac6d3a-1e51-4af1-b4c9-ece1e9e78f7e admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:47.885185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac6d3a-1e51-4af1-b4c9-ece1e9e78f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:47.885604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac6d3a-1e51-4af1-b4c9-ece1e9e78f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:47.886431 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac6d3a-1e51-4af1-b4c9-ece1e9e78f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:47.889057 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac6d3a-1e51-4af1-b4c9-ece1e9e78f7e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:47.949709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1098/2212] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:47.953068 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9e9ba-0da2-4557-afc1-63a34cb3ad55 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:47.953368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9e9ba-0da2-4557-afc1-63a34cb3ad55 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:47.953653 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9e9ba-0da2-4557-afc1-63a34cb3ad55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:47.975981 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-0ca9e9ba-0da2-4557-afc1-63a34cb3ad55 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:47.977311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0ca9e9ba-0da2-4557-afc1-63a34cb3ad55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:47.996274 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1099/2213] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:47.998143 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9e9ba-0da2-4557-afc1-63a34cb3ad55 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:48.003602 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0ca9e9ba-0da2-4557-afc1-63a34cb3ad55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:48.014376 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9e9ba-0da2-4557-afc1-63a34cb3ad55 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:48.023073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51423b05-5fc3-4113-b4c4-a41272832c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:48.024536 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51423b05-5fc3-4113-b4c4-a41272832c0c admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:48.024886 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51423b05-5fc3-4113-b4c4-a41272832c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:48.025259 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51423b05-5fc3-4113-b4c4-a41272832c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:48.026556 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51423b05-5fc3-4113-b4c4-a41272832c0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:48.030640 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51423b05-5fc3-4113-b4c4-a41272832c0c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:48.036360 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1115/2214] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:47 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:48.036360 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac6d3a-1e51-4af1-b4c9-ece1e9e78f7e admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:48.113259 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac6d3a-1e51-4af1-b4c9-ece1e9e78f7e admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:48.118367 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc1298-392e-40ca-8671-3ad477054233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:48.119218 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc1298-392e-40ca-8671-3ad477054233 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:48.119703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc1298-392e-40ca-8671-3ad477054233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:48.119991 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc1298-392e-40ca-8671-3ad477054233 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:48.120961 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc1298-392e-40ca-8671-3ad477054233 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:00:48.121279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc1298-392e-40ca-8671-3ad477054233 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:48.123930 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc1298-392e-40ca-8671-3ad477054233 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:48.140609 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1116/2215] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:00:48.140609 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc1298-392e-40ca-8671-3ad477054233 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:48.148650 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc1298-392e-40ca-8671-3ad477054233 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:48.153953 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf78e1e-eace-46af-8c62-a9323aaa13ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:48.154631 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf78e1e-eace-46af-8c62-a9323aaa13ba admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:48.154918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf78e1e-eace-46af-8c62-a9323aaa13ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:48.155194 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf78e1e-eace-46af-8c62-a9323aaa13ba admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:48.155929 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf78e1e-eace-46af-8c62-a9323aaa13ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:48.157972 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf78e1e-eace-46af-8c62-a9323aaa13ba admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:48.194545 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1100/2216] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:47 2022] POST /identity/v3/projects => generated 379 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:48.194984 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51423b05-5fc3-4113-b4c4-a41272832c0c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:48.259278 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1117/2217] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:48 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:48.260329 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf78e1e-eace-46af-8c62-a9323aaa13ba admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:48.271606 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51423b05-5fc3-4113-b4c4-a41272832c0c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:48.274315 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf78e1e-eace-46af-8c62-a9323aaa13ba admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:48.276353 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52600604-5bc9-4867-8905-0ddaecd865c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:48.278447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52600604-5bc9-4867-8905-0ddaecd865c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:48.278447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52600604-5bc9-4867-8905-0ddaecd865c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:48.278447 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52600604-5bc9-4867-8905-0ddaecd865c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:48.279073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52600604-5bc9-4867-8905-0ddaecd865c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:48.281975 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9067294-3c70-49a5-a88c-c123a69cac60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:48.282439 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52600604-5bc9-4867-8905-0ddaecd865c4 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:48.282838 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9067294-3c70-49a5-a88c-c123a69cac60 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:48.283225 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9067294-3c70-49a5-a88c-c123a69cac60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:48.283599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9067294-3c70-49a5-a88c-c123a69cac60 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:48.284465 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9067294-3c70-49a5-a88c-c123a69cac60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:48.287707 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9067294-3c70-49a5-a88c-c123a69cac60 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:48.369206 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1118/2218] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:48 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:48.370236 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9067294-3c70-49a5-a88c-c123a69cac60 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:48.374799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1101/2219] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:48 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:48.375845 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52600604-5bc9-4867-8905-0ddaecd865c4 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:48.383949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9067294-3c70-49a5-a88c-c123a69cac60 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:48.451205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf13b3-9f99-450f-86cc-0c862457e2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:48.452039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf13b3-9f99-450f-86cc-0c862457e2af admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:48.452380 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf13b3-9f99-450f-86cc-0c862457e2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:48.452661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf13b3-9f99-450f-86cc-0c862457e2af admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:48.453426 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf13b3-9f99-450f-86cc-0c862457e2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:48.455089 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf13b3-9f99-450f-86cc-0c862457e2af admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:48.469283 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1119/2220] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:48.469283 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf13b3-9f99-450f-86cc-0c862457e2af admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:48.477669 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf13b3-9f99-450f-86cc-0c862457e2af admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:48.483268 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5062fe-f17d-4c0d-b056-6c2bde1cba42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:48.483925 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5062fe-f17d-4c0d-b056-6c2bde1cba42 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:48.484245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5062fe-f17d-4c0d-b056-6c2bde1cba42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:48.484481 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52600604-5bc9-4867-8905-0ddaecd865c4 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:48.484918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5062fe-f17d-4c0d-b056-6c2bde1cba42 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:48.485206 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5062fe-f17d-4c0d-b056-6c2bde1cba42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:48.487122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5062fe-f17d-4c0d-b056-6c2bde1cba42 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:48.490057 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0847f-19e8-42ef-a7f8-fa40079c649a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:48.490720 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0847f-19e8-42ef-a7f8-fa40079c649a admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:48.491002 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0847f-19e8-42ef-a7f8-fa40079c649a admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:48.491276 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0847f-19e8-42ef-a7f8-fa40079c649a admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:48.492014 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0847f-19e8-42ef-a7f8-fa40079c649a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:48.493644 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0847f-19e8-42ef-a7f8-fa40079c649a admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:48.507344 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1102/2221] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:48.507344 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0847f-19e8-42ef-a7f8-fa40079c649a admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:48.515671 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0847f-19e8-42ef-a7f8-fa40079c649a admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:48.520540 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e308d27-2984-4f61-947b-e560baefd6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:48.521276 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e308d27-2984-4f61-947b-e560baefd6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:48.521562 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e308d27-2984-4f61-947b-e560baefd6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:48.521850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e308d27-2984-4f61-947b-e560baefd6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:48.523901 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e308d27-2984-4f61-947b-e560baefd6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:48.525555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e308d27-2984-4f61-947b-e560baefd6c4 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:48.539849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1103/2222] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:48.539849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e308d27-2984-4f61-947b-e560baefd6c4 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:48.549835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e308d27-2984-4f61-947b-e560baefd6c4 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:48.554556 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f2654-9b79-4d53-8298-e09100fe3343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:48.555222 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f2654-9b79-4d53-8298-e09100fe3343 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:48.555510 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f2654-9b79-4d53-8298-e09100fe3343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:48.555786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f2654-9b79-4d53-8298-e09100fe3343 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:48.556556 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f2654-9b79-4d53-8298-e09100fe3343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:48.558159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f2654-9b79-4d53-8298-e09100fe3343 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:48.569600 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1104/2223] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:48.570519 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f2654-9b79-4d53-8298-e09100fe3343 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:48.575940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1120/2224] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:48 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:48.575940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5062fe-f17d-4c0d-b056-6c2bde1cba42 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:48.580635 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-1b5062fe-f17d-4c0d-b056-6c2bde1cba42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:48.587347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f2654-9b79-4d53-8298-e09100fe3343 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:48.593692 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620ed3a-60cf-4e04-88a8-254466ac212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:48.593873 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5062fe-f17d-4c0d-b056-6c2bde1cba42 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:48.594584 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620ed3a-60cf-4e04-88a8-254466ac212c admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:48.594862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620ed3a-60cf-4e04-88a8-254466ac212c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:48.595142 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620ed3a-60cf-4e04-88a8-254466ac212c admin admin] PATH_INFO: `/v3/projects/0cdd096da8704dd3bc211b07e7f1f27e/users/7c35fb18d4f44f26a6a0939503da0b0e/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:48.598950 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:48.602973 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6f1dc-edc4-4635-a399-dc3887ba10df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:48.602973 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6f1dc-edc4-4635-a399-dc3887ba10df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:48.602973 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6f1dc-edc4-4635-a399-dc3887ba10df admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:48.603415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6f1dc-edc4-4635-a399-dc3887ba10df admin admin] PATH_INFO: `/v3/users/ca5171ef18034c6f922eaee7c8cd4f05` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:48.604798 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6f1dc-edc4-4635-a399-dc3887ba10df admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca5171ef18034c6f922eaee7c8cd4f05)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:48.608275 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6f1dc-edc4-4635-a399-dc3887ba10df admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:48.613155 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620ed3a-60cf-4e04-88a8-254466ac212c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cdd096da8704dd3bc211b07e7f1f27e, user_id=7c35fb18d4f44f26a6a0939503da0b0e, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:48.615855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620ed3a-60cf-4e04-88a8-254466ac212c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:48.717705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1105/2225] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:48 2022] PUT /identity/v3/projects/0cdd096da8704dd3bc211b07e7f1f27e/users/7c35fb18d4f44f26a6a0939503da0b0e/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:48.719927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620ed3a-60cf-4e04-88a8-254466ac212c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:48.747521 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:48.800118 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620ed3a-60cf-4e04-88a8-254466ac212c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:48.804868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e958d9-2187-4178-b5c5-24e2f8b8c46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:48.805796 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e958d9-2187-4178-b5c5-24e2f8b8c46d admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:48.806277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e958d9-2187-4178-b5c5-24e2f8b8c46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:48.806564 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e958d9-2187-4178-b5c5-24e2f8b8c46d admin admin] PATH_INFO: `/v3/projects/4bef742f013d43baa1bb8c9130d2021a/users/3ca17fbe932a47d48f3bee3fa6a2f559/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:48.821429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e958d9-2187-4178-b5c5-24e2f8b8c46d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bef742f013d43baa1bb8c9130d2021a, user_id=3ca17fbe932a47d48f3bee3fa6a2f559, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:48.824186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e958d9-2187-4178-b5c5-24e2f8b8c46d admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:48.891933 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-f9f6f1dc-edc4-4635-a399-dc3887ba10df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca5171ef18034c6f922eaee7c8cd4f05'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:48.898682 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-f9f6f1dc-edc4-4635-a399-dc3887ba10df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca5171ef18034c6f922eaee7c8cd4f05'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:48.899356 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-f9f6f1dc-edc4-4635-a399-dc3887ba10df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca5171ef18034c6f922eaee7c8cd4f05'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:48.912223 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-f9f6f1dc-edc4-4635-a399-dc3887ba10df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca5171ef18034c6f922eaee7c8cd4f05'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:48.912912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-f9f6f1dc-edc4-4635-a399-dc3887ba10df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca5171ef18034c6f922eaee7c8cd4f05'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:48.918911 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1106/2226] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:48 2022] PUT /identity/v3/projects/4bef742f013d43baa1bb8c9130d2021a/users/3ca17fbe932a47d48f3bee3fa6a2f559/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:48.921795 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e958d9-2187-4178-b5c5-24e2f8b8c46d admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:48.928220 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-c3e958d9-2187-4178-b5c5-24e2f8b8c46d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:49.004650 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e958d9-2187-4178-b5c5-24e2f8b8c46d admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:49.010355 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea48e4c-e4ce-4a27-a96d-4c58f28e65d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:49.011246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea48e4c-e4ce-4a27-a96d-4c58f28e65d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:49.011457 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea48e4c-e4ce-4a27-a96d-4c58f28e65d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:49.011787 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea48e4c-e4ce-4a27-a96d-4c58f28e65d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:49.013164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea48e4c-e4ce-4a27-a96d-4c58f28e65d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:49.014791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea48e4c-e4ce-4a27-a96d-4c58f28e65d0 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:49.015671 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1121/2227] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:48 2022] DELETE /identity/v3/users/ca5171ef18034c6f922eaee7c8cd4f05 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:49.017212 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9573113-2b3f-4986-89ab-0df62fefe66d None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:49.017562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9573113-2b3f-4986-89ab-0df62fefe66d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:49.017902 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9573113-2b3f-4986-89ab-0df62fefe66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:49.027301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1107/2228] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:49.029113 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3998f50-da66-44ff-a862-7d6d5de5785f None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:49.029113 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3998f50-da66-44ff-a862-7d6d5de5785f None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:49.029317 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3998f50-da66-44ff-a862-7d6d5de5785f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:49.044657 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-e9573113-2b3f-4986-89ab-0df62fefe66d None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:49.046159 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e9573113-2b3f-4986-89ab-0df62fefe66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:49.063115 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-d3998f50-da66-44ff-a862-7d6d5de5785f None None] MFA Rules not processed for user `3ca17fbe932a47d48f3bee3fa6a2f559`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:49.064367 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-d3998f50-da66-44ff-a862-7d6d5de5785f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:49.121919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1122/2229] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:49.123410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74d92a-e07a-488e-8634-c456c588dab1 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:49.123755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74d92a-e07a-488e-8634-c456c588dab1 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:49.124092 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74d92a-e07a-488e-8634-c456c588dab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:49.138654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1108/2230] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:49.139618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3998f50-da66-44ff-a862-7d6d5de5785f None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:49.158121 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3998f50-da66-44ff-a862-7d6d5de5785f None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:49.158330 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-1c74d92a-e07a-488e-8634-c456c588dab1 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:49.159641 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-1c74d92a-e07a-488e-8634-c456c588dab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:49.166500 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7915a2-eed7-47ee-97dd-a7c5e72ca138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:49.167273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7915a2-eed7-47ee-97dd-a7c5e72ca138 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:49.167659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7915a2-eed7-47ee-97dd-a7c5e72ca138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:49.168002 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7915a2-eed7-47ee-97dd-a7c5e72ca138 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:49.169011 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7915a2-eed7-47ee-97dd-a7c5e72ca138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:49.170866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1123/2231] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:49.170999 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7915a2-eed7-47ee-97dd-a7c5e72ca138 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:49.171946 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74d92a-e07a-488e-8634-c456c588dab1 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:49.173176 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-1c74d92a-e07a-488e-8634-c456c588dab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:49.194294 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1109/2232] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:49.194294 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7915a2-eed7-47ee-97dd-a7c5e72ca138 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:49.194294 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0c7915a2-eed7-47ee-97dd-a7c5e72ca138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:49.208941 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7915a2-eed7-47ee-97dd-a7c5e72ca138 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:49.221076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d7375-f5e8-4236-ac4f-f06d4ae7ff86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:49.221076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d7375-f5e8-4236-ac4f-f06d4ae7ff86 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:49.221076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d7375-f5e8-4236-ac4f-f06d4ae7ff86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:49.221076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d7375-f5e8-4236-ac4f-f06d4ae7ff86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:49.221562 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d7375-f5e8-4236-ac4f-f06d4ae7ff86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:49.221562 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d7375-f5e8-4236-ac4f-f06d4ae7ff86 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:49.265972 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74d92a-e07a-488e-8634-c456c588dab1 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:49.271677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b40be-82c3-4c30-9198-f7d877925a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:49.279332 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b40be-82c3-4c30-9198-f7d877925a00 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:49.279332 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b40be-82c3-4c30-9198-f7d877925a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:49.279332 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b40be-82c3-4c30-9198-f7d877925a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:49.289552 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b40be-82c3-4c30-9198-f7d877925a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:49.292136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b40be-82c3-4c30-9198-f7d877925a00 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:49.308440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1124/2233] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:00:49.312968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b40be-82c3-4c30-9198-f7d877925a00 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:49.319537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b40be-82c3-4c30-9198-f7d877925a00 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:49.324194 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e948ac-7645-457f-a7ea-cceb960bc394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:49.325614 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e948ac-7645-457f-a7ea-cceb960bc394 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:49.326084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e948ac-7645-457f-a7ea-cceb960bc394 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:49.326388 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e948ac-7645-457f-a7ea-cceb960bc394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:49.340063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e948ac-7645-457f-a7ea-cceb960bc394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:49.348034 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1110/2234] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:49 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:49.348190 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e948ac-7645-457f-a7ea-cceb960bc394 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:49.348280 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d7375-f5e8-4236-ac4f-f06d4ae7ff86 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:49.354838 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1125/2235] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:00:49.355840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e948ac-7645-457f-a7ea-cceb960bc394 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:49.366489 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e948ac-7645-457f-a7ea-cceb960bc394 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:49.416857 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d7375-f5e8-4236-ac4f-f06d4ae7ff86 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:49.438851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3d136-f7ca-4d80-88ff-67600f029fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:49.439771 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3d136-f7ca-4d80-88ff-67600f029fdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:49.441059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3d136-f7ca-4d80-88ff-67600f029fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:49.441359 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3d136-f7ca-4d80-88ff-67600f029fdf admin admin] PATH_INFO: `/v3/projects/5c1d98639af64f48966a2ba8d171895c/users/bf248c9dc99d4ee9a9fe20ef65be5c02/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:49.464533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3d136-f7ca-4d80-88ff-67600f029fdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1d98639af64f48966a2ba8d171895c, user_id=bf248c9dc99d4ee9a9fe20ef65be5c02, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:49.467758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3d136-f7ca-4d80-88ff-67600f029fdf admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:49.470425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da5143-eb81-4535-ab8c-e90d5f11eb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:49.471645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da5143-eb81-4535-ab8c-e90d5f11eb49 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:49.471645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da5143-eb81-4535-ab8c-e90d5f11eb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:49.471817 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da5143-eb81-4535-ab8c-e90d5f11eb49 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:49.472545 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da5143-eb81-4535-ab8c-e90d5f11eb49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:49.474535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da5143-eb81-4535-ab8c-e90d5f11eb49 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:49.587200 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1111/2236] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:49 2022] PUT /identity/v3/projects/5c1d98639af64f48966a2ba8d171895c/users/bf248c9dc99d4ee9a9fe20ef65be5c02/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:49.597636 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3dfe3-2d36-4684-891c-2109c7c70e9e None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:49.598179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3dfe3-2d36-4684-891c-2109c7c70e9e None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:49.598629 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3dfe3-2d36-4684-891c-2109c7c70e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:49.614504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1126/2237] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:49 2022] POST /identity/v3/users => generated 296 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:49.618688 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da5143-eb81-4535-ab8c-e90d5f11eb49 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:49.632609 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da5143-eb81-4535-ab8c-e90d5f11eb49 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:49.641564 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-14d3dfe3-2d36-4684-891c-2109c7c70e9e None None] MFA Rules not processed for user `bf248c9dc99d4ee9a9fe20ef65be5c02`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:49.642862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-14d3dfe3-2d36-4684-891c-2109c7c70e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:49.728971 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58ce7e-c30e-414f-bccc-1a546cf187be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:49.734412 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58ce7e-c30e-414f-bccc-1a546cf187be admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:49.734412 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58ce7e-c30e-414f-bccc-1a546cf187be admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:49.734412 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58ce7e-c30e-414f-bccc-1a546cf187be admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:49.734412 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58ce7e-c30e-414f-bccc-1a546cf187be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:49.736834 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58ce7e-c30e-414f-bccc-1a546cf187be admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:49.749821 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1112/2238] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:00:49.759593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1127/2239] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:49.762042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3dfe3-2d36-4684-891c-2109c7c70e9e None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:49.765178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-14d3dfe3-2d36-4684-891c-2109c7c70e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:49.767529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58ce7e-c30e-414f-bccc-1a546cf187be admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:49.781752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58ce7e-c30e-414f-bccc-1a546cf187be admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:49.794493 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdeddbe-1688-485e-8ad5-248d44378bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:49.796081 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdeddbe-1688-485e-8ad5-248d44378bee admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:49.796666 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdeddbe-1688-485e-8ad5-248d44378bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:49.797507 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdeddbe-1688-485e-8ad5-248d44378bee admin admin] PATH_INFO: `/v3/projects/2f5290acc6af4ddba95e1d0ab67e9898/users/8897f174b1604df8a87e0c2b8fb13251/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:49.821903 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdeddbe-1688-485e-8ad5-248d44378bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5290acc6af4ddba95e1d0ab67e9898, user_id=8897f174b1604df8a87e0c2b8fb13251, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:49.826426 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdeddbe-1688-485e-8ad5-248d44378bee admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:49.848701 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3dfe3-2d36-4684-891c-2109c7c70e9e None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:49.854957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6064f3-ab32-4452-81ca-632d75b1e69c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:49.854957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6064f3-ab32-4452-81ca-632d75b1e69c service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:49.854957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6064f3-ab32-4452-81ca-632d75b1e69c service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:49.854957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6064f3-ab32-4452-81ca-632d75b1e69c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:49.865525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6064f3-ab32-4452-81ca-632d75b1e69c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:49.867347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6064f3-ab32-4452-81ca-632d75b1e69c service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:49.874367 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:49.880334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1113/2240] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:00:49.934168 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1128/2241] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:49 2022] PUT /identity/v3/projects/2f5290acc6af4ddba95e1d0ab67e9898/users/8897f174b1604df8a87e0c2b8fb13251/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:49.938929 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6064f3-ab32-4452-81ca-632d75b1e69c service cinder] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:49.951649 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6064f3-ab32-4452-81ca-632d75b1e69c service cinder] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:50.017177 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1937a22-5bb9-4fff-a6ff-85e6b9ca43f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:50.018115 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1937a22-5bb9-4fff-a6ff-85e6b9ca43f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:50.018409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1937a22-5bb9-4fff-a6ff-85e6b9ca43f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:50.019315 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1937a22-5bb9-4fff-a6ff-85e6b9ca43f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:50.019460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1937a22-5bb9-4fff-a6ff-85e6b9ca43f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:50.022412 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1937a22-5bb9-4fff-a6ff-85e6b9ca43f8 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:50.038829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1114/2242] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:50.041795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdeddbe-1688-485e-8ad5-248d44378bee admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:50.056766 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdeddbe-1688-485e-8ad5-248d44378bee admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:50.070847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e6915-b083-4fa6-ba79-2b1142b53e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:50.074063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e6915-b083-4fa6-ba79-2b1142b53e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:50.074063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e6915-b083-4fa6-ba79-2b1142b53e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:50.074063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e6915-b083-4fa6-ba79-2b1142b53e3d admin admin] PATH_INFO: `/v3/projects/2f5290acc6af4ddba95e1d0ab67e9898/users/8897f174b1604df8a87e0c2b8fb13251/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:50.075451 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1937a22-5bb9-4fff-a6ff-85e6b9ca43f8 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:50.078485 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e6915-b083-4fa6-ba79-2b1142b53e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5290acc6af4ddba95e1d0ab67e9898, user_id=8897f174b1604df8a87e0c2b8fb13251, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:50.079302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-a1937a22-5bb9-4fff-a6ff-85e6b9ca43f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:50.081804 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e6915-b083-4fa6-ba79-2b1142b53e3d admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:50.097951 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1129/2243] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:50 2022] PUT /identity/v3/projects/2f5290acc6af4ddba95e1d0ab67e9898/users/8897f174b1604df8a87e0c2b8fb13251/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:50.110537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7cbce-da5b-49d3-be7f-a0e8e4fde9f8 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:50.111639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7cbce-da5b-49d3-be7f-a0e8e4fde9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:50.112071 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7cbce-da5b-49d3-be7f-a0e8e4fde9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:50.128129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1937a22-5bb9-4fff-a6ff-85e6b9ca43f8 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:50.174093 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-9fc7cbce-da5b-49d3-be7f-a0e8e4fde9f8 None None] MFA Rules not processed for user `8897f174b1604df8a87e0c2b8fb13251`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:50.175276 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-9fc7cbce-da5b-49d3-be7f-a0e8e4fde9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:50.224412 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e96403-6739-4a67-a0ae-5c5ca3e9ebef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:50.225293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e96403-6739-4a67-a0ae-5c5ca3e9ebef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:50.225570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e96403-6739-4a67-a0ae-5c5ca3e9ebef admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:50.225847 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e96403-6739-4a67-a0ae-5c5ca3e9ebef admin admin] PATH_INFO: `/v3/projects/d2e54332e64e45a6b7989ed8b98f21ed` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:50.228495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e96403-6739-4a67-a0ae-5c5ca3e9ebef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e54332e64e45a6b7989ed8b98f21ed)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:50.230446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e96403-6739-4a67-a0ae-5c5ca3e9ebef admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:50.311587 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1130/2244] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:50.324202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7cbce-da5b-49d3-be7f-a0e8e4fde9f8 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:50.326225 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-9fc7cbce-da5b-49d3-be7f-a0e8e4fde9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:50.362065 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-36e96403-6739-4a67-a0ae-5c5ca3e9ebef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e54332e64e45a6b7989ed8b98f21ed', 'request_id': 'req-36e96403-6739-4a67-a0ae-5c5ca3e9ebef'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:50.377428 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:50.393766 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7cbce-da5b-49d3-be7f-a0e8e4fde9f8 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:50.462911 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08136aef-b15a-436a-b925-ff0481f132cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:50.463843 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08136aef-b15a-436a-b925-ff0481f132cc service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:50.464313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08136aef-b15a-436a-b925-ff0481f132cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:50.464664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08136aef-b15a-436a-b925-ff0481f132cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:50.499099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-36e96403-6739-4a67-a0ae-5c5ca3e9ebef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e54332e64e45a6b7989ed8b98f21ed', 'request_id': 'req-36e96403-6739-4a67-a0ae-5c5ca3e9ebef'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:50.505671 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-36e96403-6739-4a67-a0ae-5c5ca3e9ebef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e54332e64e45a6b7989ed8b98f21ed', 'request_id': 'req-36e96403-6739-4a67-a0ae-5c5ca3e9ebef'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:50.523639 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-36e96403-6739-4a67-a0ae-5c5ca3e9ebef admin admin] The token cache is being invalidate because project d2e54332e64e45a6b7989ed8b98f21ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:50.524203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-36e96403-6739-4a67-a0ae-5c5ca3e9ebef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:50.525061 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-36e96403-6739-4a67-a0ae-5c5ca3e9ebef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:50.527451 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1115/2245] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:50 2022] DELETE /identity/v3/projects/d2e54332e64e45a6b7989ed8b98f21ed => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:50.531483 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e96403-6739-4a67-a0ae-5c5ca3e9ebef admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:50.533226 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-36e96403-6739-4a67-a0ae-5c5ca3e9ebef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:50.549211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08136aef-b15a-436a-b925-ff0481f132cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:50.550680 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08136aef-b15a-436a-b925-ff0481f132cc service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:50.564329 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1131/2246] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:00:50.613013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e96403-6739-4a67-a0ae-5c5ca3e9ebef admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:50.620281 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1e7ca-808f-44f7-ad24-226465a70c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:50.622143 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1e7ca-808f-44f7-ad24-226465a70c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:50.622731 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1e7ca-808f-44f7-ad24-226465a70c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:50.623147 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1e7ca-808f-44f7-ad24-226465a70c64 admin admin] PATH_INFO: `/v3/users/e77acc1594ae43d099a7d11abf5a7f2e` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:50.624694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1e7ca-808f-44f7-ad24-226465a70c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e77acc1594ae43d099a7d11abf5a7f2e)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:50.627010 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1e7ca-808f-44f7-ad24-226465a70c64 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:50.697993 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08136aef-b15a-436a-b925-ff0481f132cc service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:50.699412 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-08136aef-b15a-436a-b925-ff0481f132cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:50.718866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08136aef-b15a-436a-b925-ff0481f132cc service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:50.723882 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddefa5-7b00-47d6-be0a-026a8025d09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:50.724832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddefa5-7b00-47d6-be0a-026a8025d09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:50.725168 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddefa5-7b00-47d6-be0a-026a8025d09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:50.725445 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddefa5-7b00-47d6-be0a-026a8025d09c admin admin] PATH_INFO: `/v3/users/09bf47f5279a4020a9986f2591b97e7d` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:50.727976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddefa5-7b00-47d6-be0a-026a8025d09c admin admin] RBAC: Authorizing `identity:delete_user(user_id=09bf47f5279a4020a9986f2591b97e7d)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:50.729978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddefa5-7b00-47d6-be0a-026a8025d09c admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:50.905272 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-99c1e7ca-808f-44f7-ad24-226465a70c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e77acc1594ae43d099a7d11abf5a7f2e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:50.905939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-99c1e7ca-808f-44f7-ad24-226465a70c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e77acc1594ae43d099a7d11abf5a7f2e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:50.933200 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-edddefa5-7b00-47d6-be0a-026a8025d09c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09bf47f5279a4020a9986f2591b97e7d'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:50.956421 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-edddefa5-7b00-47d6-be0a-026a8025d09c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09bf47f5279a4020a9986f2591b97e7d'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:50.957602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-edddefa5-7b00-47d6-be0a-026a8025d09c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09bf47f5279a4020a9986f2591b97e7d'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:50.986865 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-edddefa5-7b00-47d6-be0a-026a8025d09c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09bf47f5279a4020a9986f2591b97e7d'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:50.987637 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-edddefa5-7b00-47d6-be0a-026a8025d09c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09bf47f5279a4020a9986f2591b97e7d'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:51.009946 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-99c1e7ca-808f-44f7-ad24-226465a70c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e77acc1594ae43d099a7d11abf5a7f2e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:51.010576 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-99c1e7ca-808f-44f7-ad24-226465a70c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e77acc1594ae43d099a7d11abf5a7f2e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:51.024850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-99c1e7ca-808f-44f7-ad24-226465a70c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e77acc1594ae43d099a7d11abf5a7f2e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:51.038200 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1116/2247] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:50 2022] DELETE /identity/v3/users/e77acc1594ae43d099a7d11abf5a7f2e => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:00:51.040287 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1e7ca-808f-44f7-ad24-226465a70c64 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:51.040287 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-99c1e7ca-808f-44f7-ad24-226465a70c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:51.104163 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1e7ca-808f-44f7-ad24-226465a70c64 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:51.113457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1132/2248] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:50 2022] DELETE /identity/v3/users/09bf47f5279a4020a9986f2591b97e7d => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:51.115612 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d305a-d427-44f4-8bb2-42c64b023e50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:51.116682 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d305a-d427-44f4-8bb2-42c64b023e50 service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:51.116682 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d305a-d427-44f4-8bb2-42c64b023e50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:51.116888 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d305a-d427-44f4-8bb2-42c64b023e50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:51.118383 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c47ae-af81-44ad-9316-2cabab338427 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:51.119135 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c47ae-af81-44ad-9316-2cabab338427 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:51.119135 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c47ae-af81-44ad-9316-2cabab338427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:51.124976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-599d305a-d427-44f4-8bb2-42c64b023e50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:51.150272 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-d29c47ae-af81-44ad-9316-2cabab338427 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:51.152871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d29c47ae-af81-44ad-9316-2cabab338427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:51.202984 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d305a-d427-44f4-8bb2-42c64b023e50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:51.204856 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d305a-d427-44f4-8bb2-42c64b023e50 service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:51.215086 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1117/2249] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:00:51.246044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1133/2250] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:51.256633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d305a-d427-44f4-8bb2-42c64b023e50 service cinder] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:51.258742 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-599d305a-d427-44f4-8bb2-42c64b023e50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:51.345045 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d305a-d427-44f4-8bb2-42c64b023e50 service cinder] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:51.399776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201c5b8-9b5f-4646-8f09-68729e5d3874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:51.400575 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201c5b8-9b5f-4646-8f09-68729e5d3874 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:51.400930 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201c5b8-9b5f-4646-8f09-68729e5d3874 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:51.401220 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201c5b8-9b5f-4646-8f09-68729e5d3874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:51.414756 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201c5b8-9b5f-4646-8f09-68729e5d3874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:51.416412 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201c5b8-9b5f-4646-8f09-68729e5d3874 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:51.435588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1118/2251] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:00:51.712668 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c47ae-af81-44ad-9316-2cabab338427 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:51.718126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d29c47ae-af81-44ad-9316-2cabab338427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:51.734376 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c47ae-af81-44ad-9316-2cabab338427 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:51.740765 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245bbcb-4a23-414b-885b-08f8e2cb51a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:51.741847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245bbcb-4a23-414b-885b-08f8e2cb51a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:51.742192 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245bbcb-4a23-414b-885b-08f8e2cb51a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:51.742552 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245bbcb-4a23-414b-885b-08f8e2cb51a0 admin admin] PATH_INFO: `/v3/projects/15a1d91113a9453994a766470cc4e510` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:51.743943 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245bbcb-4a23-414b-885b-08f8e2cb51a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a1d91113a9453994a766470cc4e510)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:51.746237 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245bbcb-4a23-414b-885b-08f8e2cb51a0 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:51.893789 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-9245bbcb-4a23-414b-885b-08f8e2cb51a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a1d91113a9453994a766470cc4e510', 'request_id': 'req-9245bbcb-4a23-414b-885b-08f8e2cb51a0'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:51.973245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-9245bbcb-4a23-414b-885b-08f8e2cb51a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a1d91113a9453994a766470cc4e510', 'request_id': 'req-9245bbcb-4a23-414b-885b-08f8e2cb51a0'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:51.985814 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-9245bbcb-4a23-414b-885b-08f8e2cb51a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a1d91113a9453994a766470cc4e510', 'request_id': 'req-9245bbcb-4a23-414b-885b-08f8e2cb51a0'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:52.017384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-9245bbcb-4a23-414b-885b-08f8e2cb51a0 admin admin] The token cache is being invalidate because project 15a1d91113a9453994a766470cc4e510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:52.017677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-9245bbcb-4a23-414b-885b-08f8e2cb51a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:52.019945 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-9245bbcb-4a23-414b-885b-08f8e2cb51a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:52.025339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1134/2252] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:51 2022] DELETE /identity/v3/projects/15a1d91113a9453994a766470cc4e510 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:52.030789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c986e7-d050-49d1-815e-f9518a51afdd None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:52.034276 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c986e7-d050-49d1-815e-f9518a51afdd None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:52.034276 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c986e7-d050-49d1-815e-f9518a51afdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:52.055427 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-a9c986e7-d050-49d1-815e-f9518a51afdd None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:52.057096 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-a9c986e7-d050-49d1-815e-f9518a51afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:52.096780 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245bbcb-4a23-414b-885b-08f8e2cb51a0 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:52.098387 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-9245bbcb-4a23-414b-885b-08f8e2cb51a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:52.135437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:52.178770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1119/2253] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:52.187352 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e315bb3-9a98-4cc0-b757-4a8451b17646 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:52.187646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e315bb3-9a98-4cc0-b757-4a8451b17646 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:52.188147 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e315bb3-9a98-4cc0-b757-4a8451b17646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:52.194384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245bbcb-4a23-414b-885b-08f8e2cb51a0 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:52.199728 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38901ab6-6591-4c00-8c13-740f18562c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:52.200706 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38901ab6-6591-4c00-8c13-740f18562c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:52.201058 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38901ab6-6591-4c00-8c13-740f18562c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:52.201405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38901ab6-6591-4c00-8c13-740f18562c6b admin admin] PATH_INFO: `/v3/projects/a001e3dc0f254a94881fb5be215106b2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:52.202684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38901ab6-6591-4c00-8c13-740f18562c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a001e3dc0f254a94881fb5be215106b2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:52.204774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38901ab6-6591-4c00-8c13-740f18562c6b admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:52.206698 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-6e315bb3-9a98-4cc0-b757-4a8451b17646 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:52.207902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6e315bb3-9a98-4cc0-b757-4a8451b17646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:52.219499 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1120/2254] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:00:52.222345 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e315bb3-9a98-4cc0-b757-4a8451b17646 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:52.234371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e315bb3-9a98-4cc0-b757-4a8451b17646 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:52.239152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da44caa-549d-4115-968a-e42b1c519020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:52.247409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da44caa-549d-4115-968a-e42b1c519020 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:52.248084 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da44caa-549d-4115-968a-e42b1c519020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:52.248084 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da44caa-549d-4115-968a-e42b1c519020 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:52.252574 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da44caa-549d-4115-968a-e42b1c519020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:00:52.252969 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da44caa-549d-4115-968a-e42b1c519020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:52.255021 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da44caa-549d-4115-968a-e42b1c519020 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:52.273316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1121/2255] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 17:00:52.275365 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da44caa-549d-4115-968a-e42b1c519020 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:52.288161 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da44caa-549d-4115-968a-e42b1c519020 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:52.298410 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2176586-7b7c-4ed1-98e4-c8951a47580a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:52.300446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2176586-7b7c-4ed1-98e4-c8951a47580a admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:52.301211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2176586-7b7c-4ed1-98e4-c8951a47580a admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:52.301582 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2176586-7b7c-4ed1-98e4-c8951a47580a admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:52.302346 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2176586-7b7c-4ed1-98e4-c8951a47580a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:52.305093 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2176586-7b7c-4ed1-98e4-c8951a47580a admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:52.360564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:52.364175 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-38901ab6-6591-4c00-8c13-740f18562c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a001e3dc0f254a94881fb5be215106b2', 'request_id': 'req-38901ab6-6591-4c00-8c13-740f18562c6b'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:52.405120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1122/2256] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:52 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:00:52.409395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2176586-7b7c-4ed1-98e4-c8951a47580a admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:52.453085 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-38901ab6-6591-4c00-8c13-740f18562c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a001e3dc0f254a94881fb5be215106b2', 'request_id': 'req-38901ab6-6591-4c00-8c13-740f18562c6b'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:52.460329 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-38901ab6-6591-4c00-8c13-740f18562c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a001e3dc0f254a94881fb5be215106b2', 'request_id': 'req-38901ab6-6591-4c00-8c13-740f18562c6b'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:52.472420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-38901ab6-6591-4c00-8c13-740f18562c6b admin admin] The token cache is being invalidate because project a001e3dc0f254a94881fb5be215106b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:52.472713 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-38901ab6-6591-4c00-8c13-740f18562c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:52.473403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-38901ab6-6591-4c00-8c13-740f18562c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:52.475264 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1135/2257] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:52 2022] DELETE /identity/v3/projects/a001e3dc0f254a94881fb5be215106b2 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:00:52.481325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38901ab6-6591-4c00-8c13-740f18562c6b admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:52.482543 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-38901ab6-6591-4c00-8c13-740f18562c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:52.485478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2176586-7b7c-4ed1-98e4-c8951a47580a admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:52.492932 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f462e48-d6c1-4931-9167-816da2166839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:52.493897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f462e48-d6c1-4931-9167-816da2166839 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:52.494374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f462e48-d6c1-4931-9167-816da2166839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:52.494910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f462e48-d6c1-4931-9167-816da2166839 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:52.495968 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f462e48-d6c1-4931-9167-816da2166839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:52.498053 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f462e48-d6c1-4931-9167-816da2166839 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:52.610491 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38901ab6-6591-4c00-8c13-740f18562c6b admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:52.611161 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1123/2258] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:52 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:52.617709 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5ed80-d880-4ee3-ba1a-da9730d35846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:52.618810 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5ed80-d880-4ee3-ba1a-da9730d35846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:52.619173 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5ed80-d880-4ee3-ba1a-da9730d35846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:52.619549 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5ed80-d880-4ee3-ba1a-da9730d35846 admin admin] PATH_INFO: `/v3/users/bd514f11c3bb479f962b6ef6729a4bd1` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:52.620771 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f462e48-d6c1-4931-9167-816da2166839 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:52.621515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5ed80-d880-4ee3-ba1a-da9730d35846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd514f11c3bb479f962b6ef6729a4bd1)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:52.623705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-5f462e48-d6c1-4931-9167-816da2166839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:52.623833 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5ed80-d880-4ee3-ba1a-da9730d35846 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:52.638743 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f462e48-d6c1-4931-9167-816da2166839 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:52.643857 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3003a62-b5f6-4f96-8503-ea913eece160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:52.644871 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3003a62-b5f6-4f96-8503-ea913eece160 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:52.645367 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3003a62-b5f6-4f96-8503-ea913eece160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:52.645788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3003a62-b5f6-4f96-8503-ea913eece160 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:52.646874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3003a62-b5f6-4f96-8503-ea913eece160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:52.648933 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3003a62-b5f6-4f96-8503-ea913eece160 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:52.662192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1124/2259] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:52.667171 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3003a62-b5f6-4f96-8503-ea913eece160 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:52.686924 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3003a62-b5f6-4f96-8503-ea913eece160 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:52.693376 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7587f80-3834-4a2e-8e13-a74f879a825e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:52.696923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7587f80-3834-4a2e-8e13-a74f879a825e admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:52.696923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7587f80-3834-4a2e-8e13-a74f879a825e admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:52.696923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7587f80-3834-4a2e-8e13-a74f879a825e admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:52.696923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7587f80-3834-4a2e-8e13-a74f879a825e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:52.697941 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7587f80-3834-4a2e-8e13-a74f879a825e admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:52.712157 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1125/2260] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:00:52.713696 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7587f80-3834-4a2e-8e13-a74f879a825e admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:52.724795 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7587f80-3834-4a2e-8e13-a74f879a825e admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:52.729748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fb183-7834-46c7-9812-88e7ea37d4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:52.731356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fb183-7834-46c7-9812-88e7ea37d4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:52.731356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fb183-7834-46c7-9812-88e7ea37d4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:52.731356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fb183-7834-46c7-9812-88e7ea37d4e4 admin admin] PATH_INFO: `/v3/projects/82fa3809cfe34e3692ff07d682d41bfe/users/f7131884e2744bd79e3f0b4ff87256d3/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:52.746014 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0fb183-7834-46c7-9812-88e7ea37d4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82fa3809cfe34e3692ff07d682d41bfe, user_id=f7131884e2744bd79e3f0b4ff87256d3, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:52.749979 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0fb183-7834-46c7-9812-88e7ea37d4e4 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:52.840127 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-9db5ed80-d880-4ee3-ba1a-da9730d35846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd514f11c3bb479f962b6ef6729a4bd1'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:52.846987 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-9db5ed80-d880-4ee3-ba1a-da9730d35846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd514f11c3bb479f962b6ef6729a4bd1'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:52.847738 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-9db5ed80-d880-4ee3-ba1a-da9730d35846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd514f11c3bb479f962b6ef6729a4bd1'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:52.865309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-9db5ed80-d880-4ee3-ba1a-da9730d35846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd514f11c3bb479f962b6ef6729a4bd1'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:52.866302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-9db5ed80-d880-4ee3-ba1a-da9730d35846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd514f11c3bb479f962b6ef6729a4bd1'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:52.876278 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1126/2261] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:52 2022] PUT /identity/v3/projects/82fa3809cfe34e3692ff07d682d41bfe/users/f7131884e2744bd79e3f0b4ff87256d3/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:00:52.878099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813a142-3297-483a-b758-0ab0620de350 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:52.878401 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813a142-3297-483a-b758-0ab0620de350 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:52.878686 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813a142-3297-483a-b758-0ab0620de350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:52.910277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-b813a142-3297-483a-b758-0ab0620de350 None None] MFA Rules not processed for user `f7131884e2744bd79e3f0b4ff87256d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:52.911570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b813a142-3297-483a-b758-0ab0620de350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:52.937360 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1136/2262] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:52 2022] DELETE /identity/v3/users/bd514f11c3bb479f962b6ef6729a4bd1 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:52.987276 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1127/2263] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:52.988644 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5ed80-d880-4ee3-ba1a-da9730d35846 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:52.990381 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-9db5ed80-d880-4ee3-ba1a-da9730d35846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:53.026270 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298ad62-54f9-49cf-ac03-e4b37fd6ea7c None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:53.026587 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298ad62-54f9-49cf-ac03-e4b37fd6ea7c None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:53.026841 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298ad62-54f9-49cf-ac03-e4b37fd6ea7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:53.056005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-f298ad62-54f9-49cf-ac03-e4b37fd6ea7c None None] MFA Rules not processed for user `bf248c9dc99d4ee9a9fe20ef65be5c02`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:53.062080 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-f298ad62-54f9-49cf-ac03-e4b37fd6ea7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:53.125204 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5ed80-d880-4ee3-ba1a-da9730d35846 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:53.131414 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee7a4c-3673-4bc9-a0e6-fc4c036bfd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:53.132168 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee7a4c-3673-4bc9-a0e6-fc4c036bfd5f admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:53.132452 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee7a4c-3673-4bc9-a0e6-fc4c036bfd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:53.133013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee7a4c-3673-4bc9-a0e6-fc4c036bfd5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:53.133877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee7a4c-3673-4bc9-a0e6-fc4c036bfd5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:53.135990 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee7a4c-3673-4bc9-a0e6-fc4c036bfd5f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:53.141553 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1128/2264] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:53.273146 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1137/2265] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:52 2022] POST /identity/v3/projects => generated 387 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:53.273340 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298ad62-54f9-49cf-ac03-e4b37fd6ea7c None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:53.293251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298ad62-54f9-49cf-ac03-e4b37fd6ea7c None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:53.386177 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744eac8e-aa0f-4553-b7ab-211fe54d400e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:53.387242 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744eac8e-aa0f-4553-b7ab-211fe54d400e admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:53.387594 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744eac8e-aa0f-4553-b7ab-211fe54d400e admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:53.388688 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744eac8e-aa0f-4553-b7ab-211fe54d400e admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:53.389608 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744eac8e-aa0f-4553-b7ab-211fe54d400e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:53.391810 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744eac8e-aa0f-4553-b7ab-211fe54d400e admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:53.505243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1129/2266] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:53 2022] POST /identity/v3/users => generated 294 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:53.511304 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee7a4c-3673-4bc9-a0e6-fc4c036bfd5f admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:53.524521 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee7a4c-3673-4bc9-a0e6-fc4c036bfd5f admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:53.535710 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d4546-ad7e-4c20-9a3e-1bdfed92d9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:53.536510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d4546-ad7e-4c20-9a3e-1bdfed92d9bd admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:53.536797 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d4546-ad7e-4c20-9a3e-1bdfed92d9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:53.537784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d4546-ad7e-4c20-9a3e-1bdfed92d9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:53.537784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d4546-ad7e-4c20-9a3e-1bdfed92d9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:53.545163 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d4546-ad7e-4c20-9a3e-1bdfed92d9bd admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:53.575837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1138/2267] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:53.579872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744eac8e-aa0f-4553-b7ab-211fe54d400e admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:53.593726 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744eac8e-aa0f-4553-b7ab-211fe54d400e admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:53.599787 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c06fbf-8544-4290-bddd-c5c089d4de28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:53.600736 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c06fbf-8544-4290-bddd-c5c089d4de28 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:53.603304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c06fbf-8544-4290-bddd-c5c089d4de28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:53.603304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c06fbf-8544-4290-bddd-c5c089d4de28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:53.603304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c06fbf-8544-4290-bddd-c5c089d4de28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:53.604502 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c06fbf-8544-4290-bddd-c5c089d4de28 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:53.617670 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1130/2268] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:53.621497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d4546-ad7e-4c20-9a3e-1bdfed92d9bd admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:53.635369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d4546-ad7e-4c20-9a3e-1bdfed92d9bd admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:53.645202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb6d80-3a66-4314-b939-e7eaa1b56bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:53.646306 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb6d80-3a66-4314-b939-e7eaa1b56bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:53.646735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb6d80-3a66-4314-b939-e7eaa1b56bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:53.647154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb6d80-3a66-4314-b939-e7eaa1b56bb2 admin admin] PATH_INFO: `/v3/projects/b19c4c03cfd7454099f32dacb67c76cb/users/10f1d6fb67cc49f48a7b659089c9cf78/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:53.679872 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb6d80-3a66-4314-b939-e7eaa1b56bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19c4c03cfd7454099f32dacb67c76cb, user_id=10f1d6fb67cc49f48a7b659089c9cf78, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:53.684210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb6d80-3a66-4314-b939-e7eaa1b56bb2 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:53.801247 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1139/2269] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:53 2022] PUT /identity/v3/projects/b19c4c03cfd7454099f32dacb67c76cb/users/10f1d6fb67cc49f48a7b659089c9cf78/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:53.816259 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461ba31-72f4-405b-b9fa-9edf016da0d7 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:53.816259 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461ba31-72f4-405b-b9fa-9edf016da0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:53.816259 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461ba31-72f4-405b-b9fa-9edf016da0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:53.846628 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb6d80-3a66-4314-b939-e7eaa1b56bb2 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:53.848580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2edb6d80-3a66-4314-b939-e7eaa1b56bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:53.852395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-f461ba31-72f4-405b-b9fa-9edf016da0d7 None None] MFA Rules not processed for user `10f1d6fb67cc49f48a7b659089c9cf78`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:53.853585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-f461ba31-72f4-405b-b9fa-9edf016da0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:53.975185 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1131/2270] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:53.978523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461ba31-72f4-405b-b9fa-9edf016da0d7 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:54.054811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb6d80-3a66-4314-b939-e7eaa1b56bb2 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:54.069662 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f8825-31f7-4ebe-aada-2fb618a42690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:54.071480 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f8825-31f7-4ebe-aada-2fb618a42690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:54.071923 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f8825-31f7-4ebe-aada-2fb618a42690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:54.072234 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f8825-31f7-4ebe-aada-2fb618a42690 admin admin] PATH_INFO: `/v3/projects/b4a6d325d480409e889a556d18915fad` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:54.076578 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f8825-31f7-4ebe-aada-2fb618a42690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4a6d325d480409e889a556d18915fad)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:54.079669 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f8825-31f7-4ebe-aada-2fb618a42690 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:54.154040 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461ba31-72f4-405b-b9fa-9edf016da0d7 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:54.169960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb6a3c-24f4-44fe-93f2-5d31063b5d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:54.169960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb6a3c-24f4-44fe-93f2-5d31063b5d35 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:54.169960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb6a3c-24f4-44fe-93f2-5d31063b5d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:54.169960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb6a3c-24f4-44fe-93f2-5d31063b5d35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:54.170987 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb6a3c-24f4-44fe-93f2-5d31063b5d35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:54.171266 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb6a3c-24f4-44fe-93f2-5d31063b5d35 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:54.267041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-be5f8825-31f7-4ebe-aada-2fb618a42690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4a6d325d480409e889a556d18915fad', 'request_id': 'req-be5f8825-31f7-4ebe-aada-2fb618a42690'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:54.300272 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1132/2271] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:53 2022] POST /identity/v3/projects => generated 387 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:54.304404 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb6a3c-24f4-44fe-93f2-5d31063b5d35 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:54.373436 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-be5f8825-31f7-4ebe-aada-2fb618a42690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4a6d325d480409e889a556d18915fad', 'request_id': 'req-be5f8825-31f7-4ebe-aada-2fb618a42690'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:54.396477 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-be5f8825-31f7-4ebe-aada-2fb618a42690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4a6d325d480409e889a556d18915fad', 'request_id': 'req-be5f8825-31f7-4ebe-aada-2fb618a42690'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:54.429625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb6a3c-24f4-44fe-93f2-5d31063b5d35 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:54.433853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-be5f8825-31f7-4ebe-aada-2fb618a42690 admin admin] The token cache is being invalidate because project b4a6d325d480409e889a556d18915fad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:54.435342 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-be5f8825-31f7-4ebe-aada-2fb618a42690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:54.437733 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-be5f8825-31f7-4ebe-aada-2fb618a42690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:54.447658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1140/2272] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:53 2022] DELETE /identity/v3/projects/b4a6d325d480409e889a556d18915fad => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:54.449331 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cf47e-3ef3-4729-80d5-e3812b8d5f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:54.450208 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf47e-3ef3-4729-80d5-e3812b8d5f97 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:54.450508 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf47e-3ef3-4729-80d5-e3812b8d5f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:54.450868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709ac2e-9cb3-4ddf-895f-a0a55fd7dcda None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:54.450981 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf47e-3ef3-4729-80d5-e3812b8d5f97 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:54.451643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cf47e-3ef3-4729-80d5-e3812b8d5f97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:54.452692 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709ac2e-9cb3-4ddf-895f-a0a55fd7dcda None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:54.452982 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709ac2e-9cb3-4ddf-895f-a0a55fd7dcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:54.454183 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cf47e-3ef3-4729-80d5-e3812b8d5f97 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:54.492453 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-d709ac2e-9cb3-4ddf-895f-a0a55fd7dcda None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:54.493751 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d709ac2e-9cb3-4ddf-895f-a0a55fd7dcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:54.510292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1141/2273] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:54.511783 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e24b00-208e-42cb-bc33-f57e64563e9b None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:54.513626 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e24b00-208e-42cb-bc33-f57e64563e9b None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:54.513975 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e24b00-208e-42cb-bc33-f57e64563e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:54.534390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-22e24b00-208e-42cb-bc33-f57e64563e9b None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:54.535750 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-22e24b00-208e-42cb-bc33-f57e64563e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:54.547886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1142/2274] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:54.549422 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e24b00-208e-42cb-bc33-f57e64563e9b None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:54.553605 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:54.560936 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e24b00-208e-42cb-bc33-f57e64563e9b None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:54.566862 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485a622-36b2-4f9e-8abd-23d79df50d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:54.567831 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485a622-36b2-4f9e-8abd-23d79df50d67 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:54.568289 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485a622-36b2-4f9e-8abd-23d79df50d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:54.568737 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485a622-36b2-4f9e-8abd-23d79df50d67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:54.569809 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485a622-36b2-4f9e-8abd-23d79df50d67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:00:54.570898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485a622-36b2-4f9e-8abd-23d79df50d67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:54.572764 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485a622-36b2-4f9e-8abd-23d79df50d67 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:54.594003 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1143/2275] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:00:54.595375 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485a622-36b2-4f9e-8abd-23d79df50d67 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:54.610958 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1133/2276] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:54 2022] POST /identity/v3/users => generated 300 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:54.614273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cf47e-3ef3-4729-80d5-e3812b8d5f97 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:54.616221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-3d6cf47e-3ef3-4729-80d5-e3812b8d5f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:54.618819 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485a622-36b2-4f9e-8abd-23d79df50d67 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:54.637762 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad6ab9-d298-4258-8fad-f78d453df56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:54.638469 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad6ab9-d298-4258-8fad-f78d453df56e admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:54.639167 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad6ab9-d298-4258-8fad-f78d453df56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:54.639167 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad6ab9-d298-4258-8fad-f78d453df56e admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:54.639765 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad6ab9-d298-4258-8fad-f78d453df56e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:54.646361 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad6ab9-d298-4258-8fad-f78d453df56e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:54.662369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cf47e-3ef3-4729-80d5-e3812b8d5f97 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:54.678124 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acf88b-f8dd-46ca-8844-e06e0fcebeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:54.679058 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acf88b-f8dd-46ca-8844-e06e0fcebeab admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:54.679497 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acf88b-f8dd-46ca-8844-e06e0fcebeab admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:54.679924 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acf88b-f8dd-46ca-8844-e06e0fcebeab admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:54.680848 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acf88b-f8dd-46ca-8844-e06e0fcebeab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:54.682655 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acf88b-f8dd-46ca-8844-e06e0fcebeab admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:54.702518 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1134/2277] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:00:54.703743 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acf88b-f8dd-46ca-8844-e06e0fcebeab admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:54.714224 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acf88b-f8dd-46ca-8844-e06e0fcebeab admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:54.719465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072fcd5-da46-4d40-a24e-b33953fb6cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:54.720371 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072fcd5-da46-4d40-a24e-b33953fb6cba admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:54.720692 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072fcd5-da46-4d40-a24e-b33953fb6cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:54.720936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072fcd5-da46-4d40-a24e-b33953fb6cba admin admin] PATH_INFO: `/v3/projects/1bd56e3e30f5428e9313ecc328e734e3/users/1075ab05533f43938da9a33b26d4e4b9/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:54.737025 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072fcd5-da46-4d40-a24e-b33953fb6cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bd56e3e30f5428e9313ecc328e734e3, user_id=1075ab05533f43938da9a33b26d4e4b9, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:54.740889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072fcd5-da46-4d40-a24e-b33953fb6cba admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:54.779632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:54.789545 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1144/2278] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:54 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:54.794986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad6ab9-d298-4258-8fad-f78d453df56e admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:54.840246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1135/2279] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:54 2022] PUT /identity/v3/projects/1bd56e3e30f5428e9313ecc328e734e3/users/1075ab05533f43938da9a33b26d4e4b9/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:54.842351 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072fcd5-da46-4d40-a24e-b33953fb6cba admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:54.920033 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072fcd5-da46-4d40-a24e-b33953fb6cba admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:54.920578 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad6ab9-d298-4258-8fad-f78d453df56e admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:54.925747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37189f-7d0c-479e-a204-c1fe15e98646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:54.926494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37189f-7d0c-479e-a204-c1fe15e98646 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:54.926841 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37189f-7d0c-479e-a204-c1fe15e98646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:54.927036 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b16262-cd0a-4991-b146-5db5ef7ef379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:54.927323 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37189f-7d0c-479e-a204-c1fe15e98646 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:54.927904 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b16262-cd0a-4991-b146-5db5ef7ef379 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:54.928202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37189f-7d0c-479e-a204-c1fe15e98646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:54.928506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b16262-cd0a-4991-b146-5db5ef7ef379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:54.928916 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b16262-cd0a-4991-b146-5db5ef7ef379 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:54.929823 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b16262-cd0a-4991-b146-5db5ef7ef379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:54.930559 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37189f-7d0c-479e-a204-c1fe15e98646 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:54.932720 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b16262-cd0a-4991-b146-5db5ef7ef379 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:54.946487 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1136/2280] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:54.952476 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37189f-7d0c-479e-a204-c1fe15e98646 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:54.963001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37189f-7d0c-479e-a204-c1fe15e98646 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:54.969835 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efbc16-b18a-42c6-b6a7-01c446ce7623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:54.971472 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efbc16-b18a-42c6-b6a7-01c446ce7623 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:54.972086 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efbc16-b18a-42c6-b6a7-01c446ce7623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:54.972684 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efbc16-b18a-42c6-b6a7-01c446ce7623 admin admin] PATH_INFO: `/v3/projects/1bd56e3e30f5428e9313ecc328e734e3/users/1075ab05533f43938da9a33b26d4e4b9/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:54.976392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efbc16-b18a-42c6-b6a7-01c446ce7623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bd56e3e30f5428e9313ecc328e734e3, user_id=1075ab05533f43938da9a33b26d4e4b9, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:54.979664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efbc16-b18a-42c6-b6a7-01c446ce7623 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:54.992960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1137/2281] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:54 2022] PUT /identity/v3/projects/1bd56e3e30f5428e9313ecc328e734e3/users/1075ab05533f43938da9a33b26d4e4b9/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:55.008656 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2cdd7-c0d4-484b-a501-7247c485d73e None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:55.009234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2cdd7-c0d4-484b-a501-7247c485d73e None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:55.009689 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2cdd7-c0d4-484b-a501-7247c485d73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:55.047638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-1fc2cdd7-c0d4-484b-a501-7247c485d73e None None] MFA Rules not processed for user `1075ab05533f43938da9a33b26d4e4b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:55.049505 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-1fc2cdd7-c0d4-484b-a501-7247c485d73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:55.082389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1145/2282] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:54 2022] POST /identity/v3/users => generated 289 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:00:55.087826 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b16262-cd0a-4991-b146-5db5ef7ef379 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:55.099526 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b16262-cd0a-4991-b146-5db5ef7ef379 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:55.192342 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1138/2283] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:55.201840 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2cdd7-c0d4-484b-a501-7247c485d73e None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:55.204448 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-1fc2cdd7-c0d4-484b-a501-7247c485d73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:55.204809 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5acb7-53d0-47a8-af0e-35b016bb14b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:55.205793 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5acb7-53d0-47a8-af0e-35b016bb14b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:55.206499 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5acb7-53d0-47a8-af0e-35b016bb14b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:55.206927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5acb7-53d0-47a8-af0e-35b016bb14b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:55.207824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5acb7-53d0-47a8-af0e-35b016bb14b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:55.209804 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5acb7-53d0-47a8-af0e-35b016bb14b7 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:55.222921 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1146/2284] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:55.227385 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5acb7-53d0-47a8-af0e-35b016bb14b7 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:55.240289 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5acb7-53d0-47a8-af0e-35b016bb14b7 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:55.245886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d176b-4c94-41a3-a5ca-7d28bc156e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:55.247671 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d176b-4c94-41a3-a5ca-7d28bc156e6c admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:55.247962 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d176b-4c94-41a3-a5ca-7d28bc156e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:55.248516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d176b-4c94-41a3-a5ca-7d28bc156e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:55.249275 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d176b-4c94-41a3-a5ca-7d28bc156e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:55.250896 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d176b-4c94-41a3-a5ca-7d28bc156e6c admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:55.265561 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1147/2285] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:55.267824 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d176b-4c94-41a3-a5ca-7d28bc156e6c admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:55.279469 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d176b-4c94-41a3-a5ca-7d28bc156e6c admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:55.286197 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be3af8-36bf-425a-b556-2055d128feaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:55.287335 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be3af8-36bf-425a-b556-2055d128feaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:55.287626 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be3af8-36bf-425a-b556-2055d128feaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:55.288062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be3af8-36bf-425a-b556-2055d128feaf admin admin] PATH_INFO: `/v3/projects/366312674e204e888f62977f146e29c5/users/a66c0b03c20d4a138adebb049db831b8/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:55.292707 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2cdd7-c0d4-484b-a501-7247c485d73e None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:55.305880 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e6497-1a74-4420-bf64-0d6428841bc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:55.306663 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e6497-1a74-4420-bf64-0d6428841bc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:55.306945 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e6497-1a74-4420-bf64-0d6428841bc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:55.307223 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e6497-1a74-4420-bf64-0d6428841bc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:55.313923 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be3af8-36bf-425a-b556-2055d128feaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=366312674e204e888f62977f146e29c5, user_id=a66c0b03c20d4a138adebb049db831b8, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:55.324318 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be3af8-36bf-425a-b556-2055d128feaf admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:55.329952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e6497-1a74-4420-bf64-0d6428841bc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:55.331998 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e6497-1a74-4420-bf64-0d6428841bc7 service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:55.358060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1139/2286] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:00:55.421308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1148/2287] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:55 2022] PUT /identity/v3/projects/366312674e204e888f62977f146e29c5/users/a66c0b03c20d4a138adebb049db831b8/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:55.423756 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c44c72-65e0-4154-a97e-4095dac434f5 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:55.425065 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c44c72-65e0-4154-a97e-4095dac434f5 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:55.425432 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c44c72-65e0-4154-a97e-4095dac434f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:55.458381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-e0c44c72-65e0-4154-a97e-4095dac434f5 None None] MFA Rules not processed for user `a66c0b03c20d4a138adebb049db831b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:55.459815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e0c44c72-65e0-4154-a97e-4095dac434f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:55.551027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1140/2288] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:55.556018 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be3af8-36bf-425a-b556-2055d128feaf admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:55.655258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be3af8-36bf-425a-b556-2055d128feaf admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:55.665154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110adf5f-1b9e-44ec-b5ac-79d8b929dcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:55.665512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110adf5f-1b9e-44ec-b5ac-79d8b929dcf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:55.665800 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110adf5f-1b9e-44ec-b5ac-79d8b929dcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:55.666107 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110adf5f-1b9e-44ec-b5ac-79d8b929dcf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:55.666962 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110adf5f-1b9e-44ec-b5ac-79d8b929dcf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:55.671335 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110adf5f-1b9e-44ec-b5ac-79d8b929dcf3 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:55.690075 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:55.809781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1149/2289] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:55 2022] POST /identity/v3/projects => generated 375 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:55.813257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c44c72-65e0-4154-a97e-4095dac434f5 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:55.827148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c44c72-65e0-4154-a97e-4095dac434f5 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:55.951822 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13af1-9ba8-4c85-bacf-54181256821d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:55.953561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13af1-9ba8-4c85-bacf-54181256821d admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:55.955793 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13af1-9ba8-4c85-bacf-54181256821d admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:55.956611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13af1-9ba8-4c85-bacf-54181256821d admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:55.961384 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f13af1-9ba8-4c85-bacf-54181256821d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:55.962466 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f13af1-9ba8-4c85-bacf-54181256821d admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:56.066044 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1141/2290] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:55 2022] POST /identity/v3/users => generated 288 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:56.070558 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110adf5f-1b9e-44ec-b5ac-79d8b929dcf3 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:56.089564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110adf5f-1b9e-44ec-b5ac-79d8b929dcf3 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:56.095615 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff467562-906a-453d-b311-65c1cef8ec32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:56.096523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff467562-906a-453d-b311-65c1cef8ec32 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:56.096958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff467562-906a-453d-b311-65c1cef8ec32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:56.097386 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff467562-906a-453d-b311-65c1cef8ec32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:56.098286 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff467562-906a-453d-b311-65c1cef8ec32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:56.099933 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff467562-906a-453d-b311-65c1cef8ec32 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:56.112940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1150/2291] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:56.116939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13af1-9ba8-4c85-bacf-54181256821d admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:56.127588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13af1-9ba8-4c85-bacf-54181256821d admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:56.132694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f6895-0e6b-4ed5-a79a-a669f36bd470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:56.133567 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f6895-0e6b-4ed5-a79a-a669f36bd470 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:56.133921 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f6895-0e6b-4ed5-a79a-a669f36bd470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:56.134389 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f6895-0e6b-4ed5-a79a-a669f36bd470 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:56.140510 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f6895-0e6b-4ed5-a79a-a669f36bd470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:56.140510 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f6895-0e6b-4ed5-a79a-a669f36bd470 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:56.149858 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1142/2292] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:00:56.154867 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff467562-906a-453d-b311-65c1cef8ec32 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:56.167169 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff467562-906a-453d-b311-65c1cef8ec32 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:56.173269 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2aab8-a054-4951-928b-4e3a721ff5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:56.174866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2aab8-a054-4951-928b-4e3a721ff5a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:56.175438 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2aab8-a054-4951-928b-4e3a721ff5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:56.175927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2aab8-a054-4951-928b-4e3a721ff5a0 admin admin] PATH_INFO: `/v3/projects/ac0d8abec3e040f383e278703b8aca54/users/f675b5ca7b2f41bc9f3cee54221fd9e3/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:56.197840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2aab8-a054-4951-928b-4e3a721ff5a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac0d8abec3e040f383e278703b8aca54, user_id=f675b5ca7b2f41bc9f3cee54221fd9e3, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:56.202073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f6895-0e6b-4ed5-a79a-a669f36bd470 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:56.205151 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-493f6895-0e6b-4ed5-a79a-a669f36bd470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:56.219809 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe2aab8-a054-4951-928b-4e3a721ff5a0 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:56.240317 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f6895-0e6b-4ed5-a79a-a669f36bd470 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:56.249654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78c25d-de92-45a9-b8be-788f6233226a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:56.250853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78c25d-de92-45a9-b8be-788f6233226a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:56.251265 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78c25d-de92-45a9-b8be-788f6233226a admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:56.251680 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78c25d-de92-45a9-b8be-788f6233226a admin admin] PATH_INFO: `/v3/users/b0755d8e0e044cd0b546682424edf928` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:56.253110 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78c25d-de92-45a9-b8be-788f6233226a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0755d8e0e044cd0b546682424edf928)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:56.255136 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78c25d-de92-45a9-b8be-788f6233226a admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:56.315749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:56.331362 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1151/2293] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:56 2022] PUT /identity/v3/projects/ac0d8abec3e040f383e278703b8aca54/users/f675b5ca7b2f41bc9f3cee54221fd9e3/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:56.342863 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15deff88-0aab-4de7-8e7d-5ec53813fd92 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:56.343190 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15deff88-0aab-4de7-8e7d-5ec53813fd92 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:56.343477 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15deff88-0aab-4de7-8e7d-5ec53813fd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:56.373558 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-15deff88-0aab-4de7-8e7d-5ec53813fd92 None None] MFA Rules not processed for user `f675b5ca7b2f41bc9f3cee54221fd9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:56.374736 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-15deff88-0aab-4de7-8e7d-5ec53813fd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:56.493976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1152/2294] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:00:56.500937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15deff88-0aab-4de7-8e7d-5ec53813fd92 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:56.505024 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4a78c25d-de92-45a9-b8be-788f6233226a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0755d8e0e044cd0b546682424edf928'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:56.506708 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4a78c25d-de92-45a9-b8be-788f6233226a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0755d8e0e044cd0b546682424edf928'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:56.582588 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15deff88-0aab-4de7-8e7d-5ec53813fd92 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:56.586082 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4a78c25d-de92-45a9-b8be-788f6233226a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0755d8e0e044cd0b546682424edf928'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:56.587143 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4a78c25d-de92-45a9-b8be-788f6233226a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0755d8e0e044cd0b546682424edf928'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:56.595126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b07ab9-e06a-4e53-a077-1496af34156e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:56.598126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b07ab9-e06a-4e53-a077-1496af34156e admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:56.599379 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b07ab9-e06a-4e53-a077-1496af34156e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:56.600785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b07ab9-e06a-4e53-a077-1496af34156e admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:56.602500 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b07ab9-e06a-4e53-a077-1496af34156e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:56.609071 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b07ab9-e06a-4e53-a077-1496af34156e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:56.611892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4a78c25d-de92-45a9-b8be-788f6233226a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0755d8e0e044cd0b546682424edf928'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:56.672268 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1143/2295] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:56 2022] DELETE /identity/v3/users/b0755d8e0e044cd0b546682424edf928 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:00:56.676624 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddb81e-18f6-4ef4-b7f7-8add02b2ee84 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:56.677078 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddb81e-18f6-4ef4-b7f7-8add02b2ee84 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:56.677555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddb81e-18f6-4ef4-b7f7-8add02b2ee84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:56.731253 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-16ddb81e-18f6-4ef4-b7f7-8add02b2ee84 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:56.733687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-16ddb81e-18f6-4ef4-b7f7-8add02b2ee84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:56.767620 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1153/2296] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:00:56 2022] POST /identity/v3/projects => generated 377 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:56.771256 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b07ab9-e06a-4e53-a077-1496af34156e admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:56.773542 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-25b07ab9-e06a-4e53-a077-1496af34156e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:56.907815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1144/2297] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:00:56.908670 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddb81e-18f6-4ef4-b7f7-8add02b2ee84 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:56.912207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-16ddb81e-18f6-4ef4-b7f7-8add02b2ee84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:56.940020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b07ab9-e06a-4e53-a077-1496af34156e admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:56.945936 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e067c-6c18-4e38-9978-a24384d64488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:56.946694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e067c-6c18-4e38-9978-a24384d64488 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:56.947100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e067c-6c18-4e38-9978-a24384d64488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:56.947407 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e067c-6c18-4e38-9978-a24384d64488 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:56.948920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e067c-6c18-4e38-9978-a24384d64488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:56.951697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e067c-6c18-4e38-9978-a24384d64488 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:57.034756 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddb81e-18f6-4ef4-b7f7-8add02b2ee84 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:57.062285 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1154/2298] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:00:56 2022] POST /identity/v3/users => generated 295 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:00:57.063588 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e067c-6c18-4e38-9978-a24384d64488 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:57.068748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-a78e067c-6c18-4e38-9978-a24384d64488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:57.141966 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fdf7c-ee24-4409-9eaa-91bdc1ab1f44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:57.142863 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fdf7c-ee24-4409-9eaa-91bdc1ab1f44 service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:57.143210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fdf7c-ee24-4409-9eaa-91bdc1ab1f44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:57.145347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fdf7c-ee24-4409-9eaa-91bdc1ab1f44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:57.145670 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-179fdf7c-ee24-4409-9eaa-91bdc1ab1f44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:57.175104 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e067c-6c18-4e38-9978-a24384d64488 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:57.181185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5e282-aa04-4a88-9028-bcb39e986596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:57.181747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5e282-aa04-4a88-9028-bcb39e986596 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:57.182222 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5e282-aa04-4a88-9028-bcb39e986596 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:57.182652 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5e282-aa04-4a88-9028-bcb39e986596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:57.196652 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5e282-aa04-4a88-9028-bcb39e986596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:57.198938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5e282-aa04-4a88-9028-bcb39e986596 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:57.233204 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1155/2299] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:00:57.250356 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5e282-aa04-4a88-9028-bcb39e986596 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:57.276384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5e282-aa04-4a88-9028-bcb39e986596 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:57.291617 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fdf7c-ee24-4409-9eaa-91bdc1ab1f44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:57.295385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fdf7c-ee24-4409-9eaa-91bdc1ab1f44 service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:57.302088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eafab6-b3d3-4b43-baf1-142a98c18f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:57.307171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eafab6-b3d3-4b43-baf1-142a98c18f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:57.309861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eafab6-b3d3-4b43-baf1-142a98c18f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:57.310181 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eafab6-b3d3-4b43-baf1-142a98c18f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:57.311856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eafab6-b3d3-4b43-baf1-142a98c18f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:57.317842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1145/2300] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:00:57.322659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eafab6-b3d3-4b43-baf1-142a98c18f51 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:57.369651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fdf7c-ee24-4409-9eaa-91bdc1ab1f44 service cinder] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:57.374815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1156/2301] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:57.394140 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fdf7c-ee24-4409-9eaa-91bdc1ab1f44 service cinder] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:57.408473 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d61944-0dc4-4c20-a5e6-19d9a1380bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:57.409482 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d61944-0dc4-4c20-a5e6-19d9a1380bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:57.409863 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d61944-0dc4-4c20-a5e6-19d9a1380bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:57.410200 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d61944-0dc4-4c20-a5e6-19d9a1380bfe admin admin] PATH_INFO: `/v3/projects/d26e17bd988947f5aa3d831010b60049/users/dc94a1ca7a974d248819ecff5d887410/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:57.465868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d61944-0dc4-4c20-a5e6-19d9a1380bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26e17bd988947f5aa3d831010b60049, user_id=dc94a1ca7a974d248819ecff5d887410, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:57.465868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d61944-0dc4-4c20-a5e6-19d9a1380bfe admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:57.586457 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1146/2302] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:57 2022] PUT /identity/v3/projects/d26e17bd988947f5aa3d831010b60049/users/dc94a1ca7a974d248819ecff5d887410/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:57.590745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eafab6-b3d3-4b43-baf1-142a98c18f51 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:57.605911 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eafab6-b3d3-4b43-baf1-142a98c18f51 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:57.636207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba950a78-d7d4-4b68-b115-544d56980c97 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:57.636576 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba950a78-d7d4-4b68-b115-544d56980c97 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:57.636927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba950a78-d7d4-4b68-b115-544d56980c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:57.688971 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-ba950a78-d7d4-4b68-b115-544d56980c97 None None] MFA Rules not processed for user `7c35fb18d4f44f26a6a0939503da0b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:57.691461 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-ba950a78-d7d4-4b68-b115-544d56980c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:57.742123 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cefc1-5076-4120-a78e-23bfeb306e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:57.743573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cefc1-5076-4120-a78e-23bfeb306e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:57.743974 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cefc1-5076-4120-a78e-23bfeb306e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:57.744369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cefc1-5076-4120-a78e-23bfeb306e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:57.748730 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cefc1-5076-4120-a78e-23bfeb306e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:57.752411 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cefc1-5076-4120-a78e-23bfeb306e2f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:57.781378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1157/2303] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:00:57.787944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cefc1-5076-4120-a78e-23bfeb306e2f admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:57.807819 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cefc1-5076-4120-a78e-23bfeb306e2f admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:57.819951 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcc6c5-af41-411b-b8e5-3e7fbf179251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:57.822127 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcc6c5-af41-411b-b8e5-3e7fbf179251 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:57.822666 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcc6c5-af41-411b-b8e5-3e7fbf179251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:57.822850 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcc6c5-af41-411b-b8e5-3e7fbf179251 admin admin] PATH_INFO: `/v3/projects/d26e17bd988947f5aa3d831010b60049/users/dc94a1ca7a974d248819ecff5d887410/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:57.829053 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcc6c5-af41-411b-b8e5-3e7fbf179251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26e17bd988947f5aa3d831010b60049, user_id=dc94a1ca7a974d248819ecff5d887410, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:57.832733 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcc6c5-af41-411b-b8e5-3e7fbf179251 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:57.838988 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1147/2304] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:00:57.852271 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1158/2305] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:00:57 2022] PUT /identity/v3/projects/d26e17bd988947f5aa3d831010b60049/users/dc94a1ca7a974d248819ecff5d887410/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:00:57.862425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcc6c5-af41-411b-b8e5-3e7fbf179251 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:57.863848 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378f585-0c73-4a68-ae31-944c39f40881 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:57.863848 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378f585-0c73-4a68-ae31-944c39f40881 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:57.863848 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378f585-0c73-4a68-ae31-944c39f40881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:57.870350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-addcc6c5-af41-411b-b8e5-3e7fbf179251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:57.898276 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-d378f585-0c73-4a68-ae31-944c39f40881 None None] MFA Rules not processed for user `dc94a1ca7a974d248819ecff5d887410`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:00:57.899503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-d378f585-0c73-4a68-ae31-944c39f40881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:58.046149 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcc6c5-af41-411b-b8e5-3e7fbf179251 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:58.046149 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9be2d-db53-46a9-81e6-1a4cc61dac41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:58.046149 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9be2d-db53-46a9-81e6-1a4cc61dac41 service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:58.046149 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9be2d-db53-46a9-81e6-1a4cc61dac41 service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:58.047589 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9be2d-db53-46a9-81e6-1a4cc61dac41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:58.047680 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1148/2306] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:00:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:00:58.059311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378f585-0c73-4a68-ae31-944c39f40881 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:58.060947 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-d378f585-0c73-4a68-ae31-944c39f40881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:58.107192 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9be2d-db53-46a9-81e6-1a4cc61dac41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:58.108961 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9be2d-db53-46a9-81e6-1a4cc61dac41 service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:58.120883 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1159/2307] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:00:58.138544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378f585-0c73-4a68-ae31-944c39f40881 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:58.143147 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32783468-8011-4068-a07e-187c627e2af9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:58.143834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32783468-8011-4068-a07e-187c627e2af9 service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:58.144422 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32783468-8011-4068-a07e-187c627e2af9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:58.144928 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32783468-8011-4068-a07e-187c627e2af9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:58.150493 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-32783468-8011-4068-a07e-187c627e2af9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:58.233048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9be2d-db53-46a9-81e6-1a4cc61dac41 service nova] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:58.236531 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32783468-8011-4068-a07e-187c627e2af9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:58.236685 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-a7c9be2d-db53-46a9-81e6-1a4cc61dac41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:00:58.236791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32783468-8011-4068-a07e-187c627e2af9 service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:58.249231 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1149/2308] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:00:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:00:58.407536 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9be2d-db53-46a9-81e6-1a4cc61dac41 service nova] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:58.411265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4aa44-a2b3-44f4-afbc-9fb57240b6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:58.412567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4aa44-a2b3-44f4-afbc-9fb57240b6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:58.413174 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4aa44-a2b3-44f4-afbc-9fb57240b6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:58.413614 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4aa44-a2b3-44f4-afbc-9fb57240b6cc admin admin] PATH_INFO: `/v3/projects/192cd893aa5540bfab54a6cfd0a050f6` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:58.415088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4aa44-a2b3-44f4-afbc-9fb57240b6cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=192cd893aa5540bfab54a6cfd0a050f6)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:58.417143 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4aa44-a2b3-44f4-afbc-9fb57240b6cc admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:58.656485 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-20c4aa44-a2b3-44f4-afbc-9fb57240b6cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '192cd893aa5540bfab54a6cfd0a050f6', 'request_id': 'req-20c4aa44-a2b3-44f4-afbc-9fb57240b6cc'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:58.702593 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:58.749032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-20c4aa44-a2b3-44f4-afbc-9fb57240b6cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '192cd893aa5540bfab54a6cfd0a050f6', 'request_id': 'req-20c4aa44-a2b3-44f4-afbc-9fb57240b6cc'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:58.759420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-20c4aa44-a2b3-44f4-afbc-9fb57240b6cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '192cd893aa5540bfab54a6cfd0a050f6', 'request_id': 'req-20c4aa44-a2b3-44f4-afbc-9fb57240b6cc'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:58.786275 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-20c4aa44-a2b3-44f4-afbc-9fb57240b6cc admin admin] The token cache is being invalidate because project 192cd893aa5540bfab54a6cfd0a050f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:00:58.786572 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-20c4aa44-a2b3-44f4-afbc-9fb57240b6cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:58.788898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-20c4aa44-a2b3-44f4-afbc-9fb57240b6cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:58.796011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1160/2309] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:00:58 2022] DELETE /identity/v3/projects/192cd893aa5540bfab54a6cfd0a050f6 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:00:58.797000 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32783468-8011-4068-a07e-187c627e2af9 service cinder] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:00:58.815492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32783468-8011-4068-a07e-187c627e2af9 service cinder] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:00:58.967732 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7c986-6950-4a4d-8a6d-6392f6d790b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:00:58.969163 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7c986-6950-4a4d-8a6d-6392f6d790b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:00:58.969163 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7c986-6950-4a4d-8a6d-6392f6d790b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:00:58.969454 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7c986-6950-4a4d-8a6d-6392f6d790b9 admin admin] PATH_INFO: `/v3/users/3ca17fbe932a47d48f3bee3fa6a2f559` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:00:58.974705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7c986-6950-4a4d-8a6d-6392f6d790b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca17fbe932a47d48f3bee3fa6a2f559)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:00:58.976860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7c986-6950-4a4d-8a6d-6392f6d790b9 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:00:59.014644 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=84,keystone:INSERT=9,keystone:DELETE=7 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:00:59.264422 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-84f7c986-6950-4a4d-8a6d-6392f6d790b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca17fbe932a47d48f3bee3fa6a2f559'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:59.265324 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-84f7c986-6950-4a4d-8a6d-6392f6d790b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca17fbe932a47d48f3bee3fa6a2f559'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:59.348723 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-84f7c986-6950-4a4d-8a6d-6392f6d790b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca17fbe932a47d48f3bee3fa6a2f559'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:59.349556 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-84f7c986-6950-4a4d-8a6d-6392f6d790b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca17fbe932a47d48f3bee3fa6a2f559'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:59.371202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-84f7c986-6950-4a4d-8a6d-6392f6d790b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca17fbe932a47d48f3bee3fa6a2f559'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:00:59.386841 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1150/2310] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:00:58 2022] DELETE /identity/v3/users/3ca17fbe932a47d48f3bee3fa6a2f559 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:01:00.100849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4aa44-a2b3-44f4-afbc-9fb57240b6cc admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:00.102488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-20c4aa44-a2b3-44f4-afbc-9fb57240b6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:00.123698 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4aa44-a2b3-44f4-afbc-9fb57240b6cc admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:00.260736 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f0b43-e2b5-4862-8126-c832ce98dde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:00.261698 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f0b43-e2b5-4862-8126-c832ce98dde4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:00.261990 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f0b43-e2b5-4862-8126-c832ce98dde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:00.262845 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f0b43-e2b5-4862-8126-c832ce98dde4 admin admin] PATH_INFO: `/v3/projects/4bef742f013d43baa1bb8c9130d2021a` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:00.264371 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f0b43-e2b5-4862-8126-c832ce98dde4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bef742f013d43baa1bb8c9130d2021a)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:00.267088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f0b43-e2b5-4862-8126-c832ce98dde4 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:00.467588 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-7c5f0b43-e2b5-4862-8126-c832ce98dde4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bef742f013d43baa1bb8c9130d2021a', 'request_id': 'req-7c5f0b43-e2b5-4862-8126-c832ce98dde4'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:00.547366 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-7c5f0b43-e2b5-4862-8126-c832ce98dde4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bef742f013d43baa1bb8c9130d2021a', 'request_id': 'req-7c5f0b43-e2b5-4862-8126-c832ce98dde4'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:00.559989 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-7c5f0b43-e2b5-4862-8126-c832ce98dde4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bef742f013d43baa1bb8c9130d2021a', 'request_id': 'req-7c5f0b43-e2b5-4862-8126-c832ce98dde4'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:00.584505 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-7c5f0b43-e2b5-4862-8126-c832ce98dde4 admin admin] The token cache is being invalidate because project 4bef742f013d43baa1bb8c9130d2021a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:01:00.584505 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-7c5f0b43-e2b5-4862-8126-c832ce98dde4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:00.585110 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-7c5f0b43-e2b5-4862-8126-c832ce98dde4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:00.589207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1161/2311] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:01:00 2022] DELETE /identity/v3/projects/4bef742f013d43baa1bb8c9130d2021a => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:00.594227 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7c986-6950-4a4d-8a6d-6392f6d790b9 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:00.595860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-84f7c986-6950-4a4d-8a6d-6392f6d790b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:00.619103 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7c986-6950-4a4d-8a6d-6392f6d790b9 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:00.811205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f756ed-8cd4-404f-a448-91466e63fda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:00.812290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f756ed-8cd4-404f-a448-91466e63fda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:00.818647 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f756ed-8cd4-404f-a448-91466e63fda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:00.818647 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f756ed-8cd4-404f-a448-91466e63fda5 admin admin] PATH_INFO: `/v3/users/8897f174b1604df8a87e0c2b8fb13251` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:00.818647 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f756ed-8cd4-404f-a448-91466e63fda5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8897f174b1604df8a87e0c2b8fb13251)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:00.821869 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f756ed-8cd4-404f-a448-91466e63fda5 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:00.887826 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:01.179330 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-c3f756ed-8cd4-404f-a448-91466e63fda5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8897f174b1604df8a87e0c2b8fb13251'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:01.183274 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-c3f756ed-8cd4-404f-a448-91466e63fda5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8897f174b1604df8a87e0c2b8fb13251'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:01.250297 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-c3f756ed-8cd4-404f-a448-91466e63fda5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8897f174b1604df8a87e0c2b8fb13251'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:01.251264 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-c3f756ed-8cd4-404f-a448-91466e63fda5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8897f174b1604df8a87e0c2b8fb13251'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:01.274015 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-c3f756ed-8cd4-404f-a448-91466e63fda5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8897f174b1604df8a87e0c2b8fb13251'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:01.290979 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1151/2312] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:01:00 2022] DELETE /identity/v3/users/8897f174b1604df8a87e0c2b8fb13251 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:01.650284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f0b43-e2b5-4862-8126-c832ce98dde4 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:01.652060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-7c5f0b43-e2b5-4862-8126-c832ce98dde4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:01.735189 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f0b43-e2b5-4862-8126-c832ce98dde4 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:01.821698 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abafff8-ccf1-45a3-a872-b87e49444ca3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:01.822450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abafff8-ccf1-45a3-a872-b87e49444ca3 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:01.822737 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abafff8-ccf1-45a3-a872-b87e49444ca3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:01.823015 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abafff8-ccf1-45a3-a872-b87e49444ca3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:01.829472 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2abafff8-ccf1-45a3-a872-b87e49444ca3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:01.978230 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abafff8-ccf1-45a3-a872-b87e49444ca3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:01.986513 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abafff8-ccf1-45a3-a872-b87e49444ca3 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:02.007149 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1162/2313] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:01:02.253240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:02.639162 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f756ed-8cd4-404f-a448-91466e63fda5 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:02.639162 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-c3f756ed-8cd4-404f-a448-91466e63fda5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:02.729962 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f756ed-8cd4-404f-a448-91466e63fda5 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:02.735721 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59505ba-cc3c-44b5-9c7d-57e3e369326e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:02.737427 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59505ba-cc3c-44b5-9c7d-57e3e369326e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:02.737809 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59505ba-cc3c-44b5-9c7d-57e3e369326e admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:02.738208 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59505ba-cc3c-44b5-9c7d-57e3e369326e admin admin] PATH_INFO: `/v3/projects/2f5290acc6af4ddba95e1d0ab67e9898` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:02.739690 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59505ba-cc3c-44b5-9c7d-57e3e369326e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f5290acc6af4ddba95e1d0ab67e9898)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:02.742001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59505ba-cc3c-44b5-9c7d-57e3e369326e admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:02.821288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba827ac-34ab-4f63-91e5-250cd0ec7200 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:02.827703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba827ac-34ab-4f63-91e5-250cd0ec7200 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:02.827703 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba827ac-34ab-4f63-91e5-250cd0ec7200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:02.840865 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-7ba827ac-34ab-4f63-91e5-250cd0ec7200 None None] MFA Rules not processed for user `7c35fb18d4f44f26a6a0939503da0b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:02.842080 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-7ba827ac-34ab-4f63-91e5-250cd0ec7200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:02.869809 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-c59505ba-cc3c-44b5-9c7d-57e3e369326e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f5290acc6af4ddba95e1d0ab67e9898', 'request_id': 'req-c59505ba-cc3c-44b5-9c7d-57e3e369326e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:02.908988 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1163/2314] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:02.969784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-c59505ba-cc3c-44b5-9c7d-57e3e369326e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f5290acc6af4ddba95e1d0ab67e9898', 'request_id': 'req-c59505ba-cc3c-44b5-9c7d-57e3e369326e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:02.988473 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-c59505ba-cc3c-44b5-9c7d-57e3e369326e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f5290acc6af4ddba95e1d0ab67e9898', 'request_id': 'req-c59505ba-cc3c-44b5-9c7d-57e3e369326e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:03.009240 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-c59505ba-cc3c-44b5-9c7d-57e3e369326e admin admin] The token cache is being invalidate because project 2f5290acc6af4ddba95e1d0ab67e9898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:01:03.009773 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-c59505ba-cc3c-44b5-9c7d-57e3e369326e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:03.010580 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-c59505ba-cc3c-44b5-9c7d-57e3e369326e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:03.026970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1152/2315] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:01:02 2022] DELETE /identity/v3/projects/2f5290acc6af4ddba95e1d0ab67e9898 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:03.035967 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb98c59-7c7a-47a1-8fd9-690b4a246f97 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:03.036561 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb98c59-7c7a-47a1-8fd9-690b4a246f97 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:03.036962 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb98c59-7c7a-47a1-8fd9-690b4a246f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:03.053472 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:03.067369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-4bb98c59-7c7a-47a1-8fd9-690b4a246f97 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:03.068775 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-4bb98c59-7c7a-47a1-8fd9-690b4a246f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:03.156155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1164/2316] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:03.161333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b1ab8-941f-4301-8770-c42a4ec7a244 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:03.161629 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b1ab8-941f-4301-8770-c42a4ec7a244 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:03.161912 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b1ab8-941f-4301-8770-c42a4ec7a244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:03.188060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-6d5b1ab8-941f-4301-8770-c42a4ec7a244 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:03.189356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6d5b1ab8-941f-4301-8770-c42a4ec7a244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:03.202490 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1153/2317] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:03.204959 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb98c59-7c7a-47a1-8fd9-690b4a246f97 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:03.224676 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb98c59-7c7a-47a1-8fd9-690b4a246f97 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:03.229634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2636228-3e13-43b3-8d1b-fa14f5e3264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:03.230381 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2636228-3e13-43b3-8d1b-fa14f5e3264a admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:03.231270 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2636228-3e13-43b3-8d1b-fa14f5e3264a admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:03.232287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2636228-3e13-43b3-8d1b-fa14f5e3264a admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:03.233150 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2636228-3e13-43b3-8d1b-fa14f5e3264a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:01:03.233638 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2636228-3e13-43b3-8d1b-fa14f5e3264a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:03.235385 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2636228-3e13-43b3-8d1b-fa14f5e3264a admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:03.250039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1165/2318] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:01:03.254685 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b1ab8-941f-4301-8770-c42a4ec7a244 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:03.268632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b1ab8-941f-4301-8770-c42a4ec7a244 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:03.276621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc06d4f-2f2f-4339-9b4c-5c9ed29b6f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:03.278277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc06d4f-2f2f-4339-9b4c-5c9ed29b6f14 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:03.278613 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc06d4f-2f2f-4339-9b4c-5c9ed29b6f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:03.278888 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc06d4f-2f2f-4339-9b4c-5c9ed29b6f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:03.279589 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc06d4f-2f2f-4339-9b4c-5c9ed29b6f14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:03.281970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc06d4f-2f2f-4339-9b4c-5c9ed29b6f14 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:03.399074 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1154/2319] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:01:03 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:01:03.400353 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2636228-3e13-43b3-8d1b-fa14f5e3264a admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:03.413838 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2636228-3e13-43b3-8d1b-fa14f5e3264a admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:03.521310 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c36d0-6d3b-4770-af34-23dbb682434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:03.522082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c36d0-6d3b-4770-af34-23dbb682434a admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:03.522289 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c36d0-6d3b-4770-af34-23dbb682434a admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:03.522638 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c36d0-6d3b-4770-af34-23dbb682434a admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:03.523331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c36d0-6d3b-4770-af34-23dbb682434a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:03.526188 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c36d0-6d3b-4770-af34-23dbb682434a admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:03.610440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1166/2320] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:01:03 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:01:03.615112 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc06d4f-2f2f-4339-9b4c-5c9ed29b6f14 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:03.633767 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc06d4f-2f2f-4339-9b4c-5c9ed29b6f14 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:03.643436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bf853-d1e4-4b5d-9c27-90fddbd7c057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:03.649717 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bf853-d1e4-4b5d-9c27-90fddbd7c057 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:03.650185 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bf853-d1e4-4b5d-9c27-90fddbd7c057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:03.651311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bf853-d1e4-4b5d-9c27-90fddbd7c057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:03.653892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bf853-d1e4-4b5d-9c27-90fddbd7c057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:03.657354 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bf853-d1e4-4b5d-9c27-90fddbd7c057 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:03.671173 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1155/2321] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:01:03.675612 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c36d0-6d3b-4770-af34-23dbb682434a admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:03.690246 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c36d0-6d3b-4770-af34-23dbb682434a admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:03.709162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc358cb3-88bf-4e9f-ba27-9acc638e3143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:03.710101 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc358cb3-88bf-4e9f-ba27-9acc638e3143 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:03.710101 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc358cb3-88bf-4e9f-ba27-9acc638e3143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:03.710390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc358cb3-88bf-4e9f-ba27-9acc638e3143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:03.711263 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc358cb3-88bf-4e9f-ba27-9acc638e3143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:03.714115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc358cb3-88bf-4e9f-ba27-9acc638e3143 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:03.729127 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1167/2322] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:01:03.737205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bf853-d1e4-4b5d-9c27-90fddbd7c057 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:03.757635 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bf853-d1e4-4b5d-9c27-90fddbd7c057 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:03.771393 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21019cc-901a-4498-9a48-623d801db154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:03.773080 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21019cc-901a-4498-9a48-623d801db154 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:03.774802 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21019cc-901a-4498-9a48-623d801db154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:03.775297 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21019cc-901a-4498-9a48-623d801db154 admin admin] PATH_INFO: `/v3/projects/600f113ec61042abae41ffa53dacfdc7/users/60d83c99be7b4bde8af3d134714aa814/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:03.798560 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21019cc-901a-4498-9a48-623d801db154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=600f113ec61042abae41ffa53dacfdc7, user_id=60d83c99be7b4bde8af3d134714aa814, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:03.801471 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21019cc-901a-4498-9a48-623d801db154 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:03.888735 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1156/2323] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:01:03 2022] PUT /identity/v3/projects/600f113ec61042abae41ffa53dacfdc7/users/60d83c99be7b4bde8af3d134714aa814/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:03.899858 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc358cb3-88bf-4e9f-ba27-9acc638e3143 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:03.900412 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f57665-2447-40c4-8f6e-029c61898e25 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:03.900706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f57665-2447-40c4-8f6e-029c61898e25 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:03.901055 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f57665-2447-40c4-8f6e-029c61898e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:03.902028 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-cc358cb3-88bf-4e9f-ba27-9acc638e3143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:03.930288 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-b2f57665-2447-40c4-8f6e-029c61898e25 None None] MFA Rules not processed for user `60d83c99be7b4bde8af3d134714aa814`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:03.931454 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b2f57665-2447-40c4-8f6e-029c61898e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:03.969126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc358cb3-88bf-4e9f-ba27-9acc638e3143 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:04.010099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1157/2324] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:04.015156 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f57665-2447-40c4-8f6e-029c61898e25 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:04.033646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d2b9d-d643-49ad-8c34-d142db2df312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:04.034306 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d2b9d-d643-49ad-8c34-d142db2df312 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:04.036980 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d2b9d-d643-49ad-8c34-d142db2df312 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:04.036980 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d2b9d-d643-49ad-8c34-d142db2df312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:04.037123 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e10d2b9d-d643-49ad-8c34-d142db2df312 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:04.091183 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f57665-2447-40c4-8f6e-029c61898e25 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:04.095985 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83a8ab-5d3e-4709-b1b2-ceab9b2275be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:04.096751 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83a8ab-5d3e-4709-b1b2-ceab9b2275be admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:04.097177 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83a8ab-5d3e-4709-b1b2-ceab9b2275be admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:04.097512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83a8ab-5d3e-4709-b1b2-ceab9b2275be admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:04.098223 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83a8ab-5d3e-4709-b1b2-ceab9b2275be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:04.100329 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83a8ab-5d3e-4709-b1b2-ceab9b2275be admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:04.126099 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d2b9d-d643-49ad-8c34-d142db2df312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:04.128313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d2b9d-d643-49ad-8c34-d142db2df312 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:04.146068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1168/2325] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:01:04.208160 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1158/2326] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:01:04 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:01:04.211301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d2b9d-d643-49ad-8c34-d142db2df312 service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:04.221701 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d2b9d-d643-49ad-8c34-d142db2df312 service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:04.283532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1fce2-784e-41c7-9f8e-718d4dce67b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:04.284265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1fce2-784e-41c7-9f8e-718d4dce67b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:04.284522 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1fce2-784e-41c7-9f8e-718d4dce67b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:04.284827 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1fce2-784e-41c7-9f8e-718d4dce67b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:04.285537 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1fce2-784e-41c7-9f8e-718d4dce67b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:04.287531 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1fce2-784e-41c7-9f8e-718d4dce67b9 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:04.375171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1169/2327] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:01:04 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:01:04.379599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83a8ab-5d3e-4709-b1b2-ceab9b2275be admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:04.390910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83a8ab-5d3e-4709-b1b2-ceab9b2275be admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:04.400693 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd376856-309f-4337-93b1-300a6a3b4c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:04.401369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd376856-309f-4337-93b1-300a6a3b4c2e admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:04.401658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd376856-309f-4337-93b1-300a6a3b4c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:04.401963 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd376856-309f-4337-93b1-300a6a3b4c2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:04.403027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd376856-309f-4337-93b1-300a6a3b4c2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:04.404659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd376856-309f-4337-93b1-300a6a3b4c2e admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:04.415648 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1159/2328] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:01:04.420969 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1fce2-784e-41c7-9f8e-718d4dce67b9 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:04.431197 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1fce2-784e-41c7-9f8e-718d4dce67b9 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:04.437254 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c44a86-b68a-4b00-8aaf-749bb6e17c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:04.437501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c44a86-b68a-4b00-8aaf-749bb6e17c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:04.437792 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c44a86-b68a-4b00-8aaf-749bb6e17c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:04.438075 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c44a86-b68a-4b00-8aaf-749bb6e17c92 admin admin] PATH_INFO: `/v3/projects/37757707870548dea71cdfceecf30766/users/5a54af4e940a49d3b3aa672b57a6fe4c/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:04.453137 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c44a86-b68a-4b00-8aaf-749bb6e17c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37757707870548dea71cdfceecf30766, user_id=5a54af4e940a49d3b3aa672b57a6fe4c, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:04.455810 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c44a86-b68a-4b00-8aaf-749bb6e17c92 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:04.536068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1170/2329] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:01:04 2022] PUT /identity/v3/projects/37757707870548dea71cdfceecf30766/users/5a54af4e940a49d3b3aa672b57a6fe4c/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:04.539986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd376856-309f-4337-93b1-300a6a3b4c2e admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:04.550618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd376856-309f-4337-93b1-300a6a3b4c2e admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:04.606473 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b358c-5c30-49d1-94e4-8673a6cf60c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:04.607136 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b358c-5c30-49d1-94e4-8673a6cf60c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:04.607452 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b358c-5c30-49d1-94e4-8673a6cf60c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:04.607729 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b358c-5c30-49d1-94e4-8673a6cf60c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:04.608496 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b358c-5c30-49d1-94e4-8673a6cf60c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:04.610071 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b358c-5c30-49d1-94e4-8673a6cf60c1 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:04.620368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1160/2330] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:01:04.624941 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c44a86-b68a-4b00-8aaf-749bb6e17c92 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:04.649566 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c44a86-b68a-4b00-8aaf-749bb6e17c92 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:04.655131 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762105a6-408b-46f8-bd83-efc1d2c94965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:04.659145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762105a6-408b-46f8-bd83-efc1d2c94965 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:04.659145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762105a6-408b-46f8-bd83-efc1d2c94965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:04.659145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762105a6-408b-46f8-bd83-efc1d2c94965 admin admin] PATH_INFO: `/v3/projects/37757707870548dea71cdfceecf30766/users/5a54af4e940a49d3b3aa672b57a6fe4c/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:04.659145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762105a6-408b-46f8-bd83-efc1d2c94965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37757707870548dea71cdfceecf30766, user_id=5a54af4e940a49d3b3aa672b57a6fe4c, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:04.661514 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762105a6-408b-46f8-bd83-efc1d2c94965 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:04.673962 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1171/2331] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:01:04 2022] PUT /identity/v3/projects/37757707870548dea71cdfceecf30766/users/5a54af4e940a49d3b3aa672b57a6fe4c/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:04.691154 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3ab52-1268-4565-be73-8194cb6acb21 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:04.691154 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3ab52-1268-4565-be73-8194cb6acb21 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:04.691154 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3ab52-1268-4565-be73-8194cb6acb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:04.714368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-a8a3ab52-1268-4565-be73-8194cb6acb21 None None] MFA Rules not processed for user `5a54af4e940a49d3b3aa672b57a6fe4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:04.715723 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-a8a3ab52-1268-4565-be73-8194cb6acb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:04.806173 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1161/2332] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:04.817520 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762105a6-408b-46f8-bd83-efc1d2c94965 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:04.917151 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762105a6-408b-46f8-bd83-efc1d2c94965 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:04.923031 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba69cd3-b45f-4c1b-9c63-f0588f1cba99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:04.923679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba69cd3-b45f-4c1b-9c63-f0588f1cba99 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:04.924222 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba69cd3-b45f-4c1b-9c63-f0588f1cba99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:04.924502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba69cd3-b45f-4c1b-9c63-f0588f1cba99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:04.934738 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba69cd3-b45f-4c1b-9c63-f0588f1cba99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:04.936372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba69cd3-b45f-4c1b-9c63-f0588f1cba99 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:04.946448 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1172/2333] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:01:05.012919 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3ab52-1268-4565-be73-8194cb6acb21 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:05.014535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-a8a3ab52-1268-4565-be73-8194cb6acb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:05.032542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3ab52-1268-4565-be73-8194cb6acb21 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:05.038434 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753245f-3655-4225-b5fd-443ecb277689 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:05.039179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753245f-3655-4225-b5fd-443ecb277689 service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:05.039588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753245f-3655-4225-b5fd-443ecb277689 service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:05.039944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753245f-3655-4225-b5fd-443ecb277689 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:05.042292 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-1753245f-3655-4225-b5fd-443ecb277689 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:05.110579 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753245f-3655-4225-b5fd-443ecb277689 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:05.112016 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753245f-3655-4225-b5fd-443ecb277689 service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:05.121370 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1162/2334] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:01:05.515956 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:06.328357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:06.808037 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba69cd3-b45f-4c1b-9c63-f0588f1cba99 service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:06.874761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba69cd3-b45f-4c1b-9c63-f0588f1cba99 service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:06.879314 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5267ef-f382-4067-b653-b6d34efb5d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:06.880215 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5267ef-f382-4067-b653-b6d34efb5d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:06.880500 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5267ef-f382-4067-b653-b6d34efb5d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:06.880779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5267ef-f382-4067-b653-b6d34efb5d87 admin admin] PATH_INFO: `/v3/users/60d83c99be7b4bde8af3d134714aa814` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:06.881963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5267ef-f382-4067-b653-b6d34efb5d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d83c99be7b4bde8af3d134714aa814)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:06.883885 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5267ef-f382-4067-b653-b6d34efb5d87 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:07.092744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-1c5267ef-f382-4067-b653-b6d34efb5d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d83c99be7b4bde8af3d134714aa814'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:07.099453 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-1c5267ef-f382-4067-b653-b6d34efb5d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d83c99be7b4bde8af3d134714aa814'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:07.100140 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-1c5267ef-f382-4067-b653-b6d34efb5d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d83c99be7b4bde8af3d134714aa814'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:07.112576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-1c5267ef-f382-4067-b653-b6d34efb5d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d83c99be7b4bde8af3d134714aa814'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:07.113252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-1c5267ef-f382-4067-b653-b6d34efb5d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d83c99be7b4bde8af3d134714aa814'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:07.191191 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1173/2335] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:01:06 2022] DELETE /identity/v3/users/60d83c99be7b4bde8af3d134714aa814 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:07.195525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a1dfe-dfb2-4491-baf6-f7df58a89ae9 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:07.195904 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a1dfe-dfb2-4491-baf6-f7df58a89ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:07.196091 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a1dfe-dfb2-4491-baf6-f7df58a89ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:07.215863 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-641a1dfe-dfb2-4491-baf6-f7df58a89ae9 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:07.217700 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-641a1dfe-dfb2-4491-baf6-f7df58a89ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:07.267549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:07.299241 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1163/2336] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:07.316974 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5267ef-f382-4067-b653-b6d34efb5d87 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:07.318355 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-1c5267ef-f382-4067-b653-b6d34efb5d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:07.364960 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:07.392914 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5267ef-f382-4067-b653-b6d34efb5d87 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:07.400164 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf69ce3-1b25-4bc5-9aff-eb9ec4e3c621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:07.400164 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf69ce3-1b25-4bc5-9aff-eb9ec4e3c621 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:07.400482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf69ce3-1b25-4bc5-9aff-eb9ec4e3c621 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:07.400759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf69ce3-1b25-4bc5-9aff-eb9ec4e3c621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:07.414273 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf69ce3-1b25-4bc5-9aff-eb9ec4e3c621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:07.415634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf69ce3-1b25-4bc5-9aff-eb9ec4e3c621 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:07.433424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1174/2337] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:01:08.008461 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a1dfe-dfb2-4491-baf6-f7df58a89ae9 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:08.010119 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-641a1dfe-dfb2-4491-baf6-f7df58a89ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:08.033502 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a1dfe-dfb2-4491-baf6-f7df58a89ae9 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:08.051601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b3564-5b8a-430c-aa7a-9eb67553b077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:08.052910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b3564-5b8a-430c-aa7a-9eb67553b077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:08.053298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b3564-5b8a-430c-aa7a-9eb67553b077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:08.054673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b3564-5b8a-430c-aa7a-9eb67553b077 admin admin] PATH_INFO: `/v3/projects/600f113ec61042abae41ffa53dacfdc7` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:08.064885 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b3564-5b8a-430c-aa7a-9eb67553b077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=600f113ec61042abae41ffa53dacfdc7)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:08.068224 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b3564-5b8a-430c-aa7a-9eb67553b077 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:08.224402 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-048b3564-5b8a-430c-aa7a-9eb67553b077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '600f113ec61042abae41ffa53dacfdc7', 'request_id': 'req-048b3564-5b8a-430c-aa7a-9eb67553b077'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:08.304300 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-048b3564-5b8a-430c-aa7a-9eb67553b077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '600f113ec61042abae41ffa53dacfdc7', 'request_id': 'req-048b3564-5b8a-430c-aa7a-9eb67553b077'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:08.315017 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-048b3564-5b8a-430c-aa7a-9eb67553b077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '600f113ec61042abae41ffa53dacfdc7', 'request_id': 'req-048b3564-5b8a-430c-aa7a-9eb67553b077'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:08.339274 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-048b3564-5b8a-430c-aa7a-9eb67553b077 admin admin] The token cache is being invalidate because project 600f113ec61042abae41ffa53dacfdc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:01:08.339799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-048b3564-5b8a-430c-aa7a-9eb67553b077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:08.340490 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-048b3564-5b8a-430c-aa7a-9eb67553b077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:08.343536 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1164/2338] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:01:08 2022] DELETE /identity/v3/projects/600f113ec61042abae41ffa53dacfdc7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:08.346978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf69ce3-1b25-4bc5-9aff-eb9ec4e3c621 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:08.401566 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf69ce3-1b25-4bc5-9aff-eb9ec4e3c621 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:08.473837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0352a9-094d-47b9-a9b1-d1335f69cfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:08.475111 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0352a9-094d-47b9-a9b1-d1335f69cfd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:08.475903 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0352a9-094d-47b9-a9b1-d1335f69cfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:08.476227 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0352a9-094d-47b9-a9b1-d1335f69cfd4 admin admin] PATH_INFO: `/v3/users/5a54af4e940a49d3b3aa672b57a6fe4c` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:08.477826 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0352a9-094d-47b9-a9b1-d1335f69cfd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a54af4e940a49d3b3aa672b57a6fe4c)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:08.481130 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0352a9-094d-47b9-a9b1-d1335f69cfd4 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:08.700612 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-1c0352a9-094d-47b9-a9b1-d1335f69cfd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a54af4e940a49d3b3aa672b57a6fe4c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:08.707604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-1c0352a9-094d-47b9-a9b1-d1335f69cfd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a54af4e940a49d3b3aa672b57a6fe4c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:08.708309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-1c0352a9-094d-47b9-a9b1-d1335f69cfd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a54af4e940a49d3b3aa672b57a6fe4c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:08.720520 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-1c0352a9-094d-47b9-a9b1-d1335f69cfd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a54af4e940a49d3b3aa672b57a6fe4c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:08.721242 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-1c0352a9-094d-47b9-a9b1-d1335f69cfd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a54af4e940a49d3b3aa672b57a6fe4c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:08.821561 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1175/2339] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:01:08 2022] DELETE /identity/v3/users/5a54af4e940a49d3b3aa672b57a6fe4c => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:08.886479 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b3564-5b8a-430c-aa7a-9eb67553b077 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:08.893082 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-048b3564-5b8a-430c-aa7a-9eb67553b077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:08.970248 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b3564-5b8a-430c-aa7a-9eb67553b077 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:09.022369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:09.032400 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f488de-77c3-4067-b4d2-d4861830ff74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:09.032724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f488de-77c3-4067-b4d2-d4861830ff74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:09.033006 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f488de-77c3-4067-b4d2-d4861830ff74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:09.033286 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f488de-77c3-4067-b4d2-d4861830ff74 admin admin] PATH_INFO: `/v3/users/a66c0b03c20d4a138adebb049db831b8` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:09.034497 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f488de-77c3-4067-b4d2-d4861830ff74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a66c0b03c20d4a138adebb049db831b8)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:09.036481 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f488de-77c3-4067-b4d2-d4861830ff74 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:09.256361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-70f488de-77c3-4067-b4d2-d4861830ff74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a66c0b03c20d4a138adebb049db831b8'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:09.256917 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-70f488de-77c3-4067-b4d2-d4861830ff74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a66c0b03c20d4a138adebb049db831b8'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:09.331930 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0352a9-094d-47b9-a9b1-d1335f69cfd4 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:09.333500 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-1c0352a9-094d-47b9-a9b1-d1335f69cfd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:09.346181 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0352a9-094d-47b9-a9b1-d1335f69cfd4 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:09.350759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b051677-fa95-4968-85f4-b886539139d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:09.351606 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b051677-fa95-4968-85f4-b886539139d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:09.351887 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b051677-fa95-4968-85f4-b886539139d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:09.352187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b051677-fa95-4968-85f4-b886539139d8 admin admin] PATH_INFO: `/v3/projects/37757707870548dea71cdfceecf30766` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:09.353403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b051677-fa95-4968-85f4-b886539139d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37757707870548dea71cdfceecf30766)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:09.355305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b051677-fa95-4968-85f4-b886539139d8 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:09.358720 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-70f488de-77c3-4067-b4d2-d4861830ff74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a66c0b03c20d4a138adebb049db831b8'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:09.359353 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-70f488de-77c3-4067-b4d2-d4861830ff74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a66c0b03c20d4a138adebb049db831b8'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:09.374081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-70f488de-77c3-4067-b4d2-d4861830ff74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a66c0b03c20d4a138adebb049db831b8'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:09.386723 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1165/2340] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:01:08 2022] DELETE /identity/v3/users/a66c0b03c20d4a138adebb049db831b8 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:09.391723 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c9e0c-a4a9-4337-a43f-5ff1c78017e2 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:09.392015 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c9e0c-a4a9-4337-a43f-5ff1c78017e2 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:09.392328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c9e0c-a4a9-4337-a43f-5ff1c78017e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:09.417545 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-e10c9e0c-a4a9-4337-a43f-5ff1c78017e2 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:09.418748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e10c9e0c-a4a9-4337-a43f-5ff1c78017e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:09.474961 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1166/2341] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:01:09.484846 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c9e0c-a4a9-4337-a43f-5ff1c78017e2 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:09.486306 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e10c9e0c-a4a9-4337-a43f-5ff1c78017e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:09.512338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-6b051677-fa95-4968-85f4-b886539139d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37757707870548dea71cdfceecf30766', 'request_id': 'req-6b051677-fa95-4968-85f4-b886539139d8'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:09.578545 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-6b051677-fa95-4968-85f4-b886539139d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37757707870548dea71cdfceecf30766', 'request_id': 'req-6b051677-fa95-4968-85f4-b886539139d8'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:09.586868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-6b051677-fa95-4968-85f4-b886539139d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37757707870548dea71cdfceecf30766', 'request_id': 'req-6b051677-fa95-4968-85f4-b886539139d8'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:09.598804 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-6b051677-fa95-4968-85f4-b886539139d8 admin admin] The token cache is being invalidate because project 37757707870548dea71cdfceecf30766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:01:09.599289 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-6b051677-fa95-4968-85f4-b886539139d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:09.600028 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-6b051677-fa95-4968-85f4-b886539139d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:09.603456 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1176/2342] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:01:09 2022] DELETE /identity/v3/projects/37757707870548dea71cdfceecf30766 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:01:09.604369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c9e0c-a4a9-4337-a43f-5ff1c78017e2 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:09.604508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b051677-fa95-4968-85f4-b886539139d8 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:09.608745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-6b051677-fa95-4968-85f4-b886539139d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:09.668905 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0cefe-7bd6-4787-af32-deb4df5c28ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:09.670246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0cefe-7bd6-4787-af32-deb4df5c28ba service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:09.670655 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0cefe-7bd6-4787-af32-deb4df5c28ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:09.670942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0cefe-7bd6-4787-af32-deb4df5c28ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:09.673863 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-08a0cefe-7bd6-4787-af32-deb4df5c28ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:09.705739 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b051677-fa95-4968-85f4-b886539139d8 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:09.712473 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974886c4-5119-4907-96dd-ff09c705a060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:09.713252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974886c4-5119-4907-96dd-ff09c705a060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:09.713543 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974886c4-5119-4907-96dd-ff09c705a060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:09.713820 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974886c4-5119-4907-96dd-ff09c705a060 admin admin] PATH_INFO: `/v3/users/f7131884e2744bd79e3f0b4ff87256d3` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:09.715054 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974886c4-5119-4907-96dd-ff09c705a060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7131884e2744bd79e3f0b4ff87256d3)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:09.717563 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974886c4-5119-4907-96dd-ff09c705a060 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:09.743373 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0cefe-7bd6-4787-af32-deb4df5c28ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:09.744844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0cefe-7bd6-4787-af32-deb4df5c28ba service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:09.755330 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1167/2343] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:01:09.756875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86dca4-83eb-40e9-aa3f-a61a2feabd2b None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:09.757322 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86dca4-83eb-40e9-aa3f-a61a2feabd2b None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:09.757846 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86dca4-83eb-40e9-aa3f-a61a2feabd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:09.803263 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-1c86dca4-83eb-40e9-aa3f-a61a2feabd2b None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:09.804691 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-1c86dca4-83eb-40e9-aa3f-a61a2feabd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:09.813232 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1168/2344] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:09.820882 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981acec5-4c78-46eb-a617-4f8bb9daf721 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:09.821418 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981acec5-4c78-46eb-a617-4f8bb9daf721 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:09.821801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981acec5-4c78-46eb-a617-4f8bb9daf721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:09.840596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-981acec5-4c78-46eb-a617-4f8bb9daf721 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:09.841196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-981acec5-4c78-46eb-a617-4f8bb9daf721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:09.851282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1169/2345] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:01:09.855319 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981acec5-4c78-46eb-a617-4f8bb9daf721 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:09.865768 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981acec5-4c78-46eb-a617-4f8bb9daf721 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:09.870604 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bd621-415a-43b3-b136-a997f2705f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:09.871354 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bd621-415a-43b3-b136-a997f2705f12 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:09.872222 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bd621-415a-43b3-b136-a997f2705f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:09.872222 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bd621-415a-43b3-b136-a997f2705f12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:09.872711 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bd621-415a-43b3-b136-a997f2705f12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:01:09.873627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bd621-415a-43b3-b136-a997f2705f12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:09.875364 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bd621-415a-43b3-b136-a997f2705f12 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:09.887424 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1170/2346] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 17:01:09.891288 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bd621-415a-43b3-b136-a997f2705f12 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:09.901020 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bd621-415a-43b3-b136-a997f2705f12 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:09.906128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1938fe-7ba4-487e-9ea4-7e448e14b270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:09.906774 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1938fe-7ba4-487e-9ea4-7e448e14b270 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:09.907062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1938fe-7ba4-487e-9ea4-7e448e14b270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:09.909737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1938fe-7ba4-487e-9ea4-7e448e14b270 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:09.909737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1938fe-7ba4-487e-9ea4-7e448e14b270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:09.910090 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1938fe-7ba4-487e-9ea4-7e448e14b270 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:09.942490 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-974886c4-5119-4907-96dd-ff09c705a060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7131884e2744bd79e3f0b4ff87256d3'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:09.949658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-974886c4-5119-4907-96dd-ff09c705a060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7131884e2744bd79e3f0b4ff87256d3'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:09.950375 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-974886c4-5119-4907-96dd-ff09c705a060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7131884e2744bd79e3f0b4ff87256d3'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:09.957864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:09.969264 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-974886c4-5119-4907-96dd-ff09c705a060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7131884e2744bd79e3f0b4ff87256d3'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:09.970034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-974886c4-5119-4907-96dd-ff09c705a060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7131884e2744bd79e3f0b4ff87256d3'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:09.995718 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1171/2347] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:01:09 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:01:09.997230 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1938fe-7ba4-487e-9ea4-7e448e14b270 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:10.001575 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-5a1938fe-7ba4-487e-9ea4-7e448e14b270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:10.077247 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1177/2348] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:01:09 2022] DELETE /identity/v3/users/f7131884e2744bd79e3f0b4ff87256d3 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:10.081431 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7b81c-65a9-48d3-a8f4-6ee1c5c8a63c None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:10.081827 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7b81c-65a9-48d3-a8f4-6ee1c5c8a63c None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:10.082185 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7b81c-65a9-48d3-a8f4-6ee1c5c8a63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:10.083706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1938fe-7ba4-487e-9ea4-7e448e14b270 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:10.106239 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-34b7b81c-65a9-48d3-a8f4-6ee1c5c8a63c None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:10.108226 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-34b7b81c-65a9-48d3-a8f4-6ee1c5c8a63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:10.151778 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4dabf3-ed8b-42f0-bba8-641d5f60e7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:10.152481 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dabf3-ed8b-42f0-bba8-641d5f60e7f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:10.153035 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dabf3-ed8b-42f0-bba8-641d5f60e7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:10.153314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dabf3-ed8b-42f0-bba8-641d5f60e7f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:10.154014 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4dabf3-ed8b-42f0-bba8-641d5f60e7f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:10.156565 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4dabf3-ed8b-42f0-bba8-641d5f60e7f7 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:10.176030 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1178/2349] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:01:10.185686 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7b81c-65a9-48d3-a8f4-6ee1c5c8a63c None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:10.186976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-34b7b81c-65a9-48d3-a8f4-6ee1c5c8a63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:10.248821 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1172/2350] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:01:09 2022] POST /identity/v3/users => generated 285 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:01:10.249924 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4dabf3-ed8b-42f0-bba8-641d5f60e7f7 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:10.251759 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-1c4dabf3-ed8b-42f0-bba8-641d5f60e7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:10.263314 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7b81c-65a9-48d3-a8f4-6ee1c5c8a63c None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:10.267826 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3c93a-1b37-4ac9-a60c-8dd2b815a0f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:10.269786 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3c93a-1b37-4ac9-a60c-8dd2b815a0f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:10.269786 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3c93a-1b37-4ac9-a60c-8dd2b815a0f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:10.269786 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3c93a-1b37-4ac9-a60c-8dd2b815a0f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:10.281232 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4dabf3-ed8b-42f0-bba8-641d5f60e7f7 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:10.282720 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3c93a-1b37-4ac9-a60c-8dd2b815a0f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:10.284327 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3c93a-1b37-4ac9-a60c-8dd2b815a0f6 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:10.284549 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9eee0-aedf-4cb4-ad58-5af8d1b05f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:10.285361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9eee0-aedf-4cb4-ad58-5af8d1b05f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:10.285566 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9eee0-aedf-4cb4-ad58-5af8d1b05f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:10.286092 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9eee0-aedf-4cb4-ad58-5af8d1b05f81 admin admin] PATH_INFO: `/v3/projects/366312674e204e888f62977f146e29c5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:10.287342 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9eee0-aedf-4cb4-ad58-5af8d1b05f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=366312674e204e888f62977f146e29c5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:10.289317 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb9eee0-aedf-4cb4-ad58-5af8d1b05f81 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:10.294583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1179/2351] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:01:10.295991 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3c93a-1b37-4ac9-a60c-8dd2b815a0f6 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:10.305838 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3c93a-1b37-4ac9-a60c-8dd2b815a0f6 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:10.310735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193558e-4dec-4914-8bee-80cbf140a91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:10.311601 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193558e-4dec-4914-8bee-80cbf140a91d admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:10.312312 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193558e-4dec-4914-8bee-80cbf140a91d admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:10.312604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193558e-4dec-4914-8bee-80cbf140a91d admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:10.313343 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193558e-4dec-4914-8bee-80cbf140a91d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:10.315098 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193558e-4dec-4914-8bee-80cbf140a91d admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:10.333514 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1180/2352] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:01:10.337310 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193558e-4dec-4914-8bee-80cbf140a91d admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:10.349716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193558e-4dec-4914-8bee-80cbf140a91d admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:10.354662 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4072d1b-106d-43d6-b876-e15c1b859b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:10.355341 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4072d1b-106d-43d6-b876-e15c1b859b30 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:10.366208 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4072d1b-106d-43d6-b876-e15c1b859b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:10.366208 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4072d1b-106d-43d6-b876-e15c1b859b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:10.366208 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4072d1b-106d-43d6-b876-e15c1b859b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:10.366208 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4072d1b-106d-43d6-b876-e15c1b859b30 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:10.371081 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1181/2353] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:01:10.375227 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4072d1b-106d-43d6-b876-e15c1b859b30 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:10.385477 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4072d1b-106d-43d6-b876-e15c1b859b30 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:10.391632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89255743-2125-46da-85a0-296765789dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:10.392595 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89255743-2125-46da-85a0-296765789dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:10.392889 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89255743-2125-46da-85a0-296765789dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:10.393175 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89255743-2125-46da-85a0-296765789dc9 admin admin] PATH_INFO: `/v3/projects/5fc0e908707c437fb0169bee580c7168/users/7ede9128d6354158b27db10da90b18fc/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:10.409316 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89255743-2125-46da-85a0-296765789dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc0e908707c437fb0169bee580c7168, user_id=7ede9128d6354158b27db10da90b18fc, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:10.412444 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89255743-2125-46da-85a0-296765789dc9 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:10.429417 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-fbb9eee0-aedf-4cb4-ad58-5af8d1b05f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '366312674e204e888f62977f146e29c5', 'request_id': 'req-fbb9eee0-aedf-4cb4-ad58-5af8d1b05f81'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:10.534032 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-fbb9eee0-aedf-4cb4-ad58-5af8d1b05f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '366312674e204e888f62977f146e29c5', 'request_id': 'req-fbb9eee0-aedf-4cb4-ad58-5af8d1b05f81'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:10.541258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1182/2354] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:01:10 2022] PUT /identity/v3/projects/5fc0e908707c437fb0169bee580c7168/users/7ede9128d6354158b27db10da90b18fc/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:01:10.549845 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-fbb9eee0-aedf-4cb4-ad58-5af8d1b05f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '366312674e204e888f62977f146e29c5', 'request_id': 'req-fbb9eee0-aedf-4cb4-ad58-5af8d1b05f81'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:10.552583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10010d9b-5ed5-4008-8ced-ecc80aba5979 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:10.553052 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10010d9b-5ed5-4008-8ced-ecc80aba5979 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:10.553338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10010d9b-5ed5-4008-8ced-ecc80aba5979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:10.565848 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-fbb9eee0-aedf-4cb4-ad58-5af8d1b05f81 admin admin] The token cache is being invalidate because project 366312674e204e888f62977f146e29c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:01:10.566202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-fbb9eee0-aedf-4cb4-ad58-5af8d1b05f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:10.567718 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-fbb9eee0-aedf-4cb4-ad58-5af8d1b05f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:10.570157 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1173/2355] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:01:10 2022] DELETE /identity/v3/projects/366312674e204e888f62977f146e29c5 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:10.574308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9eee0-aedf-4cb4-ad58-5af8d1b05f81 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:10.577348 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-fbb9eee0-aedf-4cb4-ad58-5af8d1b05f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:10.587343 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-10010d9b-5ed5-4008-8ced-ecc80aba5979 None None] MFA Rules not processed for user `7ede9128d6354158b27db10da90b18fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:10.591008 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-10010d9b-5ed5-4008-8ced-ecc80aba5979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:10.673417 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9eee0-aedf-4cb4-ad58-5af8d1b05f81 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:10.749013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1183/2356] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:10.768632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10010d9b-5ed5-4008-8ced-ecc80aba5979 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:10.773690 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-10010d9b-5ed5-4008-8ced-ecc80aba5979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:10.776989 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd25f11-7fe6-4931-bf30-a61c8a67cb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:10.778830 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd25f11-7fe6-4931-bf30-a61c8a67cb16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:10.779468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd25f11-7fe6-4931-bf30-a61c8a67cb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:10.780372 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd25f11-7fe6-4931-bf30-a61c8a67cb16 admin admin] PATH_INFO: `/v3/users/f675b5ca7b2f41bc9f3cee54221fd9e3` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:10.783915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd25f11-7fe6-4931-bf30-a61c8a67cb16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f675b5ca7b2f41bc9f3cee54221fd9e3)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:10.784542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd25f11-7fe6-4931-bf30-a61c8a67cb16 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:10.877418 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10010d9b-5ed5-4008-8ced-ecc80aba5979 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:10.882974 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0960861-2268-4c64-a80c-ff396a0efca2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '144e0074ab4d4e5c8743e4f7d68a89b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:10.883984 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0960861-2268-4c64-a80c-ff396a0efca2 service glance] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:10.884491 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0960861-2268-4c64-a80c-ff396a0efca2 service glance] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:10.885198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0960861-2268-4c64-a80c-ff396a0efca2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:10.902527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0960861-2268-4c64-a80c-ff396a0efca2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:10.903238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0960861-2268-4c64-a80c-ff396a0efca2 service glance] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:10.927724 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:10.931454 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1184/2357] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:01:11.038086 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-1fd25f11-7fe6-4931-bf30-a61c8a67cb16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f675b5ca7b2f41bc9f3cee54221fd9e3'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:11.040438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-1fd25f11-7fe6-4931-bf30-a61c8a67cb16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f675b5ca7b2f41bc9f3cee54221fd9e3'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:11.132787 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-1fd25f11-7fe6-4931-bf30-a61c8a67cb16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f675b5ca7b2f41bc9f3cee54221fd9e3'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:11.133524 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-1fd25f11-7fe6-4931-bf30-a61c8a67cb16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f675b5ca7b2f41bc9f3cee54221fd9e3'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:11.151157 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-1fd25f11-7fe6-4931-bf30-a61c8a67cb16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f675b5ca7b2f41bc9f3cee54221fd9e3'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:11.168411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1174/2358] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:01:10 2022] DELETE /identity/v3/users/f675b5ca7b2f41bc9f3cee54221fd9e3 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:11.590742 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0960861-2268-4c64-a80c-ff396a0efca2 service glance] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:11.592899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-a0960861-2268-4c64-a80c-ff396a0efca2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:11.622041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0960861-2268-4c64-a80c-ff396a0efca2 service glance] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:11.708937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9f815-10d0-42be-bdb6-60a0bdf50557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:11.709809 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9f815-10d0-42be-bdb6-60a0bdf50557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:11.710102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9f815-10d0-42be-bdb6-60a0bdf50557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:11.710381 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9f815-10d0-42be-bdb6-60a0bdf50557 admin admin] PATH_INFO: `/v3/projects/82fa3809cfe34e3692ff07d682d41bfe` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:11.711641 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9f815-10d0-42be-bdb6-60a0bdf50557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82fa3809cfe34e3692ff07d682d41bfe)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:11.713601 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9f815-10d0-42be-bdb6-60a0bdf50557 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:11.789094 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd25f11-7fe6-4931-bf30-a61c8a67cb16 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:11.790653 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-1fd25f11-7fe6-4931-bf30-a61c8a67cb16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:11.805984 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd25f11-7fe6-4931-bf30-a61c8a67cb16 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:11.826981 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06039147-110b-4a0b-a786-dc4e8c0bff08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:11.827973 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06039147-110b-4a0b-a786-dc4e8c0bff08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:11.828283 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06039147-110b-4a0b-a786-dc4e8c0bff08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:11.829303 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06039147-110b-4a0b-a786-dc4e8c0bff08 admin admin] PATH_INFO: `/v3/projects/ac0d8abec3e040f383e278703b8aca54` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:11.832534 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06039147-110b-4a0b-a786-dc4e8c0bff08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac0d8abec3e040f383e278703b8aca54)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:11.834762 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06039147-110b-4a0b-a786-dc4e8c0bff08 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:11.870155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-e3f9f815-10d0-42be-bdb6-60a0bdf50557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82fa3809cfe34e3692ff07d682d41bfe', 'request_id': 'req-e3f9f815-10d0-42be-bdb6-60a0bdf50557'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:11.954597 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-06039147-110b-4a0b-a786-dc4e8c0bff08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac0d8abec3e040f383e278703b8aca54', 'request_id': 'req-06039147-110b-4a0b-a786-dc4e8c0bff08'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:11.968662 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-e3f9f815-10d0-42be-bdb6-60a0bdf50557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82fa3809cfe34e3692ff07d682d41bfe', 'request_id': 'req-e3f9f815-10d0-42be-bdb6-60a0bdf50557'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:11.979073 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-e3f9f815-10d0-42be-bdb6-60a0bdf50557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82fa3809cfe34e3692ff07d682d41bfe', 'request_id': 'req-e3f9f815-10d0-42be-bdb6-60a0bdf50557'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:11.993480 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-e3f9f815-10d0-42be-bdb6-60a0bdf50557 admin admin] The token cache is being invalidate because project 82fa3809cfe34e3692ff07d682d41bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:01:11.994641 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-e3f9f815-10d0-42be-bdb6-60a0bdf50557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:11.995517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-e3f9f815-10d0-42be-bdb6-60a0bdf50557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:11.997439 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1185/2359] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:01:11 2022] DELETE /identity/v3/projects/82fa3809cfe34e3692ff07d682d41bfe => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:12.005300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9f815-10d0-42be-bdb6-60a0bdf50557 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:12.011589 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e3f9f815-10d0-42be-bdb6-60a0bdf50557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:12.061758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-06039147-110b-4a0b-a786-dc4e8c0bff08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac0d8abec3e040f383e278703b8aca54', 'request_id': 'req-06039147-110b-4a0b-a786-dc4e8c0bff08'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:12.062696 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-06039147-110b-4a0b-a786-dc4e8c0bff08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac0d8abec3e040f383e278703b8aca54', 'request_id': 'req-06039147-110b-4a0b-a786-dc4e8c0bff08'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:12.076950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-06039147-110b-4a0b-a786-dc4e8c0bff08 admin admin] The token cache is being invalidate because project ac0d8abec3e040f383e278703b8aca54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:01:12.077527 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-06039147-110b-4a0b-a786-dc4e8c0bff08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:12.078406 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-06039147-110b-4a0b-a786-dc4e8c0bff08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:12.080747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1175/2360] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:01:11 2022] DELETE /identity/v3/projects/ac0d8abec3e040f383e278703b8aca54 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:01:12.085726 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06039147-110b-4a0b-a786-dc4e8c0bff08 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:12.090750 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-06039147-110b-4a0b-a786-dc4e8c0bff08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:12.149102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9f815-10d0-42be-bdb6-60a0bdf50557 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:12.224347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06039147-110b-4a0b-a786-dc4e8c0bff08 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:12.230813 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f127e8-40d7-40ed-9197-ffa4fc332838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:12.232553 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f127e8-40d7-40ed-9197-ffa4fc332838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:12.233063 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f127e8-40d7-40ed-9197-ffa4fc332838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:12.233596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f127e8-40d7-40ed-9197-ffa4fc332838 admin admin] PATH_INFO: `/v3/users/dc94a1ca7a974d248819ecff5d887410` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:12.235406 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f127e8-40d7-40ed-9197-ffa4fc332838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc94a1ca7a974d248819ecff5d887410)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:12.237864 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f127e8-40d7-40ed-9197-ffa4fc332838 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:12.242230 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f9ddf-06af-481f-8a08-c4acfdb28d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:12.243192 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f9ddf-06af-481f-8a08-c4acfdb28d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:12.243762 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f9ddf-06af-481f-8a08-c4acfdb28d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:12.244065 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f9ddf-06af-481f-8a08-c4acfdb28d9d admin admin] PATH_INFO: `/v3/users/10f1d6fb67cc49f48a7b659089c9cf78` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:12.245661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f9ddf-06af-481f-8a08-c4acfdb28d9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f1d6fb67cc49f48a7b659089c9cf78)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:12.250915 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f9ddf-06af-481f-8a08-c4acfdb28d9d admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:12.500634 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-10f127e8-40d7-40ed-9197-ffa4fc332838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc94a1ca7a974d248819ecff5d887410'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:12.502057 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-10f127e8-40d7-40ed-9197-ffa4fc332838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc94a1ca7a974d248819ecff5d887410'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:12.559094 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-3c5f9ddf-06af-481f-8a08-c4acfdb28d9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f1d6fb67cc49f48a7b659089c9cf78'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:12.580485 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-3c5f9ddf-06af-481f-8a08-c4acfdb28d9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f1d6fb67cc49f48a7b659089c9cf78'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:12.584421 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-3c5f9ddf-06af-481f-8a08-c4acfdb28d9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f1d6fb67cc49f48a7b659089c9cf78'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:12.630083 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-3c5f9ddf-06af-481f-8a08-c4acfdb28d9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f1d6fb67cc49f48a7b659089c9cf78'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:12.630822 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-3c5f9ddf-06af-481f-8a08-c4acfdb28d9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f1d6fb67cc49f48a7b659089c9cf78'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:12.632637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-10f127e8-40d7-40ed-9197-ffa4fc332838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc94a1ca7a974d248819ecff5d887410'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:12.644968 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-10f127e8-40d7-40ed-9197-ffa4fc332838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc94a1ca7a974d248819ecff5d887410'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:12.648884 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-10f127e8-40d7-40ed-9197-ffa4fc332838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc94a1ca7a974d248819ecff5d887410'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:12.669137 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:12.693589 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1176/2361] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:01:12 2022] DELETE /identity/v3/users/dc94a1ca7a974d248819ecff5d887410 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:12.791766 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:12.799539 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1186/2362] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:01:12 2022] DELETE /identity/v3/users/10f1d6fb67cc49f48a7b659089c9cf78 => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:13.440025 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f127e8-40d7-40ed-9197-ffa4fc332838 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:13.442949 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-10f127e8-40d7-40ed-9197-ffa4fc332838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:13.543244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f127e8-40d7-40ed-9197-ffa4fc332838 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:13.634393 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7e929-cac1-47e7-a7c0-280d5e2e7057 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:13.634993 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7e929-cac1-47e7-a7c0-280d5e2e7057 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:13.635093 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7e929-cac1-47e7-a7c0-280d5e2e7057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:13.656183 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a580a-6e9e-4ddb-bfa1-8177f37abe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:13.657077 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a580a-6e9e-4ddb-bfa1-8177f37abe62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:13.657359 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a580a-6e9e-4ddb-bfa1-8177f37abe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:13.657633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a580a-6e9e-4ddb-bfa1-8177f37abe62 admin admin] PATH_INFO: `/v3/projects/d26e17bd988947f5aa3d831010b60049` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:13.659389 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a580a-6e9e-4ddb-bfa1-8177f37abe62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d26e17bd988947f5aa3d831010b60049)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:13.661380 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a580a-6e9e-4ddb-bfa1-8177f37abe62 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:13.675202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-90a7e929-cac1-47e7-a7c0-280d5e2e7057 None None] MFA Rules not processed for user `276147f205ae43da9df678dcd572115a`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:13.684313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-90a7e929-cac1-47e7-a7c0-280d5e2e7057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:13.776386 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1187/2363] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:01:13.849959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f80a580a-6e9e-4ddb-bfa1-8177f37abe62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd26e17bd988947f5aa3d831010b60049', 'request_id': 'req-f80a580a-6e9e-4ddb-bfa1-8177f37abe62'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:13.923877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7e929-cac1-47e7-a7c0-280d5e2e7057 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:13.925744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-90a7e929-cac1-47e7-a7c0-280d5e2e7057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:13.942765 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7e929-cac1-47e7-a7c0-280d5e2e7057 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:13.962861 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f80a580a-6e9e-4ddb-bfa1-8177f37abe62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd26e17bd988947f5aa3d831010b60049', 'request_id': 'req-f80a580a-6e9e-4ddb-bfa1-8177f37abe62'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:13.972955 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f80a580a-6e9e-4ddb-bfa1-8177f37abe62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd26e17bd988947f5aa3d831010b60049', 'request_id': 'req-f80a580a-6e9e-4ddb-bfa1-8177f37abe62'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:14.000631 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f80a580a-6e9e-4ddb-bfa1-8177f37abe62 admin admin] The token cache is being invalidate because project d26e17bd988947f5aa3d831010b60049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:01:14.002902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f80a580a-6e9e-4ddb-bfa1-8177f37abe62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:14.003603 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f80a580a-6e9e-4ddb-bfa1-8177f37abe62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:14.016658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1177/2364] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:01:13 2022] DELETE /identity/v3/projects/d26e17bd988947f5aa3d831010b60049 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:14.021608 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b015e-09ef-4504-9cb5-25ae506fff91 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:14.021909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b015e-09ef-4504-9cb5-25ae506fff91 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:14.022202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b015e-09ef-4504-9cb5-25ae506fff91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:14.084148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-a54b015e-09ef-4504-9cb5-25ae506fff91 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:14.085812 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-a54b015e-09ef-4504-9cb5-25ae506fff91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:14.114413 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454c120-f314-40ff-b145-695fbaa4a5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:14.116272 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454c120-f314-40ff-b145-695fbaa4a5df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:14.117345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454c120-f314-40ff-b145-695fbaa4a5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:14.117787 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454c120-f314-40ff-b145-695fbaa4a5df admin admin] PATH_INFO: `/v3/projects/b19c4c03cfd7454099f32dacb67c76cb` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:14.119443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454c120-f314-40ff-b145-695fbaa4a5df admin admin] RBAC: Authorizing `identity:delete_project(project_id=b19c4c03cfd7454099f32dacb67c76cb)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:14.124262 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454c120-f314-40ff-b145-695fbaa4a5df admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:14.200150 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1178/2365] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:14.211895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2355c-00e9-484b-ba6b-137255f7480c None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:14.212217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2355c-00e9-484b-ba6b-137255f7480c None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:14.212502 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2355c-00e9-484b-ba6b-137255f7480c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:14.248358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-aef2355c-00e9-484b-ba6b-137255f7480c None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:14.249900 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-aef2355c-00e9-484b-ba6b-137255f7480c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:14.259406 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4454c120-f314-40ff-b145-695fbaa4a5df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b19c4c03cfd7454099f32dacb67c76cb', 'request_id': 'req-4454c120-f314-40ff-b145-695fbaa4a5df'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:14.317706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1179/2366] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:01:14.323125 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2355c-00e9-484b-ba6b-137255f7480c None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:14.333703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2355c-00e9-484b-ba6b-137255f7480c None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:14.340123 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4454c120-f314-40ff-b145-695fbaa4a5df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b19c4c03cfd7454099f32dacb67c76cb', 'request_id': 'req-4454c120-f314-40ff-b145-695fbaa4a5df'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:14.343540 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80084c2-ae93-48ab-809d-57df71878557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:14.343789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80084c2-ae93-48ab-809d-57df71878557 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:14.344081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80084c2-ae93-48ab-809d-57df71878557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:14.344400 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80084c2-ae93-48ab-809d-57df71878557 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:14.345342 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80084c2-ae93-48ab-809d-57df71878557 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:01:14.345662 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80084c2-ae93-48ab-809d-57df71878557 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:14.347285 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80084c2-ae93-48ab-809d-57df71878557 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:14.356601 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4454c120-f314-40ff-b145-695fbaa4a5df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b19c4c03cfd7454099f32dacb67c76cb', 'request_id': 'req-4454c120-f314-40ff-b145-695fbaa4a5df'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:14.360053 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1180/2367] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 17:01:14.364525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80084c2-ae93-48ab-809d-57df71878557 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:14.369929 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4454c120-f314-40ff-b145-695fbaa4a5df admin admin] The token cache is being invalidate because project b19c4c03cfd7454099f32dacb67c76cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:01:14.370160 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4454c120-f314-40ff-b145-695fbaa4a5df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:14.371180 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4454c120-f314-40ff-b145-695fbaa4a5df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:14.372649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1188/2368] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:01:13 2022] DELETE /identity/v3/projects/b19c4c03cfd7454099f32dacb67c76cb => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:01:14.374749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80084c2-ae93-48ab-809d-57df71878557 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:14.376193 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454c120-f314-40ff-b145-695fbaa4a5df admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:14.377498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-4454c120-f314-40ff-b145-695fbaa4a5df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:14.382324 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde0af9-4bd3-483b-b469-0405138de1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:14.382324 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde0af9-4bd3-483b-b469-0405138de1ed admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:14.382324 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde0af9-4bd3-483b-b469-0405138de1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:14.382324 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde0af9-4bd3-483b-b469-0405138de1ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:14.382755 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde0af9-4bd3-483b-b469-0405138de1ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:14.384524 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde0af9-4bd3-483b-b469-0405138de1ed admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:14.392792 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454c120-f314-40ff-b145-695fbaa4a5df admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:14.402127 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d3edc-b7e0-4f41-b957-b6d265632d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:14.403166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d3edc-b7e0-4f41-b957-b6d265632d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:14.403750 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d3edc-b7e0-4f41-b957-b6d265632d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:14.403934 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d3edc-b7e0-4f41-b957-b6d265632d39 admin admin] PATH_INFO: `/v3/users/1075ab05533f43938da9a33b26d4e4b9` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:14.407497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d3edc-b7e0-4f41-b957-b6d265632d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1075ab05533f43938da9a33b26d4e4b9)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:14.409610 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d3edc-b7e0-4f41-b957-b6d265632d39 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:14.486513 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1181/2369] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:01:14 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:01:14.490535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde0af9-4bd3-483b-b469-0405138de1ed admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:14.492268 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-8cde0af9-4bd3-483b-b469-0405138de1ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:14.507669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:14.561406 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde0af9-4bd3-483b-b469-0405138de1ed admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:14.566500 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128a407-0b9e-4a9b-9f7a-ab93b97fc25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:14.567132 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128a407-0b9e-4a9b-9f7a-ab93b97fc25f admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:14.567540 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128a407-0b9e-4a9b-9f7a-ab93b97fc25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:14.567965 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128a407-0b9e-4a9b-9f7a-ab93b97fc25f admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:14.568709 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c128a407-0b9e-4a9b-9f7a-ab93b97fc25f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:14.570734 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c128a407-0b9e-4a9b-9f7a-ab93b97fc25f admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:14.600355 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-5e5d3edc-b7e0-4f41-b957-b6d265632d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1075ab05533f43938da9a33b26d4e4b9'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:14.607143 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-5e5d3edc-b7e0-4f41-b957-b6d265632d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1075ab05533f43938da9a33b26d4e4b9'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:14.607833 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-5e5d3edc-b7e0-4f41-b957-b6d265632d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1075ab05533f43938da9a33b26d4e4b9'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:14.619921 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-5e5d3edc-b7e0-4f41-b957-b6d265632d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1075ab05533f43938da9a33b26d4e4b9'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:14.620762 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-5e5d3edc-b7e0-4f41-b957-b6d265632d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1075ab05533f43938da9a33b26d4e4b9'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:14.673399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1182/2370] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:01:14 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:01:14.677187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128a407-0b9e-4a9b-9f7a-ab93b97fc25f admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:14.678992 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-c128a407-0b9e-4a9b-9f7a-ab93b97fc25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:14.692397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128a407-0b9e-4a9b-9f7a-ab93b97fc25f admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:14.702720 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1189/2371] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:01:14 2022] DELETE /identity/v3/users/1075ab05533f43938da9a33b26d4e4b9 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:01:14.709851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294b66c-2463-46f3-99f2-b8f5a08be5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:14.709851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294b66c-2463-46f3-99f2-b8f5a08be5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:14.709851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294b66c-2463-46f3-99f2-b8f5a08be5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:14.709851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294b66c-2463-46f3-99f2-b8f5a08be5f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:14.710187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294b66c-2463-46f3-99f2-b8f5a08be5f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:14.710187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294b66c-2463-46f3-99f2-b8f5a08be5f4 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:14.721417 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1183/2372] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:01:14.725013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d3edc-b7e0-4f41-b957-b6d265632d39 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:14.804319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d3edc-b7e0-4f41-b957-b6d265632d39 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:14.810257 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0da95-eb60-4ef2-85b4-c9e47087a1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:14.811517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0da95-eb60-4ef2-85b4-c9e47087a1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:14.811806 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0da95-eb60-4ef2-85b4-c9e47087a1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:14.812083 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0da95-eb60-4ef2-85b4-c9e47087a1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:14.813027 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0da95-eb60-4ef2-85b4-c9e47087a1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:14.814813 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0da95-eb60-4ef2-85b4-c9e47087a1e9 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:14.827146 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1190/2373] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:01:14.838347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294b66c-2463-46f3-99f2-b8f5a08be5f4 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:14.860309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294b66c-2463-46f3-99f2-b8f5a08be5f4 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:14.867020 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c313d84-6aa0-4fff-a6b0-bb7e768fa426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:14.868215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c313d84-6aa0-4fff-a6b0-bb7e768fa426 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:14.869861 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c313d84-6aa0-4fff-a6b0-bb7e768fa426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:14.869861 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c313d84-6aa0-4fff-a6b0-bb7e768fa426 admin admin] PATH_INFO: `/v3/projects/d1b55c4096154398912c80d62bc2430b/users/eaa62b68f6704652b48d08fcba5e4798/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:14.890877 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c313d84-6aa0-4fff-a6b0-bb7e768fa426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b55c4096154398912c80d62bc2430b, user_id=eaa62b68f6704652b48d08fcba5e4798, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:14.894105 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c313d84-6aa0-4fff-a6b0-bb7e768fa426 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:14.991732 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1184/2374] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:01:14 2022] PUT /identity/v3/projects/d1b55c4096154398912c80d62bc2430b/users/eaa62b68f6704652b48d08fcba5e4798/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:14.996865 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae0e49-6fcf-4dd1-9aaf-2527008ef6e7 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:14.997292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae0e49-6fcf-4dd1-9aaf-2527008ef6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:14.997643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae0e49-6fcf-4dd1-9aaf-2527008ef6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:15.034336 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-26ae0e49-6fcf-4dd1-9aaf-2527008ef6e7 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:15.048846 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-26ae0e49-6fcf-4dd1-9aaf-2527008ef6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:15.192830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1191/2375] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:15.213346 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c313d84-6aa0-4fff-a6b0-bb7e768fa426 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:15.217351 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0c313d84-6aa0-4fff-a6b0-bb7e768fa426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:15.318858 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c313d84-6aa0-4fff-a6b0-bb7e768fa426 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:15.322429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcdafa-4a97-464f-bbf8-d62836b43c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:15.323067 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcdafa-4a97-464f-bbf8-d62836b43c07 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:15.323377 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcdafa-4a97-464f-bbf8-d62836b43c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:15.323659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcdafa-4a97-464f-bbf8-d62836b43c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:15.332654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcdafa-4a97-464f-bbf8-d62836b43c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:15.334094 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcdafa-4a97-464f-bbf8-d62836b43c07 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:15.344963 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1185/2376] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:01:15.382978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae0e49-6fcf-4dd1-9aaf-2527008ef6e7 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:15.384508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-26ae0e49-6fcf-4dd1-9aaf-2527008ef6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:15.396802 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae0e49-6fcf-4dd1-9aaf-2527008ef6e7 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:15.422737 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadad642-85e1-40a5-a46d-01c44c49d00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:15.422737 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadad642-85e1-40a5-a46d-01c44c49d00f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:15.422737 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadad642-85e1-40a5-a46d-01c44c49d00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:15.422737 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadad642-85e1-40a5-a46d-01c44c49d00f admin admin] PATH_INFO: `/v3/projects/1bd56e3e30f5428e9313ecc328e734e3` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:15.423094 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadad642-85e1-40a5-a46d-01c44c49d00f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bd56e3e30f5428e9313ecc328e734e3)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:15.423094 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadad642-85e1-40a5-a46d-01c44c49d00f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:15.499179 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:15.567212 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-eadad642-85e1-40a5-a46d-01c44c49d00f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bd56e3e30f5428e9313ecc328e734e3', 'request_id': 'req-eadad642-85e1-40a5-a46d-01c44c49d00f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:15.647202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-eadad642-85e1-40a5-a46d-01c44c49d00f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bd56e3e30f5428e9313ecc328e734e3', 'request_id': 'req-eadad642-85e1-40a5-a46d-01c44c49d00f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:15.654888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-eadad642-85e1-40a5-a46d-01c44c49d00f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bd56e3e30f5428e9313ecc328e734e3', 'request_id': 'req-eadad642-85e1-40a5-a46d-01c44c49d00f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:15.666822 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-eadad642-85e1-40a5-a46d-01c44c49d00f admin admin] The token cache is being invalidate because project 1bd56e3e30f5428e9313ecc328e734e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:01:15.667316 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-eadad642-85e1-40a5-a46d-01c44c49d00f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:15.667982 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-eadad642-85e1-40a5-a46d-01c44c49d00f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:15.670056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1192/2377] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:01:15 2022] DELETE /identity/v3/projects/1bd56e3e30f5428e9313ecc328e734e3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:15.675943 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b42a9-ced5-45c8-a1a9-671c1da56744 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:15.676437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b42a9-ced5-45c8-a1a9-671c1da56744 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:15.676567 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b42a9-ced5-45c8-a1a9-671c1da56744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:15.695501 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-780b42a9-ced5-45c8-a1a9-671c1da56744 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:15.696751 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-780b42a9-ced5-45c8-a1a9-671c1da56744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:15.757761 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1186/2378] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:01:15.766515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc47996-9f99-4937-8f6a-006821bdcba5 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:15.767002 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc47996-9f99-4937-8f6a-006821bdcba5 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:15.767095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc47996-9f99-4937-8f6a-006821bdcba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:15.786444 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-6dc47996-9f99-4937-8f6a-006821bdcba5 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:15.787714 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-6dc47996-9f99-4937-8f6a-006821bdcba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:15.795740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1193/2379] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:15.800146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b42a9-ced5-45c8-a1a9-671c1da56744 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:15.810965 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b42a9-ced5-45c8-a1a9-671c1da56744 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:15.816315 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44658e05-e20c-4ed2-aee7-dfa8a6c10cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:15.817000 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44658e05-e20c-4ed2-aee7-dfa8a6c10cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:15.817397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44658e05-e20c-4ed2-aee7-dfa8a6c10cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:15.817679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44658e05-e20c-4ed2-aee7-dfa8a6c10cd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:15.818459 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44658e05-e20c-4ed2-aee7-dfa8a6c10cd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:01:15.818766 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44658e05-e20c-4ed2-aee7-dfa8a6c10cd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:15.820399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44658e05-e20c-4ed2-aee7-dfa8a6c10cd7 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:15.833117 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1187/2380] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:01:15.837462 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc47996-9f99-4937-8f6a-006821bdcba5 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:15.847304 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc47996-9f99-4937-8f6a-006821bdcba5 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:15.851963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8917eed-fb3e-44d7-81cb-bc0516026fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:15.852642 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8917eed-fb3e-44d7-81cb-bc0516026fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:15.852926 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8917eed-fb3e-44d7-81cb-bc0516026fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:15.853200 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8917eed-fb3e-44d7-81cb-bc0516026fb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:15.853905 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8917eed-fb3e-44d7-81cb-bc0516026fb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:15.855855 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8917eed-fb3e-44d7-81cb-bc0516026fb3 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:15.974513 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1194/2381] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:01:15 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:01:15.975598 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44658e05-e20c-4ed2-aee7-dfa8a6c10cd7 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:15.985887 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44658e05-e20c-4ed2-aee7-dfa8a6c10cd7 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:16.057917 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c75dcb-449e-4f4f-a384-65576404dc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:16.058589 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c75dcb-449e-4f4f-a384-65576404dc0e admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:16.059081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c75dcb-449e-4f4f-a384-65576404dc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:16.059402 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c75dcb-449e-4f4f-a384-65576404dc0e admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:16.060123 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c75dcb-449e-4f4f-a384-65576404dc0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:16.062640 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c75dcb-449e-4f4f-a384-65576404dc0e admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:16.168525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1188/2382] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:01:15 2022] POST /identity/v3/users => generated 291 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:01:16.174240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8917eed-fb3e-44d7-81cb-bc0516026fb3 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:16.184997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8917eed-fb3e-44d7-81cb-bc0516026fb3 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:16.190580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6cb1c-bace-4ca0-a931-c06b7f4e96f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:16.191759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6cb1c-bace-4ca0-a931-c06b7f4e96f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:16.192096 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6cb1c-bace-4ca0-a931-c06b7f4e96f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:16.192336 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6cb1c-bace-4ca0-a931-c06b7f4e96f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:16.193075 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6cb1c-bace-4ca0-a931-c06b7f4e96f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:16.194710 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6cb1c-bace-4ca0-a931-c06b7f4e96f9 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:16.206258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1195/2383] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:01:16.210353 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c75dcb-449e-4f4f-a384-65576404dc0e admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:16.221894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c75dcb-449e-4f4f-a384-65576404dc0e admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:16.226804 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb27cfb-0d77-475a-b8b3-55f9a4da7a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:16.227516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb27cfb-0d77-475a-b8b3-55f9a4da7a89 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:16.227805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb27cfb-0d77-475a-b8b3-55f9a4da7a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:16.228084 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb27cfb-0d77-475a-b8b3-55f9a4da7a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:16.228894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb27cfb-0d77-475a-b8b3-55f9a4da7a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:16.230512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb27cfb-0d77-475a-b8b3-55f9a4da7a89 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:16.241229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1189/2384] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:01:16.252630 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6cb1c-bace-4ca0-a931-c06b7f4e96f9 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:16.262548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6cb1c-bace-4ca0-a931-c06b7f4e96f9 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:16.267345 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e79492-f0e3-4811-9853-ca3c0210100e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:16.268304 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e79492-f0e3-4811-9853-ca3c0210100e admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:16.268619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e79492-f0e3-4811-9853-ca3c0210100e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:16.268897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e79492-f0e3-4811-9853-ca3c0210100e admin admin] PATH_INFO: `/v3/projects/f2041a9033de48729f1e1fb05a37f0f0/users/0d598eec2df4466da0039e6bd00fab48/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:16.283885 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e79492-f0e3-4811-9853-ca3c0210100e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2041a9033de48729f1e1fb05a37f0f0, user_id=0d598eec2df4466da0039e6bd00fab48, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:16.287380 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e79492-f0e3-4811-9853-ca3c0210100e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:16.411157 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1196/2385] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:01:16 2022] PUT /identity/v3/projects/f2041a9033de48729f1e1fb05a37f0f0/users/0d598eec2df4466da0039e6bd00fab48/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:16.423652 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf3503-a058-4a62-a7b1-8234e59c7793 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:16.423948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf3503-a058-4a62-a7b1-8234e59c7793 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:16.424263 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf3503-a058-4a62-a7b1-8234e59c7793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:16.451648 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-efdf3503-a058-4a62-a7b1-8234e59c7793 None None] MFA Rules not processed for user `0d598eec2df4466da0039e6bd00fab48`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:16.453012 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-efdf3503-a058-4a62-a7b1-8234e59c7793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:16.518324 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1190/2386] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:16.522960 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e79492-f0e3-4811-9853-ca3c0210100e admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:16.583118 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e79492-f0e3-4811-9853-ca3c0210100e admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:16.588174 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2053e5d-1174-4814-8f4c-c568642b3277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:16.588822 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2053e5d-1174-4814-8f4c-c568642b3277 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:16.589104 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2053e5d-1174-4814-8f4c-c568642b3277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:16.589380 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2053e5d-1174-4814-8f4c-c568642b3277 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:16.590075 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2053e5d-1174-4814-8f4c-c568642b3277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:16.592043 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2053e5d-1174-4814-8f4c-c568642b3277 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:16.666922 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1197/2387] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:01:16 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:01:16.668423 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf3503-a058-4a62-a7b1-8234e59c7793 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:16.679717 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf3503-a058-4a62-a7b1-8234e59c7793 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:16.698218 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6e573-d966-45db-b660-38681a3b1a57 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:16.698684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6e573-d966-45db-b660-38681a3b1a57 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:16.699143 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6e573-d966-45db-b660-38681a3b1a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:16.731598 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-fff6e573-d966-45db-b660-38681a3b1a57 None None] MFA Rules not processed for user `eaa62b68f6704652b48d08fcba5e4798`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:16.733707 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-fff6e573-d966-45db-b660-38681a3b1a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:16.741742 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4c2fd-37f1-483c-b2af-665daff3deb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:16.742575 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4c2fd-37f1-483c-b2af-665daff3deb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:16.746470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4c2fd-37f1-483c-b2af-665daff3deb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:16.746470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4c2fd-37f1-483c-b2af-665daff3deb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:16.746470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4c2fd-37f1-483c-b2af-665daff3deb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:16.746470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4c2fd-37f1-483c-b2af-665daff3deb0 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:16.805160 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1198/2388] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:01:16.816410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6e573-d966-45db-b660-38681a3b1a57 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:16.817925 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-fff6e573-d966-45db-b660-38681a3b1a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:16.852873 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1191/2389] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:01:16 2022] POST /identity/v3/users => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:01:16.856140 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4c2fd-37f1-483c-b2af-665daff3deb0 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:16.866975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4c2fd-37f1-483c-b2af-665daff3deb0 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:16.871667 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7869cf-33c0-42ac-bb0d-4ac99dcb416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:16.872466 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7869cf-33c0-42ac-bb0d-4ac99dcb416a admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:16.872750 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7869cf-33c0-42ac-bb0d-4ac99dcb416a admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:16.873115 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7869cf-33c0-42ac-bb0d-4ac99dcb416a admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:16.873890 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7869cf-33c0-42ac-bb0d-4ac99dcb416a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:16.875672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7869cf-33c0-42ac-bb0d-4ac99dcb416a admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:16.878681 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6e573-d966-45db-b660-38681a3b1a57 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:16.882784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0a46e-4c40-463f-9985-be9809c017c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:16.883442 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0a46e-4c40-463f-9985-be9809c017c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:16.883730 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0a46e-4c40-463f-9985-be9809c017c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:16.884187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0a46e-4c40-463f-9985-be9809c017c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:16.890140 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1192/2390] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:01:16.910390 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7869cf-33c0-42ac-bb0d-4ac99dcb416a admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:16.911218 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0a46e-4c40-463f-9985-be9809c017c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:16.911218 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0a46e-4c40-463f-9985-be9809c017c3 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:16.911513 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7869cf-33c0-42ac-bb0d-4ac99dcb416a admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:16.911608 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1199/2391] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:01:16.911693 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e049b9-a311-43fa-81a1-6f7a3a769f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:16.911693 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e049b9-a311-43fa-81a1-6f7a3a769f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:16.911693 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e049b9-a311-43fa-81a1-6f7a3a769f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:16.911693 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e049b9-a311-43fa-81a1-6f7a3a769f5c admin admin] PATH_INFO: `/v3/projects/08ea33e400a448c095aa5323de0dcc49/users/94b5470465214506b6b3da20b193a30b/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:16.927451 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e049b9-a311-43fa-81a1-6f7a3a769f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ea33e400a448c095aa5323de0dcc49, user_id=94b5470465214506b6b3da20b193a30b, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:16.930332 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e049b9-a311-43fa-81a1-6f7a3a769f5c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:17.013823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1193/2392] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:01:16 2022] PUT /identity/v3/projects/08ea33e400a448c095aa5323de0dcc49/users/94b5470465214506b6b3da20b193a30b/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:17.019571 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0a46e-4c40-463f-9985-be9809c017c3 service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:17.033122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0a46e-4c40-463f-9985-be9809c017c3 service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:17.090723 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839a5b8-befa-48c8-95a3-91983083a1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:17.091549 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839a5b8-befa-48c8-95a3-91983083a1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:17.092475 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839a5b8-befa-48c8-95a3-91983083a1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:17.092772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839a5b8-befa-48c8-95a3-91983083a1b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:17.093567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839a5b8-befa-48c8-95a3-91983083a1b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:17.095164 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839a5b8-befa-48c8-95a3-91983083a1b3 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:17.104999 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1200/2393] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:01:17.109419 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e049b9-a311-43fa-81a1-6f7a3a769f5c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:17.120074 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e049b9-a311-43fa-81a1-6f7a3a769f5c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:17.125179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961abcd-1327-41f1-b998-5c687a9d057c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:17.126085 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961abcd-1327-41f1-b998-5c687a9d057c admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:17.126372 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961abcd-1327-41f1-b998-5c687a9d057c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:17.126649 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961abcd-1327-41f1-b998-5c687a9d057c admin admin] PATH_INFO: `/v3/projects/08ea33e400a448c095aa5323de0dcc49/users/94b5470465214506b6b3da20b193a30b/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:17.128705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961abcd-1327-41f1-b998-5c687a9d057c admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ea33e400a448c095aa5323de0dcc49, user_id=94b5470465214506b6b3da20b193a30b, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:17.131317 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961abcd-1327-41f1-b998-5c687a9d057c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:17.145928 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1194/2394] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:01:17 2022] PUT /identity/v3/projects/08ea33e400a448c095aa5323de0dcc49/users/94b5470465214506b6b3da20b193a30b/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:17.157044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea86eff-e919-4242-8329-baa6d0b12426 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:17.157322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea86eff-e919-4242-8329-baa6d0b12426 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:17.157603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea86eff-e919-4242-8329-baa6d0b12426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:17.183644 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-3ea86eff-e919-4242-8329-baa6d0b12426 None None] MFA Rules not processed for user `94b5470465214506b6b3da20b193a30b`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:17.184800 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3ea86eff-e919-4242-8329-baa6d0b12426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:17.254274 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:17.266727 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1201/2395] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:17.278706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961abcd-1327-41f1-b998-5c687a9d057c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:17.283812 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e961abcd-1327-41f1-b998-5c687a9d057c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:17.373083 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961abcd-1327-41f1-b998-5c687a9d057c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:17.376930 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6d356-47e6-4d95-b3f3-fee9c4046342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:17.377635 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6d356-47e6-4d95-b3f3-fee9c4046342 service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:17.377917 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6d356-47e6-4d95-b3f3-fee9c4046342 service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:17.378361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6d356-47e6-4d95-b3f3-fee9c4046342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:17.387369 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6d356-47e6-4d95-b3f3-fee9c4046342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:17.389675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6d356-47e6-4d95-b3f3-fee9c4046342 service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:17.400062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1195/2396] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:01:17.538689 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea86eff-e919-4242-8329-baa6d0b12426 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:17.548787 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea86eff-e919-4242-8329-baa6d0b12426 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:17.552356 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e582ea2-4e83-4efc-877c-de0598514ddc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:17.553007 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e582ea2-4e83-4efc-877c-de0598514ddc service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:17.553364 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e582ea2-4e83-4efc-877c-de0598514ddc service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:17.553647 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e582ea2-4e83-4efc-877c-de0598514ddc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:17.629647 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e582ea2-4e83-4efc-877c-de0598514ddc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:17.631103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e582ea2-4e83-4efc-877c-de0598514ddc service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:17.643944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1202/2397] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:01:18.058950 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:18.593572 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:18.824209 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:18.852742 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:19.219090 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:19.447676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:19.673354 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:20.282512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:20.362051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:20.773412 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:20.942095 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:20.970294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:21.102302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:21.473568 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:22.138918 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b752e1b-e65a-4e9e-bbd0-ff434e546c56 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:22.139212 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b752e1b-e65a-4e9e-bbd0-ff434e546c56 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:22.139516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b752e1b-e65a-4e9e-bbd0-ff434e546c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:22.163940 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-0b752e1b-e65a-4e9e-bbd0-ff434e546c56 None None] MFA Rules not processed for user `eaa62b68f6704652b48d08fcba5e4798`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:22.165185 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0b752e1b-e65a-4e9e-bbd0-ff434e546c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:22.217493 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dae2b2-ac37-4eb9-9213-0574f0d44c9e None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:22.218465 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dae2b2-ac37-4eb9-9213-0574f0d44c9e None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:22.218836 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dae2b2-ac37-4eb9-9213-0574f0d44c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:22.226796 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1196/2398] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:22.234001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:22.251082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-e8dae2b2-ac37-4eb9-9213-0574f0d44c9e None None] MFA Rules not processed for user `2a0a8cfb2482466a98340adab9980d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:22.253028 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e8dae2b2-ac37-4eb9-9213-0574f0d44c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:22.319013 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1203/2399] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 17:01:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:01:22.368910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b752e1b-e65a-4e9e-bbd0-ff434e546c56 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:22.370329 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0b752e1b-e65a-4e9e-bbd0-ff434e546c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:22.442082 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b752e1b-e65a-4e9e-bbd0-ff434e546c56 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:22.447367 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf68de-3868-478e-8404-b64f1c7047e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861452a1dc634bf69ce630d7dcd8a2d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:22.448052 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf68de-3868-478e-8404-b64f1c7047e0 service swift] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:22.448452 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf68de-3868-478e-8404-b64f1c7047e0 service swift] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:22.448649 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf68de-3868-478e-8404-b64f1c7047e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:22.464183 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf68de-3868-478e-8404-b64f1c7047e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:22.465659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf68de-3868-478e-8404-b64f1c7047e0 service swift] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:22.474118 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1197/2400] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 17:01:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 17:01:22.878723 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:23.170533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:23.870064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:23.929594 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:23.955499 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dae2b2-ac37-4eb9-9213-0574f0d44c9e None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:24.037559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dae2b2-ac37-4eb9-9213-0574f0d44c9e None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:24.042530 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909864d0-c91a-4dd3-9eaa-6f83fedfad86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:24.043449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909864d0-c91a-4dd3-9eaa-6f83fedfad86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:24.043728 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909864d0-c91a-4dd3-9eaa-6f83fedfad86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:24.044145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909864d0-c91a-4dd3-9eaa-6f83fedfad86 admin admin] PATH_INFO: `/v3/users/0d598eec2df4466da0039e6bd00fab48` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:24.045308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909864d0-c91a-4dd3-9eaa-6f83fedfad86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d598eec2df4466da0039e6bd00fab48)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:24.047322 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909864d0-c91a-4dd3-9eaa-6f83fedfad86 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:24.133171 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:24.164414 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:24.249686 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-909864d0-c91a-4dd3-9eaa-6f83fedfad86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d598eec2df4466da0039e6bd00fab48'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:24.258679 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-909864d0-c91a-4dd3-9eaa-6f83fedfad86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d598eec2df4466da0039e6bd00fab48'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:24.259732 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-909864d0-c91a-4dd3-9eaa-6f83fedfad86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d598eec2df4466da0039e6bd00fab48'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:24.274538 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-909864d0-c91a-4dd3-9eaa-6f83fedfad86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d598eec2df4466da0039e6bd00fab48'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:24.275299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-909864d0-c91a-4dd3-9eaa-6f83fedfad86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d598eec2df4466da0039e6bd00fab48'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:24.342357 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1204/2401] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:01:23 2022] DELETE /identity/v3/users/0d598eec2df4466da0039e6bd00fab48 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:24.348170 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4f12d-6c65-438a-bbc8-b925e9907ec4 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:24.348676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4f12d-6c65-438a-bbc8-b925e9907ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:24.349106 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4f12d-6c65-438a-bbc8-b925e9907ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:24.376836 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-81c4f12d-6c65-438a-bbc8-b925e9907ec4 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:24.378373 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-81c4f12d-6c65-438a-bbc8-b925e9907ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:24.476146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1198/2402] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:24.487386 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909864d0-c91a-4dd3-9eaa-6f83fedfad86 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:24.489128 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-909864d0-c91a-4dd3-9eaa-6f83fedfad86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:24.542891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:24.630369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:24.726573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909864d0-c91a-4dd3-9eaa-6f83fedfad86 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:24.739670 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542fedf-cc25-43b9-9665-03280f400b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:24.741305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542fedf-cc25-43b9-9665-03280f400b07 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:24.742386 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542fedf-cc25-43b9-9665-03280f400b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:24.743314 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542fedf-cc25-43b9-9665-03280f400b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:24.765066 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542fedf-cc25-43b9-9665-03280f400b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:24.770920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542fedf-cc25-43b9-9665-03280f400b07 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:24.805274 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1205/2403] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:01:25.057387 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:25.096474 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:25.615609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4f12d-6c65-438a-bbc8-b925e9907ec4 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:25.621082 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-81c4f12d-6c65-438a-bbc8-b925e9907ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:25.667747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4f12d-6c65-438a-bbc8-b925e9907ec4 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:25.679588 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:25.690508 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83a3c6-e941-4a44-ad5a-eed20f2ce5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:25.691734 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83a3c6-e941-4a44-ad5a-eed20f2ce5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:25.693181 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83a3c6-e941-4a44-ad5a-eed20f2ce5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:25.693472 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83a3c6-e941-4a44-ad5a-eed20f2ce5a3 admin admin] PATH_INFO: `/v3/projects/f2041a9033de48729f1e1fb05a37f0f0` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:25.694962 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83a3c6-e941-4a44-ad5a-eed20f2ce5a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2041a9033de48729f1e1fb05a37f0f0)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:25.697751 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83a3c6-e941-4a44-ad5a-eed20f2ce5a3 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:25.724807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:25.873453 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-df83a3c6-e941-4a44-ad5a-eed20f2ce5a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2041a9033de48729f1e1fb05a37f0f0', 'request_id': 'req-df83a3c6-e941-4a44-ad5a-eed20f2ce5a3'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:25.973529 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-df83a3c6-e941-4a44-ad5a-eed20f2ce5a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2041a9033de48729f1e1fb05a37f0f0', 'request_id': 'req-df83a3c6-e941-4a44-ad5a-eed20f2ce5a3'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:25.984632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-df83a3c6-e941-4a44-ad5a-eed20f2ce5a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2041a9033de48729f1e1fb05a37f0f0', 'request_id': 'req-df83a3c6-e941-4a44-ad5a-eed20f2ce5a3'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:26.026202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-df83a3c6-e941-4a44-ad5a-eed20f2ce5a3 admin admin] The token cache is being invalidate because project f2041a9033de48729f1e1fb05a37f0f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:01:26.038374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-df83a3c6-e941-4a44-ad5a-eed20f2ce5a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:26.049906 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-df83a3c6-e941-4a44-ad5a-eed20f2ce5a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:26.052059 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1199/2404] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:01:25 2022] DELETE /identity/v3/projects/f2041a9033de48729f1e1fb05a37f0f0 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:26.055835 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542fedf-cc25-43b9-9665-03280f400b07 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:26.078724 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542fedf-cc25-43b9-9665-03280f400b07 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:26.170197 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3891e15-da62-433b-ac2f-a171b290619c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:26.171251 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3891e15-da62-433b-ac2f-a171b290619c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:26.171563 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3891e15-da62-433b-ac2f-a171b290619c admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:26.171950 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3891e15-da62-433b-ac2f-a171b290619c admin admin] PATH_INFO: `/v3/users/94b5470465214506b6b3da20b193a30b` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:26.186718 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3891e15-da62-433b-ac2f-a171b290619c admin admin] RBAC: Authorizing `identity:delete_user(user_id=94b5470465214506b6b3da20b193a30b)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:26.188252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3891e15-da62-433b-ac2f-a171b290619c admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:26.430613 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:26.462814 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-e3891e15-da62-433b-ac2f-a171b290619c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94b5470465214506b6b3da20b193a30b'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:26.472981 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-e3891e15-da62-433b-ac2f-a171b290619c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94b5470465214506b6b3da20b193a30b'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:26.473741 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-e3891e15-da62-433b-ac2f-a171b290619c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94b5470465214506b6b3da20b193a30b'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:26.493064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-e3891e15-da62-433b-ac2f-a171b290619c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94b5470465214506b6b3da20b193a30b'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:26.494284 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-e3891e15-da62-433b-ac2f-a171b290619c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94b5470465214506b6b3da20b193a30b'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:26.618294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1206/2405] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:01:26 2022] DELETE /identity/v3/users/94b5470465214506b6b3da20b193a30b => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:27.130359 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:27.519790 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:27.645728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83a3c6-e941-4a44-ad5a-eed20f2ce5a3 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:27.647457 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-df83a3c6-e941-4a44-ad5a-eed20f2ce5a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:27.668774 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83a3c6-e941-4a44-ad5a-eed20f2ce5a3 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:27.760641 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3d09d-512b-42ae-ab2d-3631bf387d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:27.761572 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3d09d-512b-42ae-ab2d-3631bf387d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:27.762054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3d09d-512b-42ae-ab2d-3631bf387d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:27.762578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3d09d-512b-42ae-ab2d-3631bf387d65 admin admin] PATH_INFO: `/v3/projects/08ea33e400a448c095aa5323de0dcc49` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:27.763893 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3d09d-512b-42ae-ab2d-3631bf387d65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08ea33e400a448c095aa5323de0dcc49)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:27.765925 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3d09d-512b-42ae-ab2d-3631bf387d65 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:27.890580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:27.905210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-50d3d09d-512b-42ae-ab2d-3631bf387d65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08ea33e400a448c095aa5323de0dcc49', 'request_id': 'req-50d3d09d-512b-42ae-ab2d-3631bf387d65'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:27.947100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-50d3d09d-512b-42ae-ab2d-3631bf387d65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08ea33e400a448c095aa5323de0dcc49', 'request_id': 'req-50d3d09d-512b-42ae-ab2d-3631bf387d65'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:27.953691 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-50d3d09d-512b-42ae-ab2d-3631bf387d65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08ea33e400a448c095aa5323de0dcc49', 'request_id': 'req-50d3d09d-512b-42ae-ab2d-3631bf387d65'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:27.966689 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:27.975895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-50d3d09d-512b-42ae-ab2d-3631bf387d65 admin admin] The token cache is being invalidate because project 08ea33e400a448c095aa5323de0dcc49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:01:27.975895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-50d3d09d-512b-42ae-ab2d-3631bf387d65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:27.975895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-50d3d09d-512b-42ae-ab2d-3631bf387d65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:27.975895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1200/2406] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:01:27 2022] DELETE /identity/v3/projects/08ea33e400a448c095aa5323de0dcc49 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:27.979640 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b31c1d-89da-46c7-adff-e13d4ab4194e None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:27.979939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b31c1d-89da-46c7-adff-e13d4ab4194e None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:27.980248 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b31c1d-89da-46c7-adff-e13d4ab4194e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:28.034922 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-b6b31c1d-89da-46c7-adff-e13d4ab4194e None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:28.036321 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-b6b31c1d-89da-46c7-adff-e13d4ab4194e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:28.142654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1207/2407] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:28.145151 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a30ead-da0f-4cd1-8930-7fc12a419c0b None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:28.145282 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:28.145945 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a30ead-da0f-4cd1-8930-7fc12a419c0b None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:28.146511 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a30ead-da0f-4cd1-8930-7fc12a419c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:28.168337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-15a30ead-da0f-4cd1-8930-7fc12a419c0b None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:28.169716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-15a30ead-da0f-4cd1-8930-7fc12a419c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:28.181407 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1201/2408] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:28.187050 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b31c1d-89da-46c7-adff-e13d4ab4194e None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:28.197559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b31c1d-89da-46c7-adff-e13d4ab4194e None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:28.202562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b086f0-765c-4dea-b3f6-75e5ddc795f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:28.203230 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b086f0-765c-4dea-b3f6-75e5ddc795f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:28.203514 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b086f0-765c-4dea-b3f6-75e5ddc795f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:28.203792 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b086f0-765c-4dea-b3f6-75e5ddc795f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:28.205258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b086f0-765c-4dea-b3f6-75e5ddc795f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:01:28.205559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b086f0-765c-4dea-b3f6-75e5ddc795f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:28.207431 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b086f0-765c-4dea-b3f6-75e5ddc795f5 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:28.225432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1208/2409] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:01:28.226661 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a30ead-da0f-4cd1-8930-7fc12a419c0b None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:28.238973 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a30ead-da0f-4cd1-8930-7fc12a419c0b None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:28.242114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:28.246705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638fbe8-ce08-4bf4-a4f5-196b2b10ecb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:28.247468 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638fbe8-ce08-4bf4-a4f5-196b2b10ecb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:28.247843 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638fbe8-ce08-4bf4-a4f5-196b2b10ecb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:28.248261 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638fbe8-ce08-4bf4-a4f5-196b2b10ecb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:28.249066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638fbe8-ce08-4bf4-a4f5-196b2b10ecb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:28.251064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638fbe8-ce08-4bf4-a4f5-196b2b10ecb7 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:28.276465 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:28.335846 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1202/2410] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:01:28 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:01:28.340503 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b086f0-765c-4dea-b3f6-75e5ddc795f5 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:28.351745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b086f0-765c-4dea-b3f6-75e5ddc795f5 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:28.418375 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f9c46-88a2-4b25-8f10-b52c43f0be9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:28.418984 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f9c46-88a2-4b25-8f10-b52c43f0be9e admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:28.419273 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f9c46-88a2-4b25-8f10-b52c43f0be9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:28.419552 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f9c46-88a2-4b25-8f10-b52c43f0be9e admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:28.420288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f9c46-88a2-4b25-8f10-b52c43f0be9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:28.427478 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f9c46-88a2-4b25-8f10-b52c43f0be9e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:28.450205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:28.508387 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1209/2411] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:01:28 2022] POST /identity/v3/users => generated 283 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:01:28.511951 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638fbe8-ce08-4bf4-a4f5-196b2b10ecb7 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:28.526586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638fbe8-ce08-4bf4-a4f5-196b2b10ecb7 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:28.532278 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f536496-fa91-4b6a-b393-f57277dc8d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:28.533494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f536496-fa91-4b6a-b393-f57277dc8d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:28.533772 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f536496-fa91-4b6a-b393-f57277dc8d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:28.534065 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f536496-fa91-4b6a-b393-f57277dc8d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:28.535054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f536496-fa91-4b6a-b393-f57277dc8d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:28.536815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f536496-fa91-4b6a-b393-f57277dc8d7f admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:28.550399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1203/2412] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:01:28.555562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f9c46-88a2-4b25-8f10-b52c43f0be9e admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:28.568260 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f9c46-88a2-4b25-8f10-b52c43f0be9e admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:28.573523 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ec4ee-6ae9-4005-bafe-53542671516f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:28.574358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ec4ee-6ae9-4005-bafe-53542671516f admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:28.574741 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ec4ee-6ae9-4005-bafe-53542671516f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:28.575117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ec4ee-6ae9-4005-bafe-53542671516f admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:28.575979 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ec4ee-6ae9-4005-bafe-53542671516f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:28.579689 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ec4ee-6ae9-4005-bafe-53542671516f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:28.596144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1210/2413] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:01:28.598435 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f536496-fa91-4b6a-b393-f57277dc8d7f admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:28.609916 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f536496-fa91-4b6a-b393-f57277dc8d7f admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:28.615790 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648a0a4-b162-4cfe-ae37-2efe361e7e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:28.617010 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648a0a4-b162-4cfe-ae37-2efe361e7e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:28.617512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648a0a4-b162-4cfe-ae37-2efe361e7e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:28.617994 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648a0a4-b162-4cfe-ae37-2efe361e7e3c admin admin] PATH_INFO: `/v3/projects/49d43b22db984da88d05f2193cdc697f/users/c7d1509637014d6dad80d65287573079/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:28.638293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648a0a4-b162-4cfe-ae37-2efe361e7e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d43b22db984da88d05f2193cdc697f, user_id=c7d1509637014d6dad80d65287573079, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:28.641669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648a0a4-b162-4cfe-ae37-2efe361e7e3c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:28.711333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1204/2414] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:01:28 2022] PUT /identity/v3/projects/49d43b22db984da88d05f2193cdc697f/users/c7d1509637014d6dad80d65287573079/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:28.728176 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86b54c-3f39-479a-85bc-cad82d3fc563 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:28.728483 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86b54c-3f39-479a-85bc-cad82d3fc563 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:28.728767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86b54c-3f39-479a-85bc-cad82d3fc563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:28.765418 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-2e86b54c-3f39-479a-85bc-cad82d3fc563 None None] MFA Rules not processed for user `c7d1509637014d6dad80d65287573079`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:28.766667 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2e86b54c-3f39-479a-85bc-cad82d3fc563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:28.855157 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1211/2415] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:28.860025 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648a0a4-b162-4cfe-ae37-2efe361e7e3c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:29.002062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648a0a4-b162-4cfe-ae37-2efe361e7e3c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:29.015607 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e048c9f-f301-44ff-b4fa-68943fdec345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:29.016393 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e048c9f-f301-44ff-b4fa-68943fdec345 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:29.016927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e048c9f-f301-44ff-b4fa-68943fdec345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:29.017376 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e048c9f-f301-44ff-b4fa-68943fdec345 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:29.018010 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e048c9f-f301-44ff-b4fa-68943fdec345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:29.020183 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e048c9f-f301-44ff-b4fa-68943fdec345 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:29.044481 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:29.135226 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1205/2416] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:01:28 2022] POST /identity/v3/projects => generated 367 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:01:29.139240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86b54c-3f39-479a-85bc-cad82d3fc563 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:29.152478 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86b54c-3f39-479a-85bc-cad82d3fc563 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:29.247920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b767d36-4583-4d54-806b-5bbad8fcccae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:29.249203 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b767d36-4583-4d54-806b-5bbad8fcccae admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:29.249727 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b767d36-4583-4d54-806b-5bbad8fcccae admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:29.250332 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b767d36-4583-4d54-806b-5bbad8fcccae admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:29.252541 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b767d36-4583-4d54-806b-5bbad8fcccae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:29.256541 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b767d36-4583-4d54-806b-5bbad8fcccae admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:29.380784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1212/2417] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:01:29 2022] POST /identity/v3/users => generated 290 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:01:29.383100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e048c9f-f301-44ff-b4fa-68943fdec345 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:29.397987 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e048c9f-f301-44ff-b4fa-68943fdec345 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:29.412588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a8f04-b7ee-47d1-aafc-ec37b3606be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:29.413281 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a8f04-b7ee-47d1-aafc-ec37b3606be6 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:29.413772 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a8f04-b7ee-47d1-aafc-ec37b3606be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:29.413891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a8f04-b7ee-47d1-aafc-ec37b3606be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:29.414611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a8f04-b7ee-47d1-aafc-ec37b3606be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:29.416299 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a8f04-b7ee-47d1-aafc-ec37b3606be6 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:29.444180 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1206/2418] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:01:29.447968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b767d36-4583-4d54-806b-5bbad8fcccae admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:29.465001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b767d36-4583-4d54-806b-5bbad8fcccae admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:29.465618 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1424a-34b7-46ae-845c-8fb44102488b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:29.466519 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1424a-34b7-46ae-845c-8fb44102488b admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:29.466811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1424a-34b7-46ae-845c-8fb44102488b admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:29.467096 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1424a-34b7-46ae-845c-8fb44102488b admin admin] PATH_INFO: `/v3/projects/c5ef24943bab4c1193ad7e97166166ab/users/89f6c597b5f2404e999e4328e5fb0674/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:29.494009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1424a-34b7-46ae-845c-8fb44102488b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ef24943bab4c1193ad7e97166166ab, user_id=89f6c597b5f2404e999e4328e5fb0674, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:29.497027 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1424a-34b7-46ae-845c-8fb44102488b admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:29.571174 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1213/2419] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:01:29 2022] PUT /identity/v3/projects/c5ef24943bab4c1193ad7e97166166ab/users/89f6c597b5f2404e999e4328e5fb0674/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:29.575888 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a8f04-b7ee-47d1-aafc-ec37b3606be6 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:29.594967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a8f04-b7ee-47d1-aafc-ec37b3606be6 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:29.764546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08714a-2b3b-4593-a078-cb1771a1f651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:29.765224 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08714a-2b3b-4593-a078-cb1771a1f651 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:29.765533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08714a-2b3b-4593-a078-cb1771a1f651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:29.765796 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08714a-2b3b-4593-a078-cb1771a1f651 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:29.772797 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08714a-2b3b-4593-a078-cb1771a1f651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:29.774451 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08714a-2b3b-4593-a078-cb1771a1f651 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:29.829230 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1207/2420] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:01:29.830410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1424a-34b7-46ae-845c-8fb44102488b admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:29.848510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1424a-34b7-46ae-845c-8fb44102488b admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:29.857660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56011d3e-1cef-4638-a2b9-3cc73c8775e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:29.858562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56011d3e-1cef-4638-a2b9-3cc73c8775e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:29.858846 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56011d3e-1cef-4638-a2b9-3cc73c8775e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:29.859129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56011d3e-1cef-4638-a2b9-3cc73c8775e8 admin admin] PATH_INFO: `/v3/projects/c5ef24943bab4c1193ad7e97166166ab/users/89f6c597b5f2404e999e4328e5fb0674/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:29.864665 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56011d3e-1cef-4638-a2b9-3cc73c8775e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ef24943bab4c1193ad7e97166166ab, user_id=89f6c597b5f2404e999e4328e5fb0674, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:29.867424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56011d3e-1cef-4638-a2b9-3cc73c8775e8 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:29.901859 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1214/2421] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:01:29 2022] PUT /identity/v3/projects/c5ef24943bab4c1193ad7e97166166ab/users/89f6c597b5f2404e999e4328e5fb0674/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:29.905604 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77e8b1-9507-4540-b5ba-ad04e195c992 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:29.905898 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77e8b1-9507-4540-b5ba-ad04e195c992 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:29.906181 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77e8b1-9507-4540-b5ba-ad04e195c992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:29.952057 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-4a77e8b1-9507-4540-b5ba-ad04e195c992 None None] MFA Rules not processed for user `89f6c597b5f2404e999e4328e5fb0674`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:29.956929 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-4a77e8b1-9507-4540-b5ba-ad04e195c992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:30.071694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1208/2422] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:29 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:30.087595 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56011d3e-1cef-4638-a2b9-3cc73c8775e8 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:30.090133 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-56011d3e-1cef-4638-a2b9-3cc73c8775e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:30.098589 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:30.192226 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56011d3e-1cef-4638-a2b9-3cc73c8775e8 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:30.213984 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2614b-ea9f-4e6b-9ae4-4680a216c654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:30.213984 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2614b-ea9f-4e6b-9ae4-4680a216c654 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:30.213984 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2614b-ea9f-4e6b-9ae4-4680a216c654 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:30.213984 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2614b-ea9f-4e6b-9ae4-4680a216c654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:30.247393 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2614b-ea9f-4e6b-9ae4-4680a216c654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:30.249215 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2614b-ea9f-4e6b-9ae4-4680a216c654 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:30.278954 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1215/2423] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:30 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:01:30.595031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77e8b1-9507-4540-b5ba-ad04e195c992 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:30.617361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77e8b1-9507-4540-b5ba-ad04e195c992 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:30.633365 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8c7b3-e16a-468a-a532-bd51e58d882a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:30.634196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8c7b3-e16a-468a-a532-bd51e58d882a service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:30.634590 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8c7b3-e16a-468a-a532-bd51e58d882a service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:30.636551 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8c7b3-e16a-468a-a532-bd51e58d882a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:30.718539 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8c7b3-e16a-468a-a532-bd51e58d882a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:30.719435 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8c7b3-e16a-468a-a532-bd51e58d882a service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:30.725889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:30.731558 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1209/2424] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:30 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:01:37.216973 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4381971-5015-4bbf-9edf-67daa29603ec None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:37.217910 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4381971-5015-4bbf-9edf-67daa29603ec None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:37.218362 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4381971-5015-4bbf-9edf-67daa29603ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:37.243253 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-a4381971-5015-4bbf-9edf-67daa29603ec None None] MFA Rules not processed for user `2a0a8cfb2482466a98340adab9980d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:37.245090 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-a4381971-5015-4bbf-9edf-67daa29603ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:37.345505 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1216/2425] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 17:01:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:37.389358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8c7b3-e16a-468a-a532-bd51e58d882a service cinder] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:37.390922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-93c8c7b3-e16a-468a-a532-bd51e58d882a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:37.499106 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8c7b3-e16a-468a-a532-bd51e58d882a service cinder] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:37.514324 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847abed-ba12-4437-893b-c3ab2606201d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861452a1dc634bf69ce630d7dcd8a2d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:37.515596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847abed-ba12-4437-893b-c3ab2606201d service swift] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:37.517837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847abed-ba12-4437-893b-c3ab2606201d service swift] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:37.518768 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847abed-ba12-4437-893b-c3ab2606201d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:37.534624 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847abed-ba12-4437-893b-c3ab2606201d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:37.536665 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847abed-ba12-4437-893b-c3ab2606201d service swift] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:37.547565 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1210/2426] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 17:01:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 17:01:39.137294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969692c-ccac-4135-91d4-0cb9b4e73ee8 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:39.138957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969692c-ccac-4135-91d4-0cb9b4e73ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:39.144628 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969692c-ccac-4135-91d4-0cb9b4e73ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:39.200001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-2969692c-ccac-4135-91d4-0cb9b4e73ee8 None None] MFA Rules not processed for user `2a0a8cfb2482466a98340adab9980d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:39.201086 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2969692c-ccac-4135-91d4-0cb9b4e73ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:39.225423 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1217/2427] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jun 22 17:01:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:39.242933 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847abed-ba12-4437-893b-c3ab2606201d service swift] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:39.264596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847abed-ba12-4437-893b-c3ab2606201d service swift] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:39.274398 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6271b5-b328-447e-bce4-68cea8104d6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861452a1dc634bf69ce630d7dcd8a2d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:39.275289 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6271b5-b328-447e-bce4-68cea8104d6b service swift] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:39.275690 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6271b5-b328-447e-bce4-68cea8104d6b service swift] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:39.276066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6271b5-b328-447e-bce4-68cea8104d6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:39.287970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6271b5-b328-447e-bce4-68cea8104d6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:39.290074 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6271b5-b328-447e-bce4-68cea8104d6b service swift] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:39.307411 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1211/2428] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 17:01:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 17:01:39.897753 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969692c-ccac-4135-91d4-0cb9b4e73ee8 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:39.987107 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969692c-ccac-4135-91d4-0cb9b4e73ee8 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:39.992136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3d420-81c9-4e25-9c14-2baa0b46cfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:39.992932 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3d420-81c9-4e25-9c14-2baa0b46cfb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:39.993215 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3d420-81c9-4e25-9c14-2baa0b46cfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:39.993655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3d420-81c9-4e25-9c14-2baa0b46cfb2 admin admin] PATH_INFO: `/v3/users/c7d1509637014d6dad80d65287573079` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:39.994698 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3d420-81c9-4e25-9c14-2baa0b46cfb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7d1509637014d6dad80d65287573079)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:39.996641 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3d420-81c9-4e25-9c14-2baa0b46cfb2 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:40.223696 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:40.230219 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-a9c3d420-81c9-4e25-9c14-2baa0b46cfb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7d1509637014d6dad80d65287573079'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:40.241786 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-a9c3d420-81c9-4e25-9c14-2baa0b46cfb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7d1509637014d6dad80d65287573079'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:40.243030 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-a9c3d420-81c9-4e25-9c14-2baa0b46cfb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7d1509637014d6dad80d65287573079'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:40.273980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327c1d2-0177-4e66-8333-9c4beff86b91 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:40.274512 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327c1d2-0177-4e66-8333-9c4beff86b91 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:40.274617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-a9c3d420-81c9-4e25-9c14-2baa0b46cfb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7d1509637014d6dad80d65287573079'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:40.274734 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327c1d2-0177-4e66-8333-9c4beff86b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:40.275681 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-a9c3d420-81c9-4e25-9c14-2baa0b46cfb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7d1509637014d6dad80d65287573079'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:40.295071 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-c327c1d2-0177-4e66-8333-9c4beff86b91 None None] MFA Rules not processed for user `2a0a8cfb2482466a98340adab9980d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:40.296322 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-c327c1d2-0177-4e66-8333-9c4beff86b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:40.304785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1212/2429] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 17:01:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:01:40.323970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327c1d2-0177-4e66-8333-9c4beff86b91 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:40.326016 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-c327c1d2-0177-4e66-8333-9c4beff86b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:40.367359 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327c1d2-0177-4e66-8333-9c4beff86b91 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:40.381712 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44b50d-e87f-4688-869e-f93790fbb0a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861452a1dc634bf69ce630d7dcd8a2d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:40.382389 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44b50d-e87f-4688-869e-f93790fbb0a9 service swift] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:40.382678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44b50d-e87f-4688-869e-f93790fbb0a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:40.382961 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44b50d-e87f-4688-869e-f93790fbb0a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:40.402173 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1218/2430] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:01:39 2022] DELETE /identity/v3/users/c7d1509637014d6dad80d65287573079 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:40.406684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05766b-441e-451f-a2a7-01ed0d7282bd None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:40.407167 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05766b-441e-451f-a2a7-01ed0d7282bd None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:40.407665 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05766b-441e-451f-a2a7-01ed0d7282bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:40.412241 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44b50d-e87f-4688-869e-f93790fbb0a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:40.415075 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44b50d-e87f-4688-869e-f93790fbb0a9 service swift] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:40.434488 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-8e05766b-441e-451f-a2a7-01ed0d7282bd None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:40.436609 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-8e05766b-441e-451f-a2a7-01ed0d7282bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:40.440413 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1213/2431] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 17:01:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 17:01:40.524155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1219/2432] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:01:40.536249 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44b50d-e87f-4688-869e-f93790fbb0a9 service swift] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:40.537886 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0c44b50d-e87f-4688-869e-f93790fbb0a9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:40.611157 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44b50d-e87f-4688-869e-f93790fbb0a9 service swift] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:40.734108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe39ba-311f-431f-a6b6-fd6e88c09d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:40.734936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe39ba-311f-431f-a6b6-fd6e88c09d5a service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:40.735543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe39ba-311f-431f-a6b6-fd6e88c09d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:40.736785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe39ba-311f-431f-a6b6-fd6e88c09d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:40.753743 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe39ba-311f-431f-a6b6-fd6e88c09d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:40.756714 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe39ba-311f-431f-a6b6-fd6e88c09d5a service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:40.792196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1214/2433] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:01:41.581792 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de543c7d-ce52-4c2c-9d58-9427ca1af427 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:41.582363 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de543c7d-ce52-4c2c-9d58-9427ca1af427 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:41.582479 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de543c7d-ce52-4c2c-9d58-9427ca1af427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:41.623195 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-de543c7d-ce52-4c2c-9d58-9427ca1af427 None None] MFA Rules not processed for user `2a0a8cfb2482466a98340adab9980d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:41.624467 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-de543c7d-ce52-4c2c-9d58-9427ca1af427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:41.740556 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe39ba-311f-431f-a6b6-fd6e88c09d5a service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:41.742620 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-d0fe39ba-311f-431f-a6b6-fd6e88c09d5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:41.763861 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe39ba-311f-431f-a6b6-fd6e88c09d5a service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:41.777445 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1220/2434] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jun 22 17:01:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:41.781758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bc949-3519-456a-8222-99450b1c76c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:41.783559 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bc949-3519-456a-8222-99450b1c76c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:41.783792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bc949-3519-456a-8222-99450b1c76c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:41.784163 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bc949-3519-456a-8222-99450b1c76c6 admin admin] PATH_INFO: `/v3/projects/49d43b22db984da88d05f2193cdc697f` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:41.785811 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bc949-3519-456a-8222-99450b1c76c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d43b22db984da88d05f2193cdc697f)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:41.790598 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bc949-3519-456a-8222-99450b1c76c6 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:41.811190 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de543c7d-ce52-4c2c-9d58-9427ca1af427 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:41.842719 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:41.917651 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:41.922366 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de543c7d-ce52-4c2c-9d58-9427ca1af427 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:41.928835 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a92275-9e96-457a-84a9-7544cfada6d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861452a1dc634bf69ce630d7dcd8a2d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:41.930238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a92275-9e96-457a-84a9-7544cfada6d9 service swift] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:41.930683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a92275-9e96-457a-84a9-7544cfada6d9 service swift] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:41.930962 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a92275-9e96-457a-84a9-7544cfada6d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:41.944696 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a92275-9e96-457a-84a9-7544cfada6d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:41.948569 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a92275-9e96-457a-84a9-7544cfada6d9 service swift] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:41.967271 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1221/2435] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 17:01:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 17:01:41.971334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-247bc949-3519-456a-8222-99450b1c76c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d43b22db984da88d05f2193cdc697f', 'request_id': 'req-247bc949-3519-456a-8222-99450b1c76c6'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:42.064739 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-247bc949-3519-456a-8222-99450b1c76c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d43b22db984da88d05f2193cdc697f', 'request_id': 'req-247bc949-3519-456a-8222-99450b1c76c6'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:42.069302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-247bc949-3519-456a-8222-99450b1c76c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d43b22db984da88d05f2193cdc697f', 'request_id': 'req-247bc949-3519-456a-8222-99450b1c76c6'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:42.090343 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-247bc949-3519-456a-8222-99450b1c76c6 admin admin] The token cache is being invalidate because project 49d43b22db984da88d05f2193cdc697f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:01:42.090917 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-247bc949-3519-456a-8222-99450b1c76c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:42.091739 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-247bc949-3519-456a-8222-99450b1c76c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:42.098029 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1215/2436] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:01:41 2022] DELETE /identity/v3/projects/49d43b22db984da88d05f2193cdc697f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:01:42.098920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a92275-9e96-457a-84a9-7544cfada6d9 service swift] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:42.113155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a92275-9e96-457a-84a9-7544cfada6d9 service swift] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:42.199379 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152171f-3dee-497d-a21e-494dd48ae6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:42.200359 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152171f-3dee-497d-a21e-494dd48ae6fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:42.200649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152171f-3dee-497d-a21e-494dd48ae6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:42.200934 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152171f-3dee-497d-a21e-494dd48ae6fa admin admin] PATH_INFO: `/v3/users/89f6c597b5f2404e999e4328e5fb0674` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:42.210104 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152171f-3dee-497d-a21e-494dd48ae6fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=89f6c597b5f2404e999e4328e5fb0674)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:42.212084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152171f-3dee-497d-a21e-494dd48ae6fa admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:42.400774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-e152171f-3dee-497d-a21e-494dd48ae6fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89f6c597b5f2404e999e4328e5fb0674'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:42.416848 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-e152171f-3dee-497d-a21e-494dd48ae6fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89f6c597b5f2404e999e4328e5fb0674'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:42.417939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-e152171f-3dee-497d-a21e-494dd48ae6fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89f6c597b5f2404e999e4328e5fb0674'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:42.434196 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-e152171f-3dee-497d-a21e-494dd48ae6fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89f6c597b5f2404e999e4328e5fb0674'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:42.435319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-e152171f-3dee-497d-a21e-494dd48ae6fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89f6c597b5f2404e999e4328e5fb0674'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:42.558856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1222/2437] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:01:42 2022] DELETE /identity/v3/users/89f6c597b5f2404e999e4328e5fb0674 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:01:43.223125 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bc949-3519-456a-8222-99450b1c76c6 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:43.225354 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-247bc949-3519-456a-8222-99450b1c76c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:43.269308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bc949-3519-456a-8222-99450b1c76c6 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:43.433280 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b728a-279d-42b2-9093-b23062cea46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:43.434828 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b728a-279d-42b2-9093-b23062cea46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:43.435349 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b728a-279d-42b2-9093-b23062cea46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:43.435816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b728a-279d-42b2-9093-b23062cea46f admin admin] PATH_INFO: `/v3/projects/c5ef24943bab4c1193ad7e97166166ab` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:43.437910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b728a-279d-42b2-9093-b23062cea46f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5ef24943bab4c1193ad7e97166166ab)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:43.440342 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b728a-279d-42b2-9093-b23062cea46f admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:43.607795 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4d1b728a-279d-42b2-9093-b23062cea46f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ef24943bab4c1193ad7e97166166ab', 'request_id': 'req-4d1b728a-279d-42b2-9093-b23062cea46f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:43.816492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4d1b728a-279d-42b2-9093-b23062cea46f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ef24943bab4c1193ad7e97166166ab', 'request_id': 'req-4d1b728a-279d-42b2-9093-b23062cea46f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:43.838634 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4d1b728a-279d-42b2-9093-b23062cea46f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ef24943bab4c1193ad7e97166166ab', 'request_id': 'req-4d1b728a-279d-42b2-9093-b23062cea46f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:43.912341 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4d1b728a-279d-42b2-9093-b23062cea46f admin admin] The token cache is being invalidate because project c5ef24943bab4c1193ad7e97166166ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:01:43.912341 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4d1b728a-279d-42b2-9093-b23062cea46f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:43.912341 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4d1b728a-279d-42b2-9093-b23062cea46f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:43.914060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1216/2438] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:01:43 2022] DELETE /identity/v3/projects/c5ef24943bab4c1193ad7e97166166ab => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:43.918965 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf354241-644c-42f8-8bcf-59bf185b7e78 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:43.919520 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf354241-644c-42f8-8bcf-59bf185b7e78 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:43.919520 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf354241-644c-42f8-8bcf-59bf185b7e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:43.950596 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-cf354241-644c-42f8-8bcf-59bf185b7e78 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:43.955370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-cf354241-644c-42f8-8bcf-59bf185b7e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:44.064989 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1223/2439] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:01:44.072906 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822dd86-a1af-47f0-b3cb-350c6710b2e1 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:44.073230 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822dd86-a1af-47f0-b3cb-350c6710b2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:44.073883 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822dd86-a1af-47f0-b3cb-350c6710b2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:44.128397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-d822dd86-a1af-47f0-b3cb-350c6710b2e1 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:44.135293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-d822dd86-a1af-47f0-b3cb-350c6710b2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:44.138570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1217/2440] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:44.143396 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf354241-644c-42f8-8bcf-59bf185b7e78 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:44.154556 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf354241-644c-42f8-8bcf-59bf185b7e78 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:44.163280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422ee4f-326f-4e89-88e4-dd903da7e18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:44.163983 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422ee4f-326f-4e89-88e4-dd903da7e18a admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:44.164573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422ee4f-326f-4e89-88e4-dd903da7e18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:44.165037 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422ee4f-326f-4e89-88e4-dd903da7e18a admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:44.166220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422ee4f-326f-4e89-88e4-dd903da7e18a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:01:44.166716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422ee4f-326f-4e89-88e4-dd903da7e18a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:44.168800 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422ee4f-326f-4e89-88e4-dd903da7e18a admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:44.177892 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:44.193197 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1224/2441] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:01:44.193316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822dd86-a1af-47f0-b3cb-350c6710b2e1 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:44.216479 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822dd86-a1af-47f0-b3cb-350c6710b2e1 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:44.221246 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e79683-0ab6-4303-b2e7-26ccac47e153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:44.221625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e79683-0ab6-4303-b2e7-26ccac47e153 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:44.221861 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e79683-0ab6-4303-b2e7-26ccac47e153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:44.222104 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e79683-0ab6-4303-b2e7-26ccac47e153 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:44.222819 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e79683-0ab6-4303-b2e7-26ccac47e153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:44.225094 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e79683-0ab6-4303-b2e7-26ccac47e153 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:44.303457 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:44.315410 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1218/2442] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:01:44 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:01:44.316579 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422ee4f-326f-4e89-88e4-dd903da7e18a admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:44.327751 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422ee4f-326f-4e89-88e4-dd903da7e18a admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:44.398349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0c6a8-a808-4790-a6e0-439548b42945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:44.399525 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0c6a8-a808-4790-a6e0-439548b42945 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:44.400049 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0c6a8-a808-4790-a6e0-439548b42945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:44.400754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0c6a8-a808-4790-a6e0-439548b42945 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:44.402113 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0c6a8-a808-4790-a6e0-439548b42945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:44.404737 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0c6a8-a808-4790-a6e0-439548b42945 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:44.627526 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1225/2443] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:01:44 2022] POST /identity/v3/users => generated 292 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:01:44.628044 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e79683-0ab6-4303-b2e7-26ccac47e153 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:44.648394 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e79683-0ab6-4303-b2e7-26ccac47e153 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:44.662624 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cc382-435d-484a-8dbc-cf72d9e7215d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:44.664868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cc382-435d-484a-8dbc-cf72d9e7215d admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:44.665309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cc382-435d-484a-8dbc-cf72d9e7215d admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:44.665778 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cc382-435d-484a-8dbc-cf72d9e7215d admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:44.666617 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0cc382-435d-484a-8dbc-cf72d9e7215d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:44.668450 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0cc382-435d-484a-8dbc-cf72d9e7215d admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:44.684284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1219/2444] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:01:44.689544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0c6a8-a808-4790-a6e0-439548b42945 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:44.704595 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0c6a8-a808-4790-a6e0-439548b42945 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:44.710248 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed026b3b-6300-4fa4-9e86-8588186ef6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:44.711103 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed026b3b-6300-4fa4-9e86-8588186ef6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:44.711694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed026b3b-6300-4fa4-9e86-8588186ef6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:44.712301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed026b3b-6300-4fa4-9e86-8588186ef6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:44.713111 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed026b3b-6300-4fa4-9e86-8588186ef6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:44.714738 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed026b3b-6300-4fa4-9e86-8588186ef6a2 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:44.727117 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1226/2445] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:01:44.738845 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cc382-435d-484a-8dbc-cf72d9e7215d admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:44.744336 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cc382-435d-484a-8dbc-cf72d9e7215d admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:44.750675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb520d4-bd32-4727-9977-fdc26a33b1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:44.752188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb520d4-bd32-4727-9977-fdc26a33b1b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:44.752615 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb520d4-bd32-4727-9977-fdc26a33b1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:44.753038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb520d4-bd32-4727-9977-fdc26a33b1b1 admin admin] PATH_INFO: `/v3/projects/ac1e39cc35884fbeaff81197a6e1fbd1/users/b7e627e9d04345d19f9b080fc4b7c491/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:44.772361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb520d4-bd32-4727-9977-fdc26a33b1b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1e39cc35884fbeaff81197a6e1fbd1, user_id=b7e627e9d04345d19f9b080fc4b7c491, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:44.775363 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb520d4-bd32-4727-9977-fdc26a33b1b1 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:44.865586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1220/2446] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:01:44 2022] PUT /identity/v3/projects/ac1e39cc35884fbeaff81197a6e1fbd1/users/b7e627e9d04345d19f9b080fc4b7c491/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:44.874215 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5dbd-4e33-4063-ba8d-d1a2f162f705 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:44.874698 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5dbd-4e33-4063-ba8d-d1a2f162f705 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:44.875123 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5dbd-4e33-4063-ba8d-d1a2f162f705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:44.930265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-b4ed5dbd-4e33-4063-ba8d-d1a2f162f705 None None] MFA Rules not processed for user `b7e627e9d04345d19f9b080fc4b7c491`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:44.932779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-b4ed5dbd-4e33-4063-ba8d-d1a2f162f705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:45.020938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1227/2447] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:45.034962 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb520d4-bd32-4727-9977-fdc26a33b1b1 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:45.103647 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb520d4-bd32-4727-9977-fdc26a33b1b1 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:45.111748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74292c-1e94-4bdc-8c23-9d9f7ba3c2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:45.111748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74292c-1e94-4bdc-8c23-9d9f7ba3c2c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:45.111748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74292c-1e94-4bdc-8c23-9d9f7ba3c2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:45.111748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74292c-1e94-4bdc-8c23-9d9f7ba3c2c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:45.112085 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74292c-1e94-4bdc-8c23-9d9f7ba3c2c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:45.113865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74292c-1e94-4bdc-8c23-9d9f7ba3c2c8 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:45.253821 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1221/2448] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:01:45 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:01:45.255761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed5dbd-4e33-4063-ba8d-d1a2f162f705 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:45.267073 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed5dbd-4e33-4063-ba8d-d1a2f162f705 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:45.326297 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36412383-03a7-4747-bb44-5ab9eae95128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:45.326979 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36412383-03a7-4747-bb44-5ab9eae95128 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:45.327264 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36412383-03a7-4747-bb44-5ab9eae95128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:45.327543 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36412383-03a7-4747-bb44-5ab9eae95128 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:45.328287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36412383-03a7-4747-bb44-5ab9eae95128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:45.332485 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36412383-03a7-4747-bb44-5ab9eae95128 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:45.350110 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:45.437127 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1228/2449] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:01:45 2022] POST /identity/v3/users => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:01:45.438643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74292c-1e94-4bdc-8c23-9d9f7ba3c2c8 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:45.450013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74292c-1e94-4bdc-8c23-9d9f7ba3c2c8 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:45.455425 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0287642-c691-4078-808a-19dc9dcd4d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:45.456087 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0287642-c691-4078-808a-19dc9dcd4d50 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:45.456402 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0287642-c691-4078-808a-19dc9dcd4d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:45.456683 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0287642-c691-4078-808a-19dc9dcd4d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:45.457416 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0287642-c691-4078-808a-19dc9dcd4d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:45.459026 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0287642-c691-4078-808a-19dc9dcd4d50 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:45.471259 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1222/2450] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:01:45.475512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36412383-03a7-4747-bb44-5ab9eae95128 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:45.486262 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36412383-03a7-4747-bb44-5ab9eae95128 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:45.491313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71946510-f19a-4854-88c9-23ba2fa220f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:45.492225 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71946510-f19a-4854-88c9-23ba2fa220f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:45.492567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71946510-f19a-4854-88c9-23ba2fa220f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:45.492843 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71946510-f19a-4854-88c9-23ba2fa220f0 admin admin] PATH_INFO: `/v3/projects/d3924ad9cfd34901aa4822b4f8beeb26/users/d1084cf1ca1f479b89cc76993c986419/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:45.516541 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71946510-f19a-4854-88c9-23ba2fa220f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3924ad9cfd34901aa4822b4f8beeb26, user_id=d1084cf1ca1f479b89cc76993c986419, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:45.516541 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71946510-f19a-4854-88c9-23ba2fa220f0 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:45.573256 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0287642-c691-4078-808a-19dc9dcd4d50 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:45.574976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b0287642-c691-4078-808a-19dc9dcd4d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:45.589322 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0287642-c691-4078-808a-19dc9dcd4d50 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:45.595579 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e60d4-e33c-4f6a-a9a7-b76a5a34b99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:45.596602 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e60d4-e33c-4f6a-a9a7-b76a5a34b99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:45.602619 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e60d4-e33c-4f6a-a9a7-b76a5a34b99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:45.602619 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e60d4-e33c-4f6a-a9a7-b76a5a34b99c admin admin] PATH_INFO: `/v3/users/bf248c9dc99d4ee9a9fe20ef65be5c02` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:45.602619 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e60d4-e33c-4f6a-a9a7-b76a5a34b99c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf248c9dc99d4ee9a9fe20ef65be5c02)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:45.602619 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e60d4-e33c-4f6a-a9a7-b76a5a34b99c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:45.624929 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1229/2451] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:01:45 2022] PUT /identity/v3/projects/d3924ad9cfd34901aa4822b4f8beeb26/users/d1084cf1ca1f479b89cc76993c986419/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:45.629459 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71946510-f19a-4854-88c9-23ba2fa220f0 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:45.702898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71946510-f19a-4854-88c9-23ba2fa220f0 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:45.710998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d20afa-a1f1-4ea0-8e01-08626c08b5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:45.715400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d20afa-a1f1-4ea0-8e01-08626c08b5bd admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:45.715400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d20afa-a1f1-4ea0-8e01-08626c08b5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:45.715400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d20afa-a1f1-4ea0-8e01-08626c08b5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:45.715400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d20afa-a1f1-4ea0-8e01-08626c08b5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:45.716042 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d20afa-a1f1-4ea0-8e01-08626c08b5bd admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:45.726822 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1230/2452] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:01:45.730784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d20afa-a1f1-4ea0-8e01-08626c08b5bd admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:45.743385 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d20afa-a1f1-4ea0-8e01-08626c08b5bd admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:45.747195 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9be2bb-1033-4c66-8ff8-ef236313910f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:45.748084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9be2bb-1033-4c66-8ff8-ef236313910f admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:45.748411 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9be2bb-1033-4c66-8ff8-ef236313910f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:45.748689 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9be2bb-1033-4c66-8ff8-ef236313910f admin admin] PATH_INFO: `/v3/projects/d3924ad9cfd34901aa4822b4f8beeb26/users/d1084cf1ca1f479b89cc76993c986419/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:45.750704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9be2bb-1033-4c66-8ff8-ef236313910f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3924ad9cfd34901aa4822b4f8beeb26, user_id=d1084cf1ca1f479b89cc76993c986419, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:45.754011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9be2bb-1033-4c66-8ff8-ef236313910f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:45.765887 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1231/2453] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:01:45 2022] PUT /identity/v3/projects/d3924ad9cfd34901aa4822b4f8beeb26/users/d1084cf1ca1f479b89cc76993c986419/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:01:45.776402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bfdad-fca1-4565-a995-b057ff02c8d7 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:45.776638 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bfdad-fca1-4565-a995-b057ff02c8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:45.776921 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bfdad-fca1-4565-a995-b057ff02c8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:45.803977 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-f21bfdad-fca1-4565-a995-b057ff02c8d7 None None] MFA Rules not processed for user `d1084cf1ca1f479b89cc76993c986419`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:45.805226 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f21bfdad-fca1-4565-a995-b057ff02c8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:45.827529 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-248e60d4-e33c-4f6a-a9a7-b76a5a34b99c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf248c9dc99d4ee9a9fe20ef65be5c02'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:45.828313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-248e60d4-e33c-4f6a-a9a7-b76a5a34b99c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf248c9dc99d4ee9a9fe20ef65be5c02'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:45.881963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1232/2454] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:01:45.894532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bfdad-fca1-4565-a995-b057ff02c8d7 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:45.895982 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f21bfdad-fca1-4565-a995-b057ff02c8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:45.901183 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-248e60d4-e33c-4f6a-a9a7-b76a5a34b99c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf248c9dc99d4ee9a9fe20ef65be5c02'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:45.901859 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-248e60d4-e33c-4f6a-a9a7-b76a5a34b99c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf248c9dc99d4ee9a9fe20ef65be5c02'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:45.916398 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-248e60d4-e33c-4f6a-a9a7-b76a5a34b99c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf248c9dc99d4ee9a9fe20ef65be5c02'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:45.931797 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1223/2455] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:01:45 2022] DELETE /identity/v3/users/bf248c9dc99d4ee9a9fe20ef65be5c02 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:45.935927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7eab67-9030-4928-a8ea-f3f9899244e4 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:45.936959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7eab67-9030-4928-a8ea-f3f9899244e4 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:45.937347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7eab67-9030-4928-a8ea-f3f9899244e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:45.950404 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:45.956857 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-9d7eab67-9030-4928-a8ea-f3f9899244e4 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:45.959003 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-9d7eab67-9030-4928-a8ea-f3f9899244e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:45.964918 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:45.994252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bfdad-fca1-4565-a995-b057ff02c8d7 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:46.052887 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1224/2456] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:46.066458 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7eab67-9030-4928-a8ea-f3f9899244e4 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:46.068419 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-9d7eab67-9030-4928-a8ea-f3f9899244e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:46.078885 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb81a4-d239-4c68-83e8-669504d6bd2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:46.080197 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb81a4-d239-4c68-83e8-669504d6bd2f service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:46.080556 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb81a4-d239-4c68-83e8-669504d6bd2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:46.080905 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb81a4-d239-4c68-83e8-669504d6bd2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:46.130897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7eab67-9030-4928-a8ea-f3f9899244e4 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:46.134877 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8fe8a-21d2-4df4-8dab-c2367ad07d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:46.135806 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8fe8a-21d2-4df4-8dab-c2367ad07d44 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:46.136235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8fe8a-21d2-4df4-8dab-c2367ad07d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:46.136770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8fe8a-21d2-4df4-8dab-c2367ad07d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:46.148927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8fe8a-21d2-4df4-8dab-c2367ad07d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:46.151241 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8fe8a-21d2-4df4-8dab-c2367ad07d44 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:46.162885 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1225/2457] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:01:46.191129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb81a4-d239-4c68-83e8-669504d6bd2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:46.192664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb81a4-d239-4c68-83e8-669504d6bd2f service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:46.217289 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1233/2458] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:01:46.394524 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8fe8a-21d2-4df4-8dab-c2367ad07d44 service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:46.403978 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8fe8a-21d2-4df4-8dab-c2367ad07d44 service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:46.408142 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3469f-60b6-4cc1-8631-88ff835b93d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:46.408785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3469f-60b6-4cc1-8631-88ff835b93d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:46.409069 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3469f-60b6-4cc1-8631-88ff835b93d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:46.409347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3469f-60b6-4cc1-8631-88ff835b93d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:46.411147 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-d0d3469f-60b6-4cc1-8631-88ff835b93d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:46.469490 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3469f-60b6-4cc1-8631-88ff835b93d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:46.471455 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3469f-60b6-4cc1-8631-88ff835b93d0 service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:46.483439 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1226/2459] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:01:46.490426 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb81a4-d239-4c68-83e8-669504d6bd2f service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:46.497713 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-91cb81a4-d239-4c68-83e8-669504d6bd2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:46.516224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb81a4-d239-4c68-83e8-669504d6bd2f service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:46.526827 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934af5e-56a3-4021-80af-21c566c5da8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:46.527729 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934af5e-56a3-4021-80af-21c566c5da8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:46.528015 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934af5e-56a3-4021-80af-21c566c5da8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:46.528399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934af5e-56a3-4021-80af-21c566c5da8e admin admin] PATH_INFO: `/v3/projects/5c1d98639af64f48966a2ba8d171895c` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:46.529862 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934af5e-56a3-4021-80af-21c566c5da8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c1d98639af64f48966a2ba8d171895c)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:46.535472 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934af5e-56a3-4021-80af-21c566c5da8e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:46.641818 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-6934af5e-56a3-4021-80af-21c566c5da8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c1d98639af64f48966a2ba8d171895c', 'request_id': 'req-6934af5e-56a3-4021-80af-21c566c5da8e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:46.729971 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-6934af5e-56a3-4021-80af-21c566c5da8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c1d98639af64f48966a2ba8d171895c', 'request_id': 'req-6934af5e-56a3-4021-80af-21c566c5da8e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:46.740122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-6934af5e-56a3-4021-80af-21c566c5da8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c1d98639af64f48966a2ba8d171895c', 'request_id': 'req-6934af5e-56a3-4021-80af-21c566c5da8e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:46.752450 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-6934af5e-56a3-4021-80af-21c566c5da8e admin admin] The token cache is being invalidate because project 5c1d98639af64f48966a2ba8d171895c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:01:46.752864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-6934af5e-56a3-4021-80af-21c566c5da8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:46.753634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-6934af5e-56a3-4021-80af-21c566c5da8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:46.763514 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1234/2460] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:01:46 2022] DELETE /identity/v3/projects/5c1d98639af64f48966a2ba8d171895c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:46.867683 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bb9ee-8c46-44f7-934b-e5a910eb68a3 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:46.867683 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bb9ee-8c46-44f7-934b-e5a910eb68a3 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:46.867683 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bb9ee-8c46-44f7-934b-e5a910eb68a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:46.886202 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-c05bb9ee-8c46-44f7-934b-e5a910eb68a3 None None] MFA Rules not processed for user `2a0a8cfb2482466a98340adab9980d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:46.887531 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-c05bb9ee-8c46-44f7-934b-e5a910eb68a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:46.947841 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:46.957152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1227/2461] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jun 22 17:01:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:46.969633 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934af5e-56a3-4021-80af-21c566c5da8e admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:46.971643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-6934af5e-56a3-4021-80af-21c566c5da8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:46.982648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:47.033292 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bb9ee-8c46-44f7-934b-e5a910eb68a3 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:47.034710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-c05bb9ee-8c46-44f7-934b-e5a910eb68a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:47.045153 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934af5e-56a3-4021-80af-21c566c5da8e admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:47.050877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928c577-90b0-4ba7-88be-9169cab97f66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861452a1dc634bf69ce630d7dcd8a2d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:47.051585 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928c577-90b0-4ba7-88be-9169cab97f66 service swift] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:47.051868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928c577-90b0-4ba7-88be-9169cab97f66 service swift] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:47.052196 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928c577-90b0-4ba7-88be-9169cab97f66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:47.060985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928c577-90b0-4ba7-88be-9169cab97f66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:47.062599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928c577-90b0-4ba7-88be-9169cab97f66 service swift] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:47.071174 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1235/2462] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 17:01:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 17:01:47.108053 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bb9ee-8c46-44f7-934b-e5a910eb68a3 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:47.113312 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d898c-ca6a-43e0-8452-a105d484f288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:47.114184 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d898c-ca6a-43e0-8452-a105d484f288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:47.114464 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d898c-ca6a-43e0-8452-a105d484f288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:47.114741 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d898c-ca6a-43e0-8452-a105d484f288 admin admin] PATH_INFO: `/v3/users/b7e627e9d04345d19f9b080fc4b7c491` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:47.115949 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d898c-ca6a-43e0-8452-a105d484f288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e627e9d04345d19f9b080fc4b7c491)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:47.117896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d898c-ca6a-43e0-8452-a105d484f288 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:47.274484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-1c2d898c-ca6a-43e0-8452-a105d484f288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e627e9d04345d19f9b080fc4b7c491'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:47.275193 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-1c2d898c-ca6a-43e0-8452-a105d484f288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e627e9d04345d19f9b080fc4b7c491'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:47.398102 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-1c2d898c-ca6a-43e0-8452-a105d484f288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e627e9d04345d19f9b080fc4b7c491'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:47.398722 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-1c2d898c-ca6a-43e0-8452-a105d484f288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e627e9d04345d19f9b080fc4b7c491'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:47.412542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-1c2d898c-ca6a-43e0-8452-a105d484f288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e627e9d04345d19f9b080fc4b7c491'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:47.425254 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1228/2463] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:01:47 2022] DELETE /identity/v3/users/b7e627e9d04345d19f9b080fc4b7c491 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:01:47.429577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b47624-dc9c-438f-abe1-e02b29816102 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:47.429877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b47624-dc9c-438f-abe1-e02b29816102 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:47.430183 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b47624-dc9c-438f-abe1-e02b29816102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:47.449134 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-f1b47624-dc9c-438f-abe1-e02b29816102 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:47.450413 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f1b47624-dc9c-438f-abe1-e02b29816102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:47.511089 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1236/2464] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:47.520502 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d898c-ca6a-43e0-8452-a105d484f288 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:47.522084 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-1c2d898c-ca6a-43e0-8452-a105d484f288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:47.579305 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d898c-ca6a-43e0-8452-a105d484f288 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:47.582967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e7635-340b-4ca6-acd8-54116b58d061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:47.583603 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e7635-340b-4ca6-acd8-54116b58d061 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:47.583883 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e7635-340b-4ca6-acd8-54116b58d061 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:47.584198 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e7635-340b-4ca6-acd8-54116b58d061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:47.593187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e7635-340b-4ca6-acd8-54116b58d061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:47.594669 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e7635-340b-4ca6-acd8-54116b58d061 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:47.604222 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1229/2465] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:01:48.071628 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b47624-dc9c-438f-abe1-e02b29816102 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:48.073089 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f1b47624-dc9c-438f-abe1-e02b29816102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:48.085442 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b47624-dc9c-438f-abe1-e02b29816102 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:48.090516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee614b-523c-4982-9766-34678b8f422f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:48.091484 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee614b-523c-4982-9766-34678b8f422f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:48.091783 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee614b-523c-4982-9766-34678b8f422f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:48.092071 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee614b-523c-4982-9766-34678b8f422f admin admin] PATH_INFO: `/v3/projects/ac1e39cc35884fbeaff81197a6e1fbd1` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:48.093306 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee614b-523c-4982-9766-34678b8f422f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac1e39cc35884fbeaff81197a6e1fbd1)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:48.095733 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee614b-523c-4982-9766-34678b8f422f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:48.203508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c4ee614b-523c-4982-9766-34678b8f422f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac1e39cc35884fbeaff81197a6e1fbd1', 'request_id': 'req-c4ee614b-523c-4982-9766-34678b8f422f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:48.295468 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c4ee614b-523c-4982-9766-34678b8f422f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac1e39cc35884fbeaff81197a6e1fbd1', 'request_id': 'req-c4ee614b-523c-4982-9766-34678b8f422f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:48.302211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c4ee614b-523c-4982-9766-34678b8f422f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac1e39cc35884fbeaff81197a6e1fbd1', 'request_id': 'req-c4ee614b-523c-4982-9766-34678b8f422f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:48.312873 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c4ee614b-523c-4982-9766-34678b8f422f admin admin] The token cache is being invalidate because project ac1e39cc35884fbeaff81197a6e1fbd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:01:48.313221 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c4ee614b-523c-4982-9766-34678b8f422f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:48.313887 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c4ee614b-523c-4982-9766-34678b8f422f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:48.315766 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1237/2466] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:01:48 2022] DELETE /identity/v3/projects/ac1e39cc35884fbeaff81197a6e1fbd1 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:48.321242 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e7635-340b-4ca6-acd8-54116b58d061 service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:48.331558 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e7635-340b-4ca6-acd8-54116b58d061 service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:48.348231 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:48.391520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a87f4-01fe-4f9f-935a-255ec034ea4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:48.392781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a87f4-01fe-4f9f-935a-255ec034ea4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:48.393090 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a87f4-01fe-4f9f-935a-255ec034ea4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:48.393330 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a87f4-01fe-4f9f-935a-255ec034ea4c admin admin] PATH_INFO: `/v3/users/d1084cf1ca1f479b89cc76993c986419` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:48.394529 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a87f4-01fe-4f9f-935a-255ec034ea4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1084cf1ca1f479b89cc76993c986419)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:48.396514 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a87f4-01fe-4f9f-935a-255ec034ea4c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:48.607826 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-480a87f4-01fe-4f9f-935a-255ec034ea4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1084cf1ca1f479b89cc76993c986419'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:48.608532 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-480a87f4-01fe-4f9f-935a-255ec034ea4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1084cf1ca1f479b89cc76993c986419'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:48.672277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-480a87f4-01fe-4f9f-935a-255ec034ea4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1084cf1ca1f479b89cc76993c986419'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:48.672889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-480a87f4-01fe-4f9f-935a-255ec034ea4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1084cf1ca1f479b89cc76993c986419'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:48.686356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-480a87f4-01fe-4f9f-935a-255ec034ea4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1084cf1ca1f479b89cc76993c986419'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:48.699682 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1230/2467] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:01:48 2022] DELETE /identity/v3/users/d1084cf1ca1f479b89cc76993c986419 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:49.100499 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee614b-523c-4982-9766-34678b8f422f admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:49.101963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c4ee614b-523c-4982-9766-34678b8f422f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:49.116387 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee614b-523c-4982-9766-34678b8f422f admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:49.135155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:49.172861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a29b2-589b-48c0-adeb-6555ab1d0034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:49.174266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a29b2-589b-48c0-adeb-6555ab1d0034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:49.174550 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a29b2-589b-48c0-adeb-6555ab1d0034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:49.174828 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a29b2-589b-48c0-adeb-6555ab1d0034 admin admin] PATH_INFO: `/v3/projects/d3924ad9cfd34901aa4822b4f8beeb26` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:49.176060 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a29b2-589b-48c0-adeb-6555ab1d0034 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3924ad9cfd34901aa4822b4f8beeb26)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:49.177993 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a29b2-589b-48c0-adeb-6555ab1d0034 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:49.301249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d28a29b2-589b-48c0-adeb-6555ab1d0034 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3924ad9cfd34901aa4822b4f8beeb26', 'request_id': 'req-d28a29b2-589b-48c0-adeb-6555ab1d0034'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:49.441677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d28a29b2-589b-48c0-adeb-6555ab1d0034 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3924ad9cfd34901aa4822b4f8beeb26', 'request_id': 'req-d28a29b2-589b-48c0-adeb-6555ab1d0034'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:49.448582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d28a29b2-589b-48c0-adeb-6555ab1d0034 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3924ad9cfd34901aa4822b4f8beeb26', 'request_id': 'req-d28a29b2-589b-48c0-adeb-6555ab1d0034'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:49.462966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d28a29b2-589b-48c0-adeb-6555ab1d0034 admin admin] The token cache is being invalidate because project d3924ad9cfd34901aa4822b4f8beeb26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:01:49.463254 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d28a29b2-589b-48c0-adeb-6555ab1d0034 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:49.463909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d28a29b2-589b-48c0-adeb-6555ab1d0034 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:49.465482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1238/2468] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:01:49 2022] DELETE /identity/v3/projects/d3924ad9cfd34901aa4822b4f8beeb26 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:49.470714 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3c82b-4e0a-4c21-ad8d-fa7fbf1481da None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:49.471010 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3c82b-4e0a-4c21-ad8d-fa7fbf1481da None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:49.471288 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3c82b-4e0a-4c21-ad8d-fa7fbf1481da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:49.488555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-f5f3c82b-4e0a-4c21-ad8d-fa7fbf1481da None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:49.489770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-f5f3c82b-4e0a-4c21-ad8d-fa7fbf1481da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:49.548766 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1231/2469] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:01:49.557802 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfd990-0516-44fc-b2d2-f617b94d355d None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:49.558395 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfd990-0516-44fc-b2d2-f617b94d355d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:49.558395 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbfd990-0516-44fc-b2d2-f617b94d355d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:49.576958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-0fbfd990-0516-44fc-b2d2-f617b94d355d None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:49.578171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-0fbfd990-0516-44fc-b2d2-f617b94d355d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:49.586721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1239/2470] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:49.591073 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3c82b-4e0a-4c21-ad8d-fa7fbf1481da None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:49.600824 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3c82b-4e0a-4c21-ad8d-fa7fbf1481da None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:49.605466 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09c463-aa2a-4a82-9309-c5dbbfe24f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:49.606129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09c463-aa2a-4a82-9309-c5dbbfe24f85 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:49.606415 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09c463-aa2a-4a82-9309-c5dbbfe24f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:49.606696 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09c463-aa2a-4a82-9309-c5dbbfe24f85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:49.607439 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09c463-aa2a-4a82-9309-c5dbbfe24f85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:01:49.607750 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09c463-aa2a-4a82-9309-c5dbbfe24f85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:49.609397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09c463-aa2a-4a82-9309-c5dbbfe24f85 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:49.621253 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1232/2471] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:01:49.625680 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfd990-0516-44fc-b2d2-f617b94d355d None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:49.635629 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbfd990-0516-44fc-b2d2-f617b94d355d None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:49.640310 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294be14-d45f-4d5a-bd97-e313b14ddb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:49.640973 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294be14-d45f-4d5a-bd97-e313b14ddb66 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:49.641268 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294be14-d45f-4d5a-bd97-e313b14ddb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:49.641558 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294be14-d45f-4d5a-bd97-e313b14ddb66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:49.642997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294be14-d45f-4d5a-bd97-e313b14ddb66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:49.644860 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294be14-d45f-4d5a-bd97-e313b14ddb66 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:49.734414 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1240/2472] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:01:49 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:01:49.740076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09c463-aa2a-4a82-9309-c5dbbfe24f85 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:49.749947 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09c463-aa2a-4a82-9309-c5dbbfe24f85 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:49.775167 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:49.806982 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825eca67-919f-4602-ab3e-2907dd061c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:49.807646 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eca67-919f-4602-ab3e-2907dd061c6f admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:49.807931 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eca67-919f-4602-ab3e-2907dd061c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:49.808241 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eca67-919f-4602-ab3e-2907dd061c6f admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:49.808948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825eca67-919f-4602-ab3e-2907dd061c6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:49.810860 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825eca67-919f-4602-ab3e-2907dd061c6f admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:49.900601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1233/2473] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:01:49 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:01:49.904790 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294be14-d45f-4d5a-bd97-e313b14ddb66 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:49.915693 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294be14-d45f-4d5a-bd97-e313b14ddb66 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:49.920439 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf285b29-43ee-4086-b2b7-0ba8449da387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:49.921136 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf285b29-43ee-4086-b2b7-0ba8449da387 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:49.921422 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf285b29-43ee-4086-b2b7-0ba8449da387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:49.921700 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf285b29-43ee-4086-b2b7-0ba8449da387 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:49.922435 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf285b29-43ee-4086-b2b7-0ba8449da387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:49.924037 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf285b29-43ee-4086-b2b7-0ba8449da387 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:49.934278 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1241/2474] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:01:49.938019 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825eca67-919f-4602-ab3e-2907dd061c6f admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:49.947975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825eca67-919f-4602-ab3e-2907dd061c6f admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:49.952498 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1ca19-d368-4957-81c6-f4ac0f3834a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:49.953137 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1ca19-d368-4957-81c6-f4ac0f3834a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:49.953418 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1ca19-d368-4957-81c6-f4ac0f3834a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:49.953695 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1ca19-d368-4957-81c6-f4ac0f3834a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:49.955005 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1ca19-d368-4957-81c6-f4ac0f3834a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:49.956671 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1ca19-d368-4957-81c6-f4ac0f3834a4 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:49.967040 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1234/2475] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:01:49.971544 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf285b29-43ee-4086-b2b7-0ba8449da387 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:49.981608 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf285b29-43ee-4086-b2b7-0ba8449da387 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:49.986392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9896a7e-3c8c-4014-9f1e-ca21f1bfb8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:49.987271 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9896a7e-3c8c-4014-9f1e-ca21f1bfb8ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:49.987557 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9896a7e-3c8c-4014-9f1e-ca21f1bfb8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:49.987840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9896a7e-3c8c-4014-9f1e-ca21f1bfb8ca admin admin] PATH_INFO: `/v3/projects/a03aa60c8653493b9467423c2c9a42c0/users/a4f0ddc582954f3eb06412b74ede9c0e/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:50.002538 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9896a7e-3c8c-4014-9f1e-ca21f1bfb8ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a03aa60c8653493b9467423c2c9a42c0, user_id=a4f0ddc582954f3eb06412b74ede9c0e, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:50.005233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9896a7e-3c8c-4014-9f1e-ca21f1bfb8ca admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:50.072636 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1242/2476] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:01:49 2022] PUT /identity/v3/projects/a03aa60c8653493b9467423c2c9a42c0/users/a4f0ddc582954f3eb06412b74ede9c0e/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:50.085206 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d8408-f310-41f6-82b5-9e404f162b05 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:50.085535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d8408-f310-41f6-82b5-9e404f162b05 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:50.085820 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d8408-f310-41f6-82b5-9e404f162b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:50.111159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-6c2d8408-f310-41f6-82b5-9e404f162b05 None None] MFA Rules not processed for user `a4f0ddc582954f3eb06412b74ede9c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:50.112397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6c2d8408-f310-41f6-82b5-9e404f162b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:50.175985 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1235/2477] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:50.186951 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9896a7e-3c8c-4014-9f1e-ca21f1bfb8ca admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:50.188661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c9896a7e-3c8c-4014-9f1e-ca21f1bfb8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:50.240559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:50.244820 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9896a7e-3c8c-4014-9f1e-ca21f1bfb8ca admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:50.248634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d7e1d-9443-4844-9f44-f41dadc17f8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:50.249280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d7e1d-9443-4844-9f44-f41dadc17f8d service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:50.249567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d7e1d-9443-4844-9f44-f41dadc17f8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:50.249848 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d7e1d-9443-4844-9f44-f41dadc17f8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:50.258193 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d7e1d-9443-4844-9f44-f41dadc17f8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:50.259622 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d7e1d-9443-4844-9f44-f41dadc17f8d service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:50.268453 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1243/2478] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:01:53.507454 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d8408-f310-41f6-82b5-9e404f162b05 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:53.508929 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6c2d8408-f310-41f6-82b5-9e404f162b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:53.583107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d8408-f310-41f6-82b5-9e404f162b05 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:53.591252 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae9622-7fdc-4362-b581-7801fe8963d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:53.591252 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae9622-7fdc-4362-b581-7801fe8963d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:53.591252 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae9622-7fdc-4362-b581-7801fe8963d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:53.592081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae9622-7fdc-4362-b581-7801fe8963d3 admin admin] PATH_INFO: `/v3/users/1fe59d1f996e4abdb8a90b7444133e1c` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:53.593723 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae9622-7fdc-4362-b581-7801fe8963d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fe59d1f996e4abdb8a90b7444133e1c)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:53.595703 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae9622-7fdc-4362-b581-7801fe8963d3 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:53.781002 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:53.789592 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-daae9622-7fdc-4362-b581-7801fe8963d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fe59d1f996e4abdb8a90b7444133e1c'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:53.790255 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-daae9622-7fdc-4362-b581-7801fe8963d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fe59d1f996e4abdb8a90b7444133e1c'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:53.854918 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-daae9622-7fdc-4362-b581-7801fe8963d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fe59d1f996e4abdb8a90b7444133e1c'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:53.855540 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-daae9622-7fdc-4362-b581-7801fe8963d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fe59d1f996e4abdb8a90b7444133e1c'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:53.868533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-daae9622-7fdc-4362-b581-7801fe8963d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fe59d1f996e4abdb8a90b7444133e1c'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:53.882049 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1236/2479] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:01:53 2022] DELETE /identity/v3/users/1fe59d1f996e4abdb8a90b7444133e1c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:54.115332 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d7e1d-9443-4844-9f44-f41dadc17f8d service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:54.126954 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d7e1d-9443-4844-9f44-f41dadc17f8d service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:54.182932 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ff203-7cff-4ad8-80c4-9d2ff1371559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:54.183786 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ff203-7cff-4ad8-80c4-9d2ff1371559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:54.184069 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ff203-7cff-4ad8-80c4-9d2ff1371559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:54.184380 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ff203-7cff-4ad8-80c4-9d2ff1371559 admin admin] PATH_INFO: `/v3/projects/e491322c9bb146359268dcd649f24662` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:54.185549 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ff203-7cff-4ad8-80c4-9d2ff1371559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e491322c9bb146359268dcd649f24662)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:54.187458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ff203-7cff-4ad8-80c4-9d2ff1371559 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:54.296545 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ad1ff203-7cff-4ad8-80c4-9d2ff1371559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e491322c9bb146359268dcd649f24662', 'request_id': 'req-ad1ff203-7cff-4ad8-80c4-9d2ff1371559'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:54.375498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ad1ff203-7cff-4ad8-80c4-9d2ff1371559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e491322c9bb146359268dcd649f24662', 'request_id': 'req-ad1ff203-7cff-4ad8-80c4-9d2ff1371559'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:54.383434 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ad1ff203-7cff-4ad8-80c4-9d2ff1371559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e491322c9bb146359268dcd649f24662', 'request_id': 'req-ad1ff203-7cff-4ad8-80c4-9d2ff1371559'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:54.395975 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ad1ff203-7cff-4ad8-80c4-9d2ff1371559 admin admin] The token cache is being invalidate because project e491322c9bb146359268dcd649f24662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:01:54.396318 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ad1ff203-7cff-4ad8-80c4-9d2ff1371559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:54.397003 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-ad1ff203-7cff-4ad8-80c4-9d2ff1371559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:01:54.398808 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1244/2480] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:01:54 2022] DELETE /identity/v3/projects/e491322c9bb146359268dcd649f24662 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:54.405248 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086aef7a-3ad6-410d-86bc-56ba751b833a None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:54.405717 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086aef7a-3ad6-410d-86bc-56ba751b833a None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:54.407715 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086aef7a-3ad6-410d-86bc-56ba751b833a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:54.436410 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-086aef7a-3ad6-410d-86bc-56ba751b833a None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:54.437700 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-086aef7a-3ad6-410d-86bc-56ba751b833a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:54.497243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1237/2481] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:54.505588 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee1571-a5ac-4891-b964-496414c9fa21 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:54.505881 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee1571-a5ac-4891-b964-496414c9fa21 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:54.506169 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee1571-a5ac-4891-b964-496414c9fa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:54.524134 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-8cee1571-a5ac-4891-b964-496414c9fa21 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:54.525400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-8cee1571-a5ac-4891-b964-496414c9fa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:54.534119 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1245/2482] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:54.538166 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086aef7a-3ad6-410d-86bc-56ba751b833a None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:54.547827 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086aef7a-3ad6-410d-86bc-56ba751b833a None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:54.553044 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef17f8-6475-4560-9e99-123d6386f606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:54.553693 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef17f8-6475-4560-9e99-123d6386f606 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:54.553983 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef17f8-6475-4560-9e99-123d6386f606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:54.554267 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef17f8-6475-4560-9e99-123d6386f606 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:54.554998 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef17f8-6475-4560-9e99-123d6386f606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:01:54.555308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef17f8-6475-4560-9e99-123d6386f606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:54.556945 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef17f8-6475-4560-9e99-123d6386f606 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:54.571718 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1238/2483] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:01:54.573560 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee1571-a5ac-4891-b964-496414c9fa21 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:54.582225 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee1571-a5ac-4891-b964-496414c9fa21 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:54.586878 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb2456-065b-4b5f-9297-156d0c547e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:54.587518 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb2456-065b-4b5f-9297-156d0c547e11 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:54.587806 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb2456-065b-4b5f-9297-156d0c547e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:54.588085 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb2456-065b-4b5f-9297-156d0c547e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:54.588811 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb2456-065b-4b5f-9297-156d0c547e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:54.590715 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb2456-065b-4b5f-9297-156d0c547e11 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:54.695183 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1246/2484] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:01:54 2022] POST /identity/v3/projects => generated 391 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:01:54.699593 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef17f8-6475-4560-9e99-123d6386f606 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:54.711483 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef17f8-6475-4560-9e99-123d6386f606 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:54.766893 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370c95d-34f0-4cf4-adba-75c2ac98eb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:54.768438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370c95d-34f0-4cf4-adba-75c2ac98eb6c admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:54.768723 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370c95d-34f0-4cf4-adba-75c2ac98eb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:54.768995 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370c95d-34f0-4cf4-adba-75c2ac98eb6c admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:54.769681 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370c95d-34f0-4cf4-adba-75c2ac98eb6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:54.771561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370c95d-34f0-4cf4-adba-75c2ac98eb6c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:54.887486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1239/2485] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:01:54 2022] POST /identity/v3/users => generated 296 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:01:54.891604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb2456-065b-4b5f-9297-156d0c547e11 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:54.902514 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb2456-065b-4b5f-9297-156d0c547e11 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:54.907604 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40f7da-c4c3-4213-9f7a-2fb06020f9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:54.908302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40f7da-c4c3-4213-9f7a-2fb06020f9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:54.908595 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40f7da-c4c3-4213-9f7a-2fb06020f9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:54.908880 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40f7da-c4c3-4213-9f7a-2fb06020f9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:54.909652 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40f7da-c4c3-4213-9f7a-2fb06020f9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:54.911362 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40f7da-c4c3-4213-9f7a-2fb06020f9a4 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:54.921854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1247/2486] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:01:54.926168 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370c95d-34f0-4cf4-adba-75c2ac98eb6c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:54.936011 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370c95d-34f0-4cf4-adba-75c2ac98eb6c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:54.941493 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46bc96-50ea-4094-bd8a-7cf4be56c7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:54.942151 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46bc96-50ea-4094-bd8a-7cf4be56c7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:54.942437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46bc96-50ea-4094-bd8a-7cf4be56c7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:54.942714 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46bc96-50ea-4094-bd8a-7cf4be56c7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:54.943448 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46bc96-50ea-4094-bd8a-7cf4be56c7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:54.945080 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46bc96-50ea-4094-bd8a-7cf4be56c7e2 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:54.955271 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1240/2487] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:01:54.958975 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40f7da-c4c3-4213-9f7a-2fb06020f9a4 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:54.968760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40f7da-c4c3-4213-9f7a-2fb06020f9a4 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:54.973536 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17a3cd-12c4-47a4-9f73-eb92dfc08881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:54.974406 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17a3cd-12c4-47a4-9f73-eb92dfc08881 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:54.974691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17a3cd-12c4-47a4-9f73-eb92dfc08881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:54.974969 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17a3cd-12c4-47a4-9f73-eb92dfc08881 admin admin] PATH_INFO: `/v3/projects/1e2b4c3e355744ccbe47bcb7e0136090/users/133fb4d826054ad7baf40ef526b2e720/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:54.990806 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17a3cd-12c4-47a4-9f73-eb92dfc08881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2b4c3e355744ccbe47bcb7e0136090, user_id=133fb4d826054ad7baf40ef526b2e720, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:54.993500 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17a3cd-12c4-47a4-9f73-eb92dfc08881 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:55.075779 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1248/2488] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:01:54 2022] PUT /identity/v3/projects/1e2b4c3e355744ccbe47bcb7e0136090/users/133fb4d826054ad7baf40ef526b2e720/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:01:55.086490 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f06f7-1264-4965-9bcd-3851f1db55a7 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:55.086782 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f06f7-1264-4965-9bcd-3851f1db55a7 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:55.087071 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f06f7-1264-4965-9bcd-3851f1db55a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:55.113581 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-667f06f7-1264-4965-9bcd-3851f1db55a7 None None] MFA Rules not processed for user `133fb4d826054ad7baf40ef526b2e720`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:01:55.114798 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-667f06f7-1264-4965-9bcd-3851f1db55a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:55.122775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:55.179749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1241/2489] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:01:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:01:55.190528 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17a3cd-12c4-47a4-9f73-eb92dfc08881 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:01:55.192337 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-8d17a3cd-12c4-47a4-9f73-eb92dfc08881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:01:55.214333 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:01:55.251776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17a3cd-12c4-47a4-9f73-eb92dfc08881 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:01:55.255413 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025c478-5f82-4b39-8a12-57a97cb44746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:01:55.256052 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025c478-5f82-4b39-8a12-57a97cb44746 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:01:55.256367 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025c478-5f82-4b39-8a12-57a97cb44746 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:01:55.256643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025c478-5f82-4b39-8a12-57a97cb44746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:01:55.264796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025c478-5f82-4b39-8a12-57a97cb44746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:01:55.266223 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025c478-5f82-4b39-8a12-57a97cb44746 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:01:55.275849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1249/2490] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:01:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:02:02.179118 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f06f7-1264-4965-9bcd-3851f1db55a7 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:02.181071 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-667f06f7-1264-4965-9bcd-3851f1db55a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:02.272185 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f06f7-1264-4965-9bcd-3851f1db55a7 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:02.282092 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22577027-5fca-4d1e-a4cc-2f2610dc25eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79a71fa89446c3abbb4fdbf2c93aac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:02.282092 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22577027-5fca-4d1e-a4cc-2f2610dc25eb service placement] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:02.282092 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22577027-5fca-4d1e-a4cc-2f2610dc25eb service placement] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:02.282092 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22577027-5fca-4d1e-a4cc-2f2610dc25eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:02.282716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-22577027-5fca-4d1e-a4cc-2f2610dc25eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:02.292130 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22577027-5fca-4d1e-a4cc-2f2610dc25eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:02.293758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22577027-5fca-4d1e-a4cc-2f2610dc25eb service placement] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:02.303939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1242/2491] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:02:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:02:05.489786 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=18 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:11.724881 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025c478-5f82-4b39-8a12-57a97cb44746 service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:11.726443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-4025c478-5f82-4b39-8a12-57a97cb44746 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:11.790996 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025c478-5f82-4b39-8a12-57a97cb44746 service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:11.796272 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881dab4-6cc3-44cc-bf32-72caa3653863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:11.797294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881dab4-6cc3-44cc-bf32-72caa3653863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:11.797577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881dab4-6cc3-44cc-bf32-72caa3653863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:11.797856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881dab4-6cc3-44cc-bf32-72caa3653863 admin admin] PATH_INFO: `/v3/users/7ede9128d6354158b27db10da90b18fc` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:11.799059 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881dab4-6cc3-44cc-bf32-72caa3653863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ede9128d6354158b27db10da90b18fc)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:11.801109 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881dab4-6cc3-44cc-bf32-72caa3653863 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:11.972432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-9881dab4-6cc3-44cc-bf32-72caa3653863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ede9128d6354158b27db10da90b18fc'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:11.979311 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-9881dab4-6cc3-44cc-bf32-72caa3653863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ede9128d6354158b27db10da90b18fc'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:11.980005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-9881dab4-6cc3-44cc-bf32-72caa3653863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ede9128d6354158b27db10da90b18fc'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:11.991485 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-9881dab4-6cc3-44cc-bf32-72caa3653863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ede9128d6354158b27db10da90b18fc'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:11.992165 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-9881dab4-6cc3-44cc-bf32-72caa3653863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ede9128d6354158b27db10da90b18fc'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:12.067754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1250/2492] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:02:11 2022] DELETE /identity/v3/users/7ede9128d6354158b27db10da90b18fc => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:02:12.074973 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741508da-a07d-40bb-b10b-dd145f16d0b2 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:12.075426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741508da-a07d-40bb-b10b-dd145f16d0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:12.075561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741508da-a07d-40bb-b10b-dd145f16d0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:12.093575 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-741508da-a07d-40bb-b10b-dd145f16d0b2 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:12.094769 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-741508da-a07d-40bb-b10b-dd145f16d0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:12.153419 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1243/2493] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:02:12.163636 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881dab4-6cc3-44cc-bf32-72caa3653863 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:12.165177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-9881dab4-6cc3-44cc-bf32-72caa3653863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:12.220195 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881dab4-6cc3-44cc-bf32-72caa3653863 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:12.223883 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdc746-d86d-4750-ae74-5f5dd8b6ea1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:12.224461 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdc746-d86d-4750-ae74-5f5dd8b6ea1a service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:12.224744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdc746-d86d-4750-ae74-5f5dd8b6ea1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:12.225019 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdc746-d86d-4750-ae74-5f5dd8b6ea1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:12.234329 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdc746-d86d-4750-ae74-5f5dd8b6ea1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:12.236506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdc746-d86d-4750-ae74-5f5dd8b6ea1a service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:12.251080 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1251/2494] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:02:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:02:12.677915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741508da-a07d-40bb-b10b-dd145f16d0b2 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:12.679814 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-741508da-a07d-40bb-b10b-dd145f16d0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:12.692514 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741508da-a07d-40bb-b10b-dd145f16d0b2 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:12.697948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcba2b-e5fb-4f59-8ece-8650ee9e44db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:12.698821 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcba2b-e5fb-4f59-8ece-8650ee9e44db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:12.699101 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcba2b-e5fb-4f59-8ece-8650ee9e44db admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:12.699380 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcba2b-e5fb-4f59-8ece-8650ee9e44db admin admin] PATH_INFO: `/v3/projects/5fc0e908707c437fb0169bee580c7168` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:12.700738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcba2b-e5fb-4f59-8ece-8650ee9e44db admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc0e908707c437fb0169bee580c7168)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:12.702657 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcba2b-e5fb-4f59-8ece-8650ee9e44db admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:12.720778 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:12.829956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-25dcba2b-e5fb-4f59-8ece-8650ee9e44db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc0e908707c437fb0169bee580c7168', 'request_id': 'req-25dcba2b-e5fb-4f59-8ece-8650ee9e44db'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:12.900830 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-25dcba2b-e5fb-4f59-8ece-8650ee9e44db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc0e908707c437fb0169bee580c7168', 'request_id': 'req-25dcba2b-e5fb-4f59-8ece-8650ee9e44db'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:12.906962 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-25dcba2b-e5fb-4f59-8ece-8650ee9e44db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc0e908707c437fb0169bee580c7168', 'request_id': 'req-25dcba2b-e5fb-4f59-8ece-8650ee9e44db'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:12.918677 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-25dcba2b-e5fb-4f59-8ece-8650ee9e44db admin admin] The token cache is being invalidate because project 5fc0e908707c437fb0169bee580c7168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:02:12.918967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-25dcba2b-e5fb-4f59-8ece-8650ee9e44db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:12.919626 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-25dcba2b-e5fb-4f59-8ece-8650ee9e44db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:12.921238 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1244/2495] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:02:12 2022] DELETE /identity/v3/projects/5fc0e908707c437fb0169bee580c7168 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:02:12.926107 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b0c30-e522-479a-9d54-c538c7580a4c None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:12.926581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b0c30-e522-479a-9d54-c538c7580a4c None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:12.926673 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b0c30-e522-479a-9d54-c538c7580a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:12.946350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-de3b0c30-e522-479a-9d54-c538c7580a4c None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:12.947582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-de3b0c30-e522-479a-9d54-c538c7580a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:12.965195 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:13.006581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1252/2496] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:02:13.014551 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98b8f6-5101-4170-8d45-06b9bb360387 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:13.014841 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98b8f6-5101-4170-8d45-06b9bb360387 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:13.015121 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98b8f6-5101-4170-8d45-06b9bb360387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:13.036678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-2e98b8f6-5101-4170-8d45-06b9bb360387 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:13.037926 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-2e98b8f6-5101-4170-8d45-06b9bb360387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:13.046228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1245/2497] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:02:13.050473 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b0c30-e522-479a-9d54-c538c7580a4c None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:13.060098 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b0c30-e522-479a-9d54-c538c7580a4c None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:13.064643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129988b4-4443-4dc9-9337-11101507b6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:13.065280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129988b4-4443-4dc9-9337-11101507b6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:13.065566 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129988b4-4443-4dc9-9337-11101507b6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:13.068250 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129988b4-4443-4dc9-9337-11101507b6c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:13.068250 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129988b4-4443-4dc9-9337-11101507b6c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:02:13.068250 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129988b4-4443-4dc9-9337-11101507b6c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:13.068516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129988b4-4443-4dc9-9337-11101507b6c1 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:13.083929 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1253/2498] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 17:02:13.085121 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98b8f6-5101-4170-8d45-06b9bb360387 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:13.094773 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98b8f6-5101-4170-8d45-06b9bb360387 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:13.104785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68264e-6fc4-4a80-98f2-34cf3cfe91c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:13.104785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68264e-6fc4-4a80-98f2-34cf3cfe91c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:13.104785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68264e-6fc4-4a80-98f2-34cf3cfe91c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:13.104785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68264e-6fc4-4a80-98f2-34cf3cfe91c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:13.105271 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68264e-6fc4-4a80-98f2-34cf3cfe91c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:13.105271 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68264e-6fc4-4a80-98f2-34cf3cfe91c3 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:13.176723 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1246/2499] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:02:13 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:02:13.180882 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129988b4-4443-4dc9-9337-11101507b6c1 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:13.191145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129988b4-4443-4dc9-9337-11101507b6c1 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:13.252052 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990a353-381d-490d-be3d-fde6f6bf6c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:13.252746 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990a353-381d-490d-be3d-fde6f6bf6c23 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:13.253038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990a353-381d-490d-be3d-fde6f6bf6c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:13.253319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990a353-381d-490d-be3d-fde6f6bf6c23 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:13.254021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990a353-381d-490d-be3d-fde6f6bf6c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:13.256492 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990a353-381d-490d-be3d-fde6f6bf6c23 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:13.353125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1254/2500] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:02:13 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:02:13.356915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68264e-6fc4-4a80-98f2-34cf3cfe91c3 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:13.367883 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68264e-6fc4-4a80-98f2-34cf3cfe91c3 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:13.372675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4f504-3e76-4961-bdc0-498b7d04041c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:13.373341 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4f504-3e76-4961-bdc0-498b7d04041c admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:13.373628 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4f504-3e76-4961-bdc0-498b7d04041c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:13.373907 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c4f504-3e76-4961-bdc0-498b7d04041c admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:13.376309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4f504-3e76-4961-bdc0-498b7d04041c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:13.376309 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c4f504-3e76-4961-bdc0-498b7d04041c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:13.387251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1247/2501] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:02:13.391229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990a353-381d-490d-be3d-fde6f6bf6c23 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:13.402515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990a353-381d-490d-be3d-fde6f6bf6c23 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:13.408042 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab50c86-2975-44ce-a31e-853f7b6989d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:13.408759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab50c86-2975-44ce-a31e-853f7b6989d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:13.409049 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab50c86-2975-44ce-a31e-853f7b6989d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:13.409331 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab50c86-2975-44ce-a31e-853f7b6989d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:13.410081 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab50c86-2975-44ce-a31e-853f7b6989d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:13.411766 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab50c86-2975-44ce-a31e-853f7b6989d0 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:13.422470 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1255/2502] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:02:13.426438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4f504-3e76-4961-bdc0-498b7d04041c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:13.436570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c4f504-3e76-4961-bdc0-498b7d04041c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:13.441238 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a08005-e645-4adf-97f3-e056b891fc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:13.442637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a08005-e645-4adf-97f3-e056b891fc17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:13.442915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a08005-e645-4adf-97f3-e056b891fc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:13.443344 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a08005-e645-4adf-97f3-e056b891fc17 admin admin] PATH_INFO: `/v3/projects/1e0a028c415649f28c1b38b18f666045/users/0db26ed3988944999549075b32f26d7b/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:13.458406 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a08005-e645-4adf-97f3-e056b891fc17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e0a028c415649f28c1b38b18f666045, user_id=0db26ed3988944999549075b32f26d7b, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:13.461095 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a08005-e645-4adf-97f3-e056b891fc17 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:13.568036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1248/2503] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:02:13 2022] PUT /identity/v3/projects/1e0a028c415649f28c1b38b18f666045/users/0db26ed3988944999549075b32f26d7b/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:02:13.578795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcba4f-dfce-48c8-a5cd-33eed2822e91 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:13.579087 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcba4f-dfce-48c8-a5cd-33eed2822e91 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:13.579368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcba4f-dfce-48c8-a5cd-33eed2822e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:13.611734 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-e5dcba4f-dfce-48c8-a5cd-33eed2822e91 None None] MFA Rules not processed for user `0db26ed3988944999549075b32f26d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:13.613002 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e5dcba4f-dfce-48c8-a5cd-33eed2822e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:13.678100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1256/2504] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:02:13.688596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a08005-e645-4adf-97f3-e056b891fc17 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:13.690277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-a2a08005-e645-4adf-97f3-e056b891fc17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:13.749815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a08005-e645-4adf-97f3-e056b891fc17 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:13.753574 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810461b1-5953-4662-affc-748a4b3ab168 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:13.754810 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810461b1-5953-4662-affc-748a4b3ab168 service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:13.755093 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810461b1-5953-4662-affc-748a4b3ab168 service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:13.755372 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810461b1-5953-4662-affc-748a4b3ab168 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:13.763475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810461b1-5953-4662-affc-748a4b3ab168 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:13.765064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810461b1-5953-4662-affc-748a4b3ab168 service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:13.773818 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1249/2505] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:02:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:02:23.674733 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:23.769710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:37.060909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcba4f-dfce-48c8-a5cd-33eed2822e91 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:37.069924 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e5dcba4f-dfce-48c8-a5cd-33eed2822e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:37.127174 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcba4f-dfce-48c8-a5cd-33eed2822e91 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:37.131698 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9be5b-addc-4575-ae4d-29ad4e2426a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:37.132609 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9be5b-addc-4575-ae4d-29ad4e2426a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:37.132898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9be5b-addc-4575-ae4d-29ad4e2426a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:37.133159 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9be5b-addc-4575-ae4d-29ad4e2426a0 admin admin] PATH_INFO: `/v3/users/133fb4d826054ad7baf40ef526b2e720` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:37.134447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9be5b-addc-4575-ae4d-29ad4e2426a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=133fb4d826054ad7baf40ef526b2e720)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:37.136403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9be5b-addc-4575-ae4d-29ad4e2426a0 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:37.340634 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-1db9be5b-addc-4575-ae4d-29ad4e2426a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '133fb4d826054ad7baf40ef526b2e720'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:37.347904 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-1db9be5b-addc-4575-ae4d-29ad4e2426a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '133fb4d826054ad7baf40ef526b2e720'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:37.348586 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-1db9be5b-addc-4575-ae4d-29ad4e2426a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '133fb4d826054ad7baf40ef526b2e720'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:37.361068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-1db9be5b-addc-4575-ae4d-29ad4e2426a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '133fb4d826054ad7baf40ef526b2e720'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:37.361713 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-1db9be5b-addc-4575-ae4d-29ad4e2426a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '133fb4d826054ad7baf40ef526b2e720'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:37.441623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1257/2506] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:02:37 2022] DELETE /identity/v3/users/133fb4d826054ad7baf40ef526b2e720 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:02:37.446176 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07b5b3-bd43-4ce9-b187-12aadefd67ec None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:37.446734 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07b5b3-bd43-4ce9-b187-12aadefd67ec None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:37.446870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07b5b3-bd43-4ce9-b187-12aadefd67ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:37.464417 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-6b07b5b3-bd43-4ce9-b187-12aadefd67ec None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:37.465632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6b07b5b3-bd43-4ce9-b187-12aadefd67ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:37.523695 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1250/2507] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:02:37.534181 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9be5b-addc-4575-ae4d-29ad4e2426a0 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:37.535600 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-1db9be5b-addc-4575-ae4d-29ad4e2426a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:37.592471 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9be5b-addc-4575-ae4d-29ad4e2426a0 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:37.598094 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542aa463-c10a-479c-b7dc-772671cc41d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:37.598739 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542aa463-c10a-479c-b7dc-772671cc41d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:37.599020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542aa463-c10a-479c-b7dc-772671cc41d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:37.599296 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542aa463-c10a-479c-b7dc-772671cc41d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:37.608600 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542aa463-c10a-479c-b7dc-772671cc41d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:37.610037 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542aa463-c10a-479c-b7dc-772671cc41d4 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:37.619394 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1258/2508] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:02:38.022704 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07b5b3-bd43-4ce9-b187-12aadefd67ec None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:38.024320 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6b07b5b3-bd43-4ce9-b187-12aadefd67ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:38.044370 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07b5b3-bd43-4ce9-b187-12aadefd67ec None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:38.058137 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b819f9-24a9-48f6-a6f6-8d1c323b214f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:38.059031 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b819f9-24a9-48f6-a6f6-8d1c323b214f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:38.059321 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b819f9-24a9-48f6-a6f6-8d1c323b214f admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:38.059599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b819f9-24a9-48f6-a6f6-8d1c323b214f admin admin] PATH_INFO: `/v3/projects/1e2b4c3e355744ccbe47bcb7e0136090` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:38.061867 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b819f9-24a9-48f6-a6f6-8d1c323b214f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2b4c3e355744ccbe47bcb7e0136090)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:38.063812 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b819f9-24a9-48f6-a6f6-8d1c323b214f admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:38.175016 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f5b819f9-24a9-48f6-a6f6-8d1c323b214f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2b4c3e355744ccbe47bcb7e0136090', 'request_id': 'req-f5b819f9-24a9-48f6-a6f6-8d1c323b214f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:38.249583 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f5b819f9-24a9-48f6-a6f6-8d1c323b214f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2b4c3e355744ccbe47bcb7e0136090', 'request_id': 'req-f5b819f9-24a9-48f6-a6f6-8d1c323b214f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:38.255603 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f5b819f9-24a9-48f6-a6f6-8d1c323b214f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2b4c3e355744ccbe47bcb7e0136090', 'request_id': 'req-f5b819f9-24a9-48f6-a6f6-8d1c323b214f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:38.267555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f5b819f9-24a9-48f6-a6f6-8d1c323b214f admin admin] The token cache is being invalidate because project 1e2b4c3e355744ccbe47bcb7e0136090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:02:38.267842 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f5b819f9-24a9-48f6-a6f6-8d1c323b214f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:38.268500 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f5b819f9-24a9-48f6-a6f6-8d1c323b214f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:38.270045 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1251/2509] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:02:38 2022] DELETE /identity/v3/projects/1e2b4c3e355744ccbe47bcb7e0136090 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:02:38.276318 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7861e-1c47-4caa-b6b0-7800eb8d553c None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:38.276788 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7861e-1c47-4caa-b6b0-7800eb8d553c None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:38.276871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7861e-1c47-4caa-b6b0-7800eb8d553c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:38.295424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-4dd7861e-1c47-4caa-b6b0-7800eb8d553c None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:38.296663 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-4dd7861e-1c47-4caa-b6b0-7800eb8d553c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:38.316545 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:38.362578 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1259/2510] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:02:38.370166 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197656c-6191-40c8-887a-1a8cd1ed47d1 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:38.370461 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197656c-6191-40c8-887a-1a8cd1ed47d1 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:38.370749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197656c-6191-40c8-887a-1a8cd1ed47d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:38.389528 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-4197656c-6191-40c8-887a-1a8cd1ed47d1 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:38.390712 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-4197656c-6191-40c8-887a-1a8cd1ed47d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:38.398924 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1252/2511] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:02:38.402989 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7861e-1c47-4caa-b6b0-7800eb8d553c None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:38.412774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7861e-1c47-4caa-b6b0-7800eb8d553c None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:38.417226 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4342f-f5cf-45ea-8407-64feb9a3a606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:38.417930 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4342f-f5cf-45ea-8407-64feb9a3a606 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:38.418211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4342f-f5cf-45ea-8407-64feb9a3a606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:38.418512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4342f-f5cf-45ea-8407-64feb9a3a606 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:38.419737 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4342f-f5cf-45ea-8407-64feb9a3a606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:02:38.420046 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4342f-f5cf-45ea-8407-64feb9a3a606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:38.421663 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4342f-f5cf-45ea-8407-64feb9a3a606 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:38.435844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1260/2512] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:02:38.441253 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197656c-6191-40c8-887a-1a8cd1ed47d1 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:38.451177 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197656c-6191-40c8-887a-1a8cd1ed47d1 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:38.455991 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f734a-dca6-4872-9599-60e4c70bbf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:38.456675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f734a-dca6-4872-9599-60e4c70bbf1b admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:38.456955 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f734a-dca6-4872-9599-60e4c70bbf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:38.457233 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f734a-dca6-4872-9599-60e4c70bbf1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:38.457921 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f734a-dca6-4872-9599-60e4c70bbf1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:38.459885 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f734a-dca6-4872-9599-60e4c70bbf1b admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:38.549199 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1253/2513] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:02:38 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:02:38.553099 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4342f-f5cf-45ea-8407-64feb9a3a606 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:38.565358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4342f-f5cf-45ea-8407-64feb9a3a606 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:38.623294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5717a1-3538-4ae3-ac11-77f6a3d569cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:38.623990 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5717a1-3538-4ae3-ac11-77f6a3d569cd admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:38.624368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5717a1-3538-4ae3-ac11-77f6a3d569cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:38.624668 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5717a1-3538-4ae3-ac11-77f6a3d569cd admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:38.625458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5717a1-3538-4ae3-ac11-77f6a3d569cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:38.627375 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5717a1-3538-4ae3-ac11-77f6a3d569cd admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:38.731096 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1261/2514] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:02:38 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:02:38.736749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f734a-dca6-4872-9599-60e4c70bbf1b admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:38.753348 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f734a-dca6-4872-9599-60e4c70bbf1b admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:38.753348 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a16a4b-2f5d-4fdf-8c18-2e323bb064a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:38.753348 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a16a4b-2f5d-4fdf-8c18-2e323bb064a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:38.753348 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a16a4b-2f5d-4fdf-8c18-2e323bb064a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:38.753728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a16a4b-2f5d-4fdf-8c18-2e323bb064a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:38.754062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a16a4b-2f5d-4fdf-8c18-2e323bb064a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:38.755674 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a16a4b-2f5d-4fdf-8c18-2e323bb064a3 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:38.767882 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1254/2515] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:02:38.771691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5717a1-3538-4ae3-ac11-77f6a3d569cd admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:38.782349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5717a1-3538-4ae3-ac11-77f6a3d569cd admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:38.787250 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921508a0-12d5-4e8f-b0d6-8d12b976961f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:38.787898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921508a0-12d5-4e8f-b0d6-8d12b976961f admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:38.788227 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921508a0-12d5-4e8f-b0d6-8d12b976961f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:38.788506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921508a0-12d5-4e8f-b0d6-8d12b976961f admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:38.789243 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921508a0-12d5-4e8f-b0d6-8d12b976961f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:38.790868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921508a0-12d5-4e8f-b0d6-8d12b976961f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:38.800689 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1262/2516] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:02:38.804779 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a16a4b-2f5d-4fdf-8c18-2e323bb064a3 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:38.815356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a16a4b-2f5d-4fdf-8c18-2e323bb064a3 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:38.819973 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9f566-10a7-47bb-a946-156dc05228cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:38.820876 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9f566-10a7-47bb-a946-156dc05228cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:38.821189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9f566-10a7-47bb-a946-156dc05228cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:38.821449 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9f566-10a7-47bb-a946-156dc05228cd admin admin] PATH_INFO: `/v3/projects/053f13e36c374b3ca47073594406fe26/users/4bd8f30d0f834973a0e9f5d8dfc1a9ee/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:38.837090 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9f566-10a7-47bb-a946-156dc05228cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=053f13e36c374b3ca47073594406fe26, user_id=4bd8f30d0f834973a0e9f5d8dfc1a9ee, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:38.839722 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9f566-10a7-47bb-a946-156dc05228cd admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:38.929163 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1255/2517] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:02:38 2022] PUT /identity/v3/projects/053f13e36c374b3ca47073594406fe26/users/4bd8f30d0f834973a0e9f5d8dfc1a9ee/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:02:38.939233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c571eb-2550-467f-b46c-6e9a77987215 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:38.939526 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c571eb-2550-467f-b46c-6e9a77987215 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:38.939809 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c571eb-2550-467f-b46c-6e9a77987215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:38.963026 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-12c571eb-2550-467f-b46c-6e9a77987215 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:38.963026 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-12c571eb-2550-467f-b46c-6e9a77987215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:39.018305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1263/2518] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:02:39.028093 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9f566-10a7-47bb-a946-156dc05228cd admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:39.029937 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-90a9f566-10a7-47bb-a946-156dc05228cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:39.052262 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:39.087520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9f566-10a7-47bb-a946-156dc05228cd admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:39.091432 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a94f87-4714-4e27-b0b6-24a653a00484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:39.092078 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a94f87-4714-4e27-b0b6-24a653a00484 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:39.092401 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a94f87-4714-4e27-b0b6-24a653a00484 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:39.092679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a94f87-4714-4e27-b0b6-24a653a00484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:39.102282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a94f87-4714-4e27-b0b6-24a653a00484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:39.104529 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a94f87-4714-4e27-b0b6-24a653a00484 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:39.114439 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1256/2519] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:02:39.887540 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c571eb-2550-467f-b46c-6e9a77987215 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:39.892644 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-12c571eb-2550-467f-b46c-6e9a77987215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:39.901795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c571eb-2550-467f-b46c-6e9a77987215 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:39.907415 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5efbf-586f-4c1d-9323-25e2ebe7df1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:39.908306 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5efbf-586f-4c1d-9323-25e2ebe7df1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:39.908594 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5efbf-586f-4c1d-9323-25e2ebe7df1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:39.908876 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5efbf-586f-4c1d-9323-25e2ebe7df1e admin admin] PATH_INFO: `/v3/users/a4f0ddc582954f3eb06412b74ede9c0e` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:39.910080 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5efbf-586f-4c1d-9323-25e2ebe7df1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4f0ddc582954f3eb06412b74ede9c0e)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:39.912062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5efbf-586f-4c1d-9323-25e2ebe7df1e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:39.941956 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:40.149463 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-8ba5efbf-586f-4c1d-9323-25e2ebe7df1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4f0ddc582954f3eb06412b74ede9c0e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:40.157555 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-8ba5efbf-586f-4c1d-9323-25e2ebe7df1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4f0ddc582954f3eb06412b74ede9c0e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:40.158308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-8ba5efbf-586f-4c1d-9323-25e2ebe7df1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4f0ddc582954f3eb06412b74ede9c0e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:40.171734 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-8ba5efbf-586f-4c1d-9323-25e2ebe7df1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4f0ddc582954f3eb06412b74ede9c0e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:40.172459 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-8ba5efbf-586f-4c1d-9323-25e2ebe7df1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4f0ddc582954f3eb06412b74ede9c0e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:40.267201 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1264/2520] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:02:39 2022] DELETE /identity/v3/users/a4f0ddc582954f3eb06412b74ede9c0e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:02:40.271618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c0ef5-0d32-40d5-8596-760c9812cdc7 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:40.272066 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c0ef5-0d32-40d5-8596-760c9812cdc7 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:40.272211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c0ef5-0d32-40d5-8596-760c9812cdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:40.289253 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-119c0ef5-0d32-40d5-8596-760c9812cdc7 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:40.290459 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-119c0ef5-0d32-40d5-8596-760c9812cdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:40.357062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1257/2521] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:02:40.367379 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5efbf-586f-4c1d-9323-25e2ebe7df1e admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:40.374484 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-8ba5efbf-586f-4c1d-9323-25e2ebe7df1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:40.426143 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5efbf-586f-4c1d-9323-25e2ebe7df1e admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:40.429689 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ec66e-92ac-49bf-a9c3-7792b1224e3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:40.430329 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ec66e-92ac-49bf-a9c3-7792b1224e3f service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:40.430610 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ec66e-92ac-49bf-a9c3-7792b1224e3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:40.430888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ec66e-92ac-49bf-a9c3-7792b1224e3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:40.440153 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ec66e-92ac-49bf-a9c3-7792b1224e3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:40.441590 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ec66e-92ac-49bf-a9c3-7792b1224e3f service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:40.451510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1265/2522] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:02:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:02:40.677650 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c0ef5-0d32-40d5-8596-760c9812cdc7 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:40.679226 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-119c0ef5-0d32-40d5-8596-760c9812cdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:40.694034 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c0ef5-0d32-40d5-8596-760c9812cdc7 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:40.699079 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67002ec-b7f3-415c-b0f1-02dc5260c7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:40.700054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67002ec-b7f3-415c-b0f1-02dc5260c7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:40.701223 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67002ec-b7f3-415c-b0f1-02dc5260c7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:40.701223 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67002ec-b7f3-415c-b0f1-02dc5260c7f3 admin admin] PATH_INFO: `/v3/users/0db26ed3988944999549075b32f26d7b` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:40.702287 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67002ec-b7f3-415c-b0f1-02dc5260c7f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0db26ed3988944999549075b32f26d7b)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:40.704705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67002ec-b7f3-415c-b0f1-02dc5260c7f3 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:40.933986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e67002ec-b7f3-415c-b0f1-02dc5260c7f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0db26ed3988944999549075b32f26d7b'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:40.934683 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e67002ec-b7f3-415c-b0f1-02dc5260c7f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0db26ed3988944999549075b32f26d7b'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:40.999311 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ec66e-92ac-49bf-a9c3-7792b1224e3f service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:41.000887 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-113ec66e-92ac-49bf-a9c3-7792b1224e3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:41.019354 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ec66e-92ac-49bf-a9c3-7792b1224e3f service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:41.024294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16467696-02f4-4b38-a62e-b48be62d4d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:41.025154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16467696-02f4-4b38-a62e-b48be62d4d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:41.025439 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16467696-02f4-4b38-a62e-b48be62d4d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:41.025746 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16467696-02f4-4b38-a62e-b48be62d4d4a admin admin] PATH_INFO: `/v3/projects/a03aa60c8653493b9467423c2c9a42c0` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:41.026955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16467696-02f4-4b38-a62e-b48be62d4d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a03aa60c8653493b9467423c2c9a42c0)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:41.029741 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16467696-02f4-4b38-a62e-b48be62d4d4a admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:41.048017 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e67002ec-b7f3-415c-b0f1-02dc5260c7f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0db26ed3988944999549075b32f26d7b'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:41.053605 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e67002ec-b7f3-415c-b0f1-02dc5260c7f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0db26ed3988944999549075b32f26d7b'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:41.063446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e67002ec-b7f3-415c-b0f1-02dc5260c7f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0db26ed3988944999549075b32f26d7b'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:41.075361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1258/2523] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:02:40 2022] DELETE /identity/v3/users/0db26ed3988944999549075b32f26d7b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:02:41.082128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfa3e1-984d-440d-aa79-12d7e08370b7 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:41.082128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfa3e1-984d-440d-aa79-12d7e08370b7 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:41.082128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfa3e1-984d-440d-aa79-12d7e08370b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:41.096852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-2bbfa3e1-984d-440d-aa79-12d7e08370b7 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:41.098080 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-2bbfa3e1-984d-440d-aa79-12d7e08370b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:41.131325 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:41.173426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1259/2524] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:02:41.181062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfa3e1-984d-440d-aa79-12d7e08370b7 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:41.183550 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-2bbfa3e1-984d-440d-aa79-12d7e08370b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:41.196351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-16467696-02f4-4b38-a62e-b48be62d4d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a03aa60c8653493b9467423c2c9a42c0', 'request_id': 'req-16467696-02f4-4b38-a62e-b48be62d4d4a'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:41.266700 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-16467696-02f4-4b38-a62e-b48be62d4d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a03aa60c8653493b9467423c2c9a42c0', 'request_id': 'req-16467696-02f4-4b38-a62e-b48be62d4d4a'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:41.281363 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-16467696-02f4-4b38-a62e-b48be62d4d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a03aa60c8653493b9467423c2c9a42c0', 'request_id': 'req-16467696-02f4-4b38-a62e-b48be62d4d4a'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:41.289126 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfa3e1-984d-440d-aa79-12d7e08370b7 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:41.295532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-16467696-02f4-4b38-a62e-b48be62d4d4a admin admin] The token cache is being invalidate because project a03aa60c8653493b9467423c2c9a42c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:02:41.300209 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-16467696-02f4-4b38-a62e-b48be62d4d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:41.300209 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-16467696-02f4-4b38-a62e-b48be62d4d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:41.300209 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1266/2525] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:02:40 2022] DELETE /identity/v3/projects/a03aa60c8653493b9467423c2c9a42c0 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:02:41.304036 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22132a9a-cc7a-4956-a7d1-4668521df9dc None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:41.304440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22132a9a-cc7a-4956-a7d1-4668521df9dc None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:41.304854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22132a9a-cc7a-4956-a7d1-4668521df9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:41.333043 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-22132a9a-cc7a-4956-a7d1-4668521df9dc None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:41.334416 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-22132a9a-cc7a-4956-a7d1-4668521df9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:41.363474 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:41.365618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530f0bb-a082-49e1-91a2-23abfb182e3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:41.366311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530f0bb-a082-49e1-91a2-23abfb182e3f service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:41.366564 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530f0bb-a082-49e1-91a2-23abfb182e3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:41.366841 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530f0bb-a082-49e1-91a2-23abfb182e3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:41.368712 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-8530f0bb-a082-49e1-91a2-23abfb182e3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:41.411859 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1267/2526] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:02:41.420818 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23968f1a-0bb5-4e9e-872a-e30448786166 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:41.421114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23968f1a-0bb5-4e9e-872a-e30448786166 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:41.421396 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23968f1a-0bb5-4e9e-872a-e30448786166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:41.440800 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-23968f1a-0bb5-4e9e-872a-e30448786166 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:41.442152 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-23968f1a-0bb5-4e9e-872a-e30448786166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:41.445888 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530f0bb-a082-49e1-91a2-23abfb182e3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:41.447575 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530f0bb-a082-49e1-91a2-23abfb182e3f service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:41.455834 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1268/2527] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:02:41.456913 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23968f1a-0bb5-4e9e-872a-e30448786166 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:41.462219 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1260/2528] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:02:41.466646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23968f1a-0bb5-4e9e-872a-e30448786166 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:41.472171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92028c33-eb05-4805-aed5-d5112b501774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:41.472978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92028c33-eb05-4805-aed5-d5112b501774 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:41.473398 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92028c33-eb05-4805-aed5-d5112b501774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:41.473854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92028c33-eb05-4805-aed5-d5112b501774 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:41.474675 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92028c33-eb05-4805-aed5-d5112b501774 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:02:41.475077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92028c33-eb05-4805-aed5-d5112b501774 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:41.477207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92028c33-eb05-4805-aed5-d5112b501774 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:41.491379 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1269/2529] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 17:02:41.495486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530f0bb-a082-49e1-91a2-23abfb182e3f service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:41.514485 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530f0bb-a082-49e1-91a2-23abfb182e3f service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:41.527462 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bb483-c8bc-4b69-a04c-8c8004b85441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:41.528922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bb483-c8bc-4b69-a04c-8c8004b85441 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:41.529365 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bb483-c8bc-4b69-a04c-8c8004b85441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:41.529664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bb483-c8bc-4b69-a04c-8c8004b85441 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:41.531789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bb483-c8bc-4b69-a04c-8c8004b85441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:41.533945 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bb483-c8bc-4b69-a04c-8c8004b85441 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:41.672235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1261/2530] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:02:41 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:02:41.673924 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92028c33-eb05-4805-aed5-d5112b501774 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:41.692313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92028c33-eb05-4805-aed5-d5112b501774 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:41.776039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5db7c-6487-4162-8d45-9d095f8e502f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:41.777005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5db7c-6487-4162-8d45-9d095f8e502f admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:41.777435 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5db7c-6487-4162-8d45-9d095f8e502f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:41.777910 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5db7c-6487-4162-8d45-9d095f8e502f admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:41.779716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5db7c-6487-4162-8d45-9d095f8e502f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:41.784072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5db7c-6487-4162-8d45-9d095f8e502f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:41.877666 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1270/2531] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:02:41 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:02:41.881072 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bb483-c8bc-4b69-a04c-8c8004b85441 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:41.892038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bb483-c8bc-4b69-a04c-8c8004b85441 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:41.897120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848c7e0-7260-457b-9c75-832522e23f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:41.900722 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848c7e0-7260-457b-9c75-832522e23f1e admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:41.900722 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848c7e0-7260-457b-9c75-832522e23f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:41.900722 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848c7e0-7260-457b-9c75-832522e23f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:41.900722 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848c7e0-7260-457b-9c75-832522e23f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:41.900722 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848c7e0-7260-457b-9c75-832522e23f1e admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:41.912627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1262/2532] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:02:41.916615 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5db7c-6487-4162-8d45-9d095f8e502f admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:41.928220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5db7c-6487-4162-8d45-9d095f8e502f admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:41.933116 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e00e9d-4c2a-49c0-ac9e-0d36ecf9cb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:41.933882 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e00e9d-4c2a-49c0-ac9e-0d36ecf9cb99 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:41.934244 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e00e9d-4c2a-49c0-ac9e-0d36ecf9cb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:41.934612 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e00e9d-4c2a-49c0-ac9e-0d36ecf9cb99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:41.935443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e00e9d-4c2a-49c0-ac9e-0d36ecf9cb99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:41.937178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e00e9d-4c2a-49c0-ac9e-0d36ecf9cb99 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:41.952581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1271/2533] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:02:41.953980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848c7e0-7260-457b-9c75-832522e23f1e admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:41.964661 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848c7e0-7260-457b-9c75-832522e23f1e admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:41.970263 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f264a-04a9-409d-bc26-fadbc3cfad5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:41.971192 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f264a-04a9-409d-bc26-fadbc3cfad5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:41.971481 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f264a-04a9-409d-bc26-fadbc3cfad5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:41.971762 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f264a-04a9-409d-bc26-fadbc3cfad5f admin admin] PATH_INFO: `/v3/projects/b710294d4abc4b7191399deb477e799c/users/2bbf91477029455f98a7ad5e424abf60/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:41.975174 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:41.987482 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f264a-04a9-409d-bc26-fadbc3cfad5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b710294d4abc4b7191399deb477e799c, user_id=2bbf91477029455f98a7ad5e424abf60, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:41.990376 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f264a-04a9-409d-bc26-fadbc3cfad5f admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:42.068051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1263/2534] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:02:41 2022] PUT /identity/v3/projects/b710294d4abc4b7191399deb477e799c/users/2bbf91477029455f98a7ad5e424abf60/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:02:42.078683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609db06-0174-4c37-b0b9-7c994d1d67dd None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:42.079285 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609db06-0174-4c37-b0b9-7c994d1d67dd None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:42.079285 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609db06-0174-4c37-b0b9-7c994d1d67dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:42.108404 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-6609db06-0174-4c37-b0b9-7c994d1d67dd None None] MFA Rules not processed for user `2bbf91477029455f98a7ad5e424abf60`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:42.109648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-6609db06-0174-4c37-b0b9-7c994d1d67dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:42.185732 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1272/2535] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:02:42.189201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f264a-04a9-409d-bc26-fadbc3cfad5f admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:42.191170 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-1a1f264a-04a9-409d-bc26-fadbc3cfad5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:42.197436 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609db06-0174-4c37-b0b9-7c994d1d67dd None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:42.198955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-6609db06-0174-4c37-b0b9-7c994d1d67dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:42.218403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:42.275981 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609db06-0174-4c37-b0b9-7c994d1d67dd None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:42.281249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f98f0c-da6a-4e87-802e-2d10eaeaed20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:42.282183 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f98f0c-da6a-4e87-802e-2d10eaeaed20 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:42.282525 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f98f0c-da6a-4e87-802e-2d10eaeaed20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:42.283200 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f98f0c-da6a-4e87-802e-2d10eaeaed20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:42.294003 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f98f0c-da6a-4e87-802e-2d10eaeaed20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:42.295876 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f98f0c-da6a-4e87-802e-2d10eaeaed20 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:42.313347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1273/2536] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:02:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:02:42.321761 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f264a-04a9-409d-bc26-fadbc3cfad5f admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:42.337688 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b06bb-04fe-458d-914f-c8c4354f01ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:42.350282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b06bb-04fe-458d-914f-c8c4354f01ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:42.350282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b06bb-04fe-458d-914f-c8c4354f01ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:42.350282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b06bb-04fe-458d-914f-c8c4354f01ff admin admin] PATH_INFO: `/v3/projects/1e0a028c415649f28c1b38b18f666045` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:42.350282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b06bb-04fe-458d-914f-c8c4354f01ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e0a028c415649f28c1b38b18f666045)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:42.350282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b06bb-04fe-458d-914f-c8c4354f01ff admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:42.510484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4d6b06bb-04fe-458d-914f-c8c4354f01ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e0a028c415649f28c1b38b18f666045', 'request_id': 'req-4d6b06bb-04fe-458d-914f-c8c4354f01ff'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:42.619510 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4d6b06bb-04fe-458d-914f-c8c4354f01ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e0a028c415649f28c1b38b18f666045', 'request_id': 'req-4d6b06bb-04fe-458d-914f-c8c4354f01ff'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:42.626698 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4d6b06bb-04fe-458d-914f-c8c4354f01ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e0a028c415649f28c1b38b18f666045', 'request_id': 'req-4d6b06bb-04fe-458d-914f-c8c4354f01ff'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:42.639630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4d6b06bb-04fe-458d-914f-c8c4354f01ff admin admin] The token cache is being invalidate because project 1e0a028c415649f28c1b38b18f666045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:02:42.639938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4d6b06bb-04fe-458d-914f-c8c4354f01ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:42.645256 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4d6b06bb-04fe-458d-914f-c8c4354f01ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:42.651782 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1264/2537] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:02:42 2022] DELETE /identity/v3/projects/1e0a028c415649f28c1b38b18f666045 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:02:42.654171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaee365-73ff-45ac-b5ad-a51a4096cbc1 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:42.654653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaee365-73ff-45ac-b5ad-a51a4096cbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:42.655105 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaee365-73ff-45ac-b5ad-a51a4096cbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:42.684912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-2eaee365-73ff-45ac-b5ad-a51a4096cbc1 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:42.684912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2eaee365-73ff-45ac-b5ad-a51a4096cbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:42.762654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1274/2538] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:02:42.770798 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97373750-27bd-4a17-ab59-9209a0074acd None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:42.771143 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97373750-27bd-4a17-ab59-9209a0074acd None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:42.771374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97373750-27bd-4a17-ab59-9209a0074acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:42.792454 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-97373750-27bd-4a17-ab59-9209a0074acd None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:42.794962 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-97373750-27bd-4a17-ab59-9209a0074acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:42.802572 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1265/2539] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:02:42.806966 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaee365-73ff-45ac-b5ad-a51a4096cbc1 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:42.818766 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaee365-73ff-45ac-b5ad-a51a4096cbc1 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:42.824909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12df17-6fcf-45af-8108-a580928da58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:42.825596 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12df17-6fcf-45af-8108-a580928da58b admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:42.825928 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12df17-6fcf-45af-8108-a580928da58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:42.826210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12df17-6fcf-45af-8108-a580928da58b admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:42.826986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12df17-6fcf-45af-8108-a580928da58b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:02:42.827295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12df17-6fcf-45af-8108-a580928da58b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:42.828973 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12df17-6fcf-45af-8108-a580928da58b admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:42.842188 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1275/2540] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:02:42.847228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97373750-27bd-4a17-ab59-9209a0074acd None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:42.858998 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97373750-27bd-4a17-ab59-9209a0074acd None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:42.864476 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318e874-78fa-4e89-ad51-4a367c93833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:42.865148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318e874-78fa-4e89-ad51-4a367c93833e admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:42.865432 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318e874-78fa-4e89-ad51-4a367c93833e admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:42.865706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318e874-78fa-4e89-ad51-4a367c93833e admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:42.866475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318e874-78fa-4e89-ad51-4a367c93833e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:42.868419 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8318e874-78fa-4e89-ad51-4a367c93833e admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:42.983630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1266/2541] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:02:42 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:02:42.991769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12df17-6fcf-45af-8108-a580928da58b admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:43.001593 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12df17-6fcf-45af-8108-a580928da58b admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:43.154638 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18c4f0-45be-4cbd-b322-75b136f49922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:43.155599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18c4f0-45be-4cbd-b322-75b136f49922 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:43.155896 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18c4f0-45be-4cbd-b322-75b136f49922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:43.156250 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18c4f0-45be-4cbd-b322-75b136f49922 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:43.157156 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18c4f0-45be-4cbd-b322-75b136f49922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:43.159167 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18c4f0-45be-4cbd-b322-75b136f49922 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:43.285029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1276/2542] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:02:42 2022] POST /identity/v3/users => generated 293 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:02:43.289272 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318e874-78fa-4e89-ad51-4a367c93833e admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:43.305052 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318e874-78fa-4e89-ad51-4a367c93833e admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:43.314027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe711284-98ec-44cb-b8bd-5126f726b1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:43.315178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe711284-98ec-44cb-b8bd-5126f726b1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:43.315710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe711284-98ec-44cb-b8bd-5126f726b1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:43.316333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe711284-98ec-44cb-b8bd-5126f726b1c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:43.317357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe711284-98ec-44cb-b8bd-5126f726b1c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:43.318932 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe711284-98ec-44cb-b8bd-5126f726b1c2 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:43.330645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1267/2543] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:02:43.334769 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18c4f0-45be-4cbd-b322-75b136f49922 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:43.350297 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18c4f0-45be-4cbd-b322-75b136f49922 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:43.361833 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197497c-9ef4-4331-8ce7-0ecd1f671a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:43.362521 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197497c-9ef4-4331-8ce7-0ecd1f671a73 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:43.362814 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197497c-9ef4-4331-8ce7-0ecd1f671a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:43.363099 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197497c-9ef4-4331-8ce7-0ecd1f671a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:43.363891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197497c-9ef4-4331-8ce7-0ecd1f671a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:43.365555 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197497c-9ef4-4331-8ce7-0ecd1f671a73 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:43.389758 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1277/2544] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:02:43.397196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe711284-98ec-44cb-b8bd-5126f726b1c2 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:43.409739 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe711284-98ec-44cb-b8bd-5126f726b1c2 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:43.414910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cf8e6-9503-4c71-b71c-1520b4c830cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:43.416145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cf8e6-9503-4c71-b71c-1520b4c830cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:43.416448 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cf8e6-9503-4c71-b71c-1520b4c830cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:43.416726 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cf8e6-9503-4c71-b71c-1520b4c830cb admin admin] PATH_INFO: `/v3/projects/fb2f9e80471c4d6b93febc9534cb9be6/users/9719a17bb03b43a09dcd7bf4f019c81c/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:43.435402 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4cf8e6-9503-4c71-b71c-1520b4c830cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb2f9e80471c4d6b93febc9534cb9be6, user_id=9719a17bb03b43a09dcd7bf4f019c81c, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:43.438112 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4cf8e6-9503-4c71-b71c-1520b4c830cb admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:43.562673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1268/2545] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:02:43 2022] PUT /identity/v3/projects/fb2f9e80471c4d6b93febc9534cb9be6/users/9719a17bb03b43a09dcd7bf4f019c81c/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:02:43.568044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a91391-c4ae-4ee6-bfb8-78611425def9 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:43.568372 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a91391-c4ae-4ee6-bfb8-78611425def9 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:43.568661 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a91391-c4ae-4ee6-bfb8-78611425def9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:43.590320 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-25a91391-c4ae-4ee6-bfb8-78611425def9 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:43.594301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-25a91391-c4ae-4ee6-bfb8-78611425def9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:43.627215 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:43.687216 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1278/2546] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:02:43.694410 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cf8e6-9503-4c71-b71c-1520b4c830cb admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:43.696449 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-5a4cf8e6-9503-4c71-b71c-1520b4c830cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:43.712083 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:43.758273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cf8e6-9503-4c71-b71c-1520b4c830cb admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:43.762457 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf26f1-d387-4ce4-aef9-12b5fc13e3c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:43.764533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf26f1-d387-4ce4-aef9-12b5fc13e3c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:43.765069 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf26f1-d387-4ce4-aef9-12b5fc13e3c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:43.766100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf26f1-d387-4ce4-aef9-12b5fc13e3c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:43.777331 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf26f1-d387-4ce4-aef9-12b5fc13e3c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:43.779776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf26f1-d387-4ce4-aef9-12b5fc13e3c1 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:43.790233 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1269/2547] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:02:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:02:45.456098 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2372eb-bc95-4f0a-b8e6-eb39301ef6f2 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:45.456789 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2372eb-bc95-4f0a-b8e6-eb39301ef6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:45.456789 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2372eb-bc95-4f0a-b8e6-eb39301ef6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:45.488654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-0a2372eb-bc95-4f0a-b8e6-eb39301ef6f2 None None] MFA Rules not processed for user `4bd8f30d0f834973a0e9f5d8dfc1a9ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:45.491194 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-0a2372eb-bc95-4f0a-b8e6-eb39301ef6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:45.614649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1279/2548] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:02:45.615914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf26f1-d387-4ce4-aef9-12b5fc13e3c1 service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:45.617961 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-3fbf26f1-d387-4ce4-aef9-12b5fc13e3c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:45.640054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf26f1-d387-4ce4-aef9-12b5fc13e3c1 service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:45.646210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768ceda-407f-450f-84c8-bf93374be0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:45.647266 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768ceda-407f-450f-84c8-bf93374be0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:45.647718 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768ceda-407f-450f-84c8-bf93374be0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:45.648199 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768ceda-407f-450f-84c8-bf93374be0a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:45.649299 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768ceda-407f-450f-84c8-bf93374be0a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:45.651461 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768ceda-407f-450f-84c8-bf93374be0a9 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:45.772197 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1270/2549] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:02:45 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:02:45.772838 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2372eb-bc95-4f0a-b8e6-eb39301ef6f2 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:45.788748 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2372eb-bc95-4f0a-b8e6-eb39301ef6f2 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:45.853487 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7e875-f1df-4a31-b8c5-e4abe2c3d3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:45.854154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7e875-f1df-4a31-b8c5-e4abe2c3d3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:45.854436 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7e875-f1df-4a31-b8c5-e4abe2c3d3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:45.854709 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7e875-f1df-4a31-b8c5-e4abe2c3d3c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:45.855410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7e875-f1df-4a31-b8c5-e4abe2c3d3c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:45.857492 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7e875-f1df-4a31-b8c5-e4abe2c3d3c5 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:45.956277 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1280/2550] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:02:45 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:02:45.957498 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768ceda-407f-450f-84c8-bf93374be0a9 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:45.968785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768ceda-407f-450f-84c8-bf93374be0a9 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:45.973878 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1870a-45ee-4996-99d2-0541cfff6a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:45.974937 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1870a-45ee-4996-99d2-0541cfff6a5f admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:45.975615 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1870a-45ee-4996-99d2-0541cfff6a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:45.976094 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1870a-45ee-4996-99d2-0541cfff6a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:45.981799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1870a-45ee-4996-99d2-0541cfff6a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:45.981799 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1870a-45ee-4996-99d2-0541cfff6a5f admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:45.994574 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1271/2551] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:02:45.998755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7e875-f1df-4a31-b8c5-e4abe2c3d3c5 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:46.014843 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7e875-f1df-4a31-b8c5-e4abe2c3d3c5 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:46.025002 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157578f7-fe42-49bc-9b66-d235e5a7943d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:46.025002 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157578f7-fe42-49bc-9b66-d235e5a7943d admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:46.025002 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157578f7-fe42-49bc-9b66-d235e5a7943d admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:46.025002 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157578f7-fe42-49bc-9b66-d235e5a7943d admin admin] PATH_INFO: `/v3/projects/a0929cf097964bf3a874fab0abc20a6b/users/d5cbcd6e9dac46f0a9e1117e2573b90e/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:46.047166 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157578f7-fe42-49bc-9b66-d235e5a7943d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0929cf097964bf3a874fab0abc20a6b, user_id=d5cbcd6e9dac46f0a9e1117e2573b90e, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:46.055401 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157578f7-fe42-49bc-9b66-d235e5a7943d admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:46.226182 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1281/2552] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:02:45 2022] PUT /identity/v3/projects/a0929cf097964bf3a874fab0abc20a6b/users/d5cbcd6e9dac46f0a9e1117e2573b90e/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:02:46.227555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1870a-45ee-4996-99d2-0541cfff6a5f admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:46.241942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1870a-45ee-4996-99d2-0541cfff6a5f admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:46.333476 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be388d-595d-4620-b8a7-4f6690ff314c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:46.335264 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be388d-595d-4620-b8a7-4f6690ff314c admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:46.335767 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be388d-595d-4620-b8a7-4f6690ff314c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:46.336302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be388d-595d-4620-b8a7-4f6690ff314c admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:46.340483 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be388d-595d-4620-b8a7-4f6690ff314c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:46.342927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be388d-595d-4620-b8a7-4f6690ff314c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:46.361631 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1272/2553] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:02:46.362381 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157578f7-fe42-49bc-9b66-d235e5a7943d admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:46.379337 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157578f7-fe42-49bc-9b66-d235e5a7943d admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:46.387804 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87fc73-2a6d-4331-9ebc-80656e135b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:46.389612 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87fc73-2a6d-4331-9ebc-80656e135b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:46.390010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87fc73-2a6d-4331-9ebc-80656e135b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:46.390315 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87fc73-2a6d-4331-9ebc-80656e135b5c admin admin] PATH_INFO: `/v3/projects/a0929cf097964bf3a874fab0abc20a6b/users/d5cbcd6e9dac46f0a9e1117e2573b90e/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:46.393220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87fc73-2a6d-4331-9ebc-80656e135b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0929cf097964bf3a874fab0abc20a6b, user_id=d5cbcd6e9dac46f0a9e1117e2573b90e, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:46.396742 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87fc73-2a6d-4331-9ebc-80656e135b5c admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:46.422613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1282/2554] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:02:46 2022] PUT /identity/v3/projects/a0929cf097964bf3a874fab0abc20a6b/users/d5cbcd6e9dac46f0a9e1117e2573b90e/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:02:46.745844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be388d-595d-4620-b8a7-4f6690ff314c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:46.752310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e2be388d-595d-4620-b8a7-4f6690ff314c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:46.776795 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be388d-595d-4620-b8a7-4f6690ff314c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:46.867503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb900e1-f595-457d-b8ae-52d1aad16b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:46.867503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb900e1-f595-457d-b8ae-52d1aad16b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:46.867503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb900e1-f595-457d-b8ae-52d1aad16b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:46.867794 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb900e1-f595-457d-b8ae-52d1aad16b76 admin admin] PATH_INFO: `/v3/users/2bbf91477029455f98a7ad5e424abf60` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:46.871069 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb900e1-f595-457d-b8ae-52d1aad16b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bbf91477029455f98a7ad5e424abf60)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:46.873791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb900e1-f595-457d-b8ae-52d1aad16b76 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:46.915647 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:47.088422 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-2fb900e1-f595-457d-b8ae-52d1aad16b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bbf91477029455f98a7ad5e424abf60'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:47.093795 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-2fb900e1-f595-457d-b8ae-52d1aad16b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bbf91477029455f98a7ad5e424abf60'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:47.191781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-2fb900e1-f595-457d-b8ae-52d1aad16b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bbf91477029455f98a7ad5e424abf60'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:47.192475 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-2fb900e1-f595-457d-b8ae-52d1aad16b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bbf91477029455f98a7ad5e424abf60'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:47.219778 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-2fb900e1-f595-457d-b8ae-52d1aad16b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bbf91477029455f98a7ad5e424abf60'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:47.247623 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1273/2555] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:02:46 2022] DELETE /identity/v3/users/2bbf91477029455f98a7ad5e424abf60 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:02:47.252664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a05b59-dd8d-4df1-8a0e-6436d3301410 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:47.256963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a05b59-dd8d-4df1-8a0e-6436d3301410 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:47.256963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a05b59-dd8d-4df1-8a0e-6436d3301410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:47.268893 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:47.275454 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-f1a05b59-dd8d-4df1-8a0e-6436d3301410 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:47.276820 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f1a05b59-dd8d-4df1-8a0e-6436d3301410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:47.410305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1283/2556] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:02:47.426980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb900e1-f595-457d-b8ae-52d1aad16b76 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:47.428822 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-2fb900e1-f595-457d-b8ae-52d1aad16b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:47.536301 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb900e1-f595-457d-b8ae-52d1aad16b76 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:47.541391 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce59e7d-6a5f-4b0e-b40f-ccd90298bb70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:47.542275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce59e7d-6a5f-4b0e-b40f-ccd90298bb70 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:47.542681 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce59e7d-6a5f-4b0e-b40f-ccd90298bb70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:47.543033 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce59e7d-6a5f-4b0e-b40f-ccd90298bb70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:47.567649 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce59e7d-6a5f-4b0e-b40f-ccd90298bb70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:47.569801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce59e7d-6a5f-4b0e-b40f-ccd90298bb70 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:47.583958 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1274/2557] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:02:48.474866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a05b59-dd8d-4df1-8a0e-6436d3301410 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:48.476420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f1a05b59-dd8d-4df1-8a0e-6436d3301410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:48.498193 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a05b59-dd8d-4df1-8a0e-6436d3301410 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:48.518010 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964a61b-e706-4519-b2b5-477532e5201f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:48.519225 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964a61b-e706-4519-b2b5-477532e5201f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:48.519745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964a61b-e706-4519-b2b5-477532e5201f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:48.520266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964a61b-e706-4519-b2b5-477532e5201f admin admin] PATH_INFO: `/v3/projects/b710294d4abc4b7191399deb477e799c` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:48.531827 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964a61b-e706-4519-b2b5-477532e5201f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b710294d4abc4b7191399deb477e799c)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:48.531827 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964a61b-e706-4519-b2b5-477532e5201f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:48.684735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4964a61b-e706-4519-b2b5-477532e5201f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b710294d4abc4b7191399deb477e799c', 'request_id': 'req-4964a61b-e706-4519-b2b5-477532e5201f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:48.816063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4964a61b-e706-4519-b2b5-477532e5201f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b710294d4abc4b7191399deb477e799c', 'request_id': 'req-4964a61b-e706-4519-b2b5-477532e5201f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:48.824183 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4964a61b-e706-4519-b2b5-477532e5201f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b710294d4abc4b7191399deb477e799c', 'request_id': 'req-4964a61b-e706-4519-b2b5-477532e5201f'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:48.846002 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4964a61b-e706-4519-b2b5-477532e5201f admin admin] The token cache is being invalidate because project b710294d4abc4b7191399deb477e799c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:02:48.846675 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4964a61b-e706-4519-b2b5-477532e5201f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:48.848313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4964a61b-e706-4519-b2b5-477532e5201f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:02:48.870932 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1284/2558] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:02:48 2022] DELETE /identity/v3/projects/b710294d4abc4b7191399deb477e799c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:02:51.146172 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aebd4-cb71-4eb7-8235-6acbe0247b04 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:51.146896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aebd4-cb71-4eb7-8235-6acbe0247b04 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:51.146896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aebd4-cb71-4eb7-8235-6acbe0247b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:51.198387 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-963aebd4-cb71-4eb7-8235-6acbe0247b04 None None] MFA Rules not processed for user `9719a17bb03b43a09dcd7bf4f019c81c`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:51.199731 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-963aebd4-cb71-4eb7-8235-6acbe0247b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:51.310985 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1275/2559] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:02:51.315985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964a61b-e706-4519-b2b5-477532e5201f admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:51.318362 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-4964a61b-e706-4519-b2b5-477532e5201f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:51.432887 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964a61b-e706-4519-b2b5-477532e5201f admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:51.438867 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30b3e6-0987-41c6-a193-fbf3fc6427f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:51.439558 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30b3e6-0987-41c6-a193-fbf3fc6427f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:51.439839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30b3e6-0987-41c6-a193-fbf3fc6427f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:51.440126 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30b3e6-0987-41c6-a193-fbf3fc6427f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:51.440909 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30b3e6-0987-41c6-a193-fbf3fc6427f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:51.442832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30b3e6-0987-41c6-a193-fbf3fc6427f2 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:51.530195 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1285/2560] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:02:51 2022] POST /identity/v3/projects => generated 383 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:02:51.534417 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963aebd4-cb71-4eb7-8235-6acbe0247b04 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:51.551614 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963aebd4-cb71-4eb7-8235-6acbe0247b04 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:51.613429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:51.686783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c9e17-6236-4e95-a4dd-06df8bb07f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:51.687807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c9e17-6236-4e95-a4dd-06df8bb07f1b admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:51.688279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c9e17-6236-4e95-a4dd-06df8bb07f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:51.688737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c9e17-6236-4e95-a4dd-06df8bb07f1b admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:51.689661 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c9e17-6236-4e95-a4dd-06df8bb07f1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:51.691850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c9e17-6236-4e95-a4dd-06df8bb07f1b admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:51.802261 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1276/2561] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:02:51 2022] POST /identity/v3/users => generated 298 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:02:51.805381 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30b3e6-0987-41c6-a193-fbf3fc6427f2 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:51.816447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30b3e6-0987-41c6-a193-fbf3fc6427f2 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:51.822203 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b996f-6555-4d89-a21f-2c08da86657c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:51.822993 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b996f-6555-4d89-a21f-2c08da86657c admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:51.823349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b996f-6555-4d89-a21f-2c08da86657c admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:51.823697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b996f-6555-4d89-a21f-2c08da86657c admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:51.824643 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b996f-6555-4d89-a21f-2c08da86657c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:51.826900 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b996f-6555-4d89-a21f-2c08da86657c admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:51.859675 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1286/2562] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:02:51.863684 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c9e17-6236-4e95-a4dd-06df8bb07f1b admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:51.878417 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c9e17-6236-4e95-a4dd-06df8bb07f1b admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:51.918971 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345165d-eec1-4191-b8bb-af3747f9bcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:51.920096 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345165d-eec1-4191-b8bb-af3747f9bcc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:51.922899 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345165d-eec1-4191-b8bb-af3747f9bcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:51.922899 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345165d-eec1-4191-b8bb-af3747f9bcc1 admin admin] PATH_INFO: `/v3/projects/ba769b4f49d94b66a81859b409ae59cd/users/bf4dc9441c3c4080874712d9f9522089/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:51.953595 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345165d-eec1-4191-b8bb-af3747f9bcc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba769b4f49d94b66a81859b409ae59cd, user_id=bf4dc9441c3c4080874712d9f9522089, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:51.958064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345165d-eec1-4191-b8bb-af3747f9bcc1 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:52.101146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1277/2563] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:02:51 2022] PUT /identity/v3/projects/ba769b4f49d94b66a81859b409ae59cd/users/bf4dc9441c3c4080874712d9f9522089/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:02:52.105793 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b996f-6555-4d89-a21f-2c08da86657c admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:52.115864 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:52.127524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b996f-6555-4d89-a21f-2c08da86657c admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:52.290493 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49ba95-ce55-46fb-8719-84a2e250e0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:52.290493 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49ba95-ce55-46fb-8719-84a2e250e0cb admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:52.290493 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49ba95-ce55-46fb-8719-84a2e250e0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:52.290493 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49ba95-ce55-46fb-8719-84a2e250e0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:52.291001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49ba95-ce55-46fb-8719-84a2e250e0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:52.291001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49ba95-ce55-46fb-8719-84a2e250e0cb admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:52.313675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345165d-eec1-4191-b8bb-af3747f9bcc1 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:52.320304 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1287/2564] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:02:52.329705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345165d-eec1-4191-b8bb-af3747f9bcc1 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:52.342917 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c746b-6541-49c0-998f-10fb2d4706f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:52.343837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c746b-6541-49c0-998f-10fb2d4706f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:52.344147 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c746b-6541-49c0-998f-10fb2d4706f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:52.344602 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c746b-6541-49c0-998f-10fb2d4706f6 admin admin] PATH_INFO: `/v3/projects/ba769b4f49d94b66a81859b409ae59cd/users/bf4dc9441c3c4080874712d9f9522089/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:52.349094 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c746b-6541-49c0-998f-10fb2d4706f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba769b4f49d94b66a81859b409ae59cd, user_id=bf4dc9441c3c4080874712d9f9522089, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:52.351748 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69c746b-6541-49c0-998f-10fb2d4706f6 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:52.380361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1278/2565] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:02:52 2022] PUT /identity/v3/projects/ba769b4f49d94b66a81859b409ae59cd/users/bf4dc9441c3c4080874712d9f9522089/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:02:53.939362 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e34fa6-d225-4a6f-bc15-da533b5ca27a None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:53.939866 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e34fa6-d225-4a6f-bc15-da533b5ca27a None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:53.939948 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e34fa6-d225-4a6f-bc15-da533b5ca27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:53.973499 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-a3e34fa6-d225-4a6f-bc15-da533b5ca27a None None] MFA Rules not processed for user `d5cbcd6e9dac46f0a9e1117e2573b90e`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:53.977427 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-a3e34fa6-d225-4a6f-bc15-da533b5ca27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:54.058035 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1288/2566] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:53 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:02:54.074340 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c746b-6541-49c0-998f-10fb2d4706f6 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:54.075339 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-d69c746b-6541-49c0-998f-10fb2d4706f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:54.212973 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c746b-6541-49c0-998f-10fb2d4706f6 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:54.220704 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8f83c-43b5-456d-8d0f-44aa19afc5a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:54.221378 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8f83c-43b5-456d-8d0f-44aa19afc5a5 service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:54.221680 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8f83c-43b5-456d-8d0f-44aa19afc5a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:54.221980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8f83c-43b5-456d-8d0f-44aa19afc5a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:54.223719 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-9ce8f83c-43b5-456d-8d0f-44aa19afc5a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:54.292837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8f83c-43b5-456d-8d0f-44aa19afc5a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:54.294542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8f83c-43b5-456d-8d0f-44aa19afc5a5 service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:54.298419 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:54.305029 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1279/2567] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:02:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:02:57.675447 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ad20e-c0cc-4e42-b2a3-dc314e3d3ed1 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:57.675998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ad20e-c0cc-4e42-b2a3-dc314e3d3ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:57.675998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ad20e-c0cc-4e42-b2a3-dc314e3d3ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:57.710955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-e35ad20e-c0cc-4e42-b2a3-dc314e3d3ed1 None None] MFA Rules not processed for user `4bd8f30d0f834973a0e9f5d8dfc1a9ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:57.713176 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e35ad20e-c0cc-4e42-b2a3-dc314e3d3ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:57.730830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1289/2568] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:02:58.887983 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85654cd-4129-437f-9c36-4ec33989aced None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:58.889027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85654cd-4129-437f-9c36-4ec33989aced None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:58.889218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85654cd-4129-437f-9c36-4ec33989aced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:58.940807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-f85654cd-4129-437f-9c36-4ec33989aced None None] MFA Rules not processed for user `bf4dc9441c3c4080874712d9f9522089`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:58.942303 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-f85654cd-4129-437f-9c36-4ec33989aced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:59.040402 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1280/2569] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:02:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:02:59.053739 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ad20e-c0cc-4e42-b2a3-dc314e3d3ed1 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:59.055432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e35ad20e-c0cc-4e42-b2a3-dc314e3d3ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:59.181383 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ad20e-c0cc-4e42-b2a3-dc314e3d3ed1 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:59.186492 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67bc7b-a998-4e7e-9894-2a4f32e760f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '144e0074ab4d4e5c8743e4f7d68a89b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:59.187220 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67bc7b-a998-4e7e-9894-2a4f32e760f7 service glance] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:59.187508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67bc7b-a998-4e7e-9894-2a4f32e760f7 service glance] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:59.187788 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67bc7b-a998-4e7e-9894-2a4f32e760f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:59.203954 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=100 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:02:59.268497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67bc7b-a998-4e7e-9894-2a4f32e760f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:02:59.270204 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67bc7b-a998-4e7e-9894-2a4f32e760f7 service glance] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:02:59.280426 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1290/2570] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:02:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:02:59.557984 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8edee8-67f5-4737-81dd-3a3deb484469 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:59.558289 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8edee8-67f5-4737-81dd-3a3deb484469 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:59.558638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8edee8-67f5-4737-81dd-3a3deb484469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:02:59.609814 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-fe8edee8-67f5-4737-81dd-3a3deb484469 None None] MFA Rules not processed for user `2a0a8cfb2482466a98340adab9980d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:02:59.611024 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-fe8edee8-67f5-4737-81dd-3a3deb484469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:59.677682 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1281/2571] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 17:02:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:02:59.854622 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67bc7b-a998-4e7e-9894-2a4f32e760f7 service glance] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:02:59.857924 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-ab67bc7b-a998-4e7e-9894-2a4f32e760f7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:02:59.978246 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67bc7b-a998-4e7e-9894-2a4f32e760f7 service glance] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:02:59.986290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7314e10-34c3-4b47-ab79-4daa76cebdca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861452a1dc634bf69ce630d7dcd8a2d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:02:59.986893 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7314e10-34c3-4b47-ab79-4daa76cebdca service swift] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:02:59.987176 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7314e10-34c3-4b47-ab79-4daa76cebdca service swift] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:02:59.987449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7314e10-34c3-4b47-ab79-4daa76cebdca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:03:00.002008 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7314e10-34c3-4b47-ab79-4daa76cebdca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:03:00.003652 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7314e10-34c3-4b47-ab79-4daa76cebdca service swift] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:03:00.037191 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1291/2572] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 17:02:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 17:03:09.673595 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=75 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:03:10.014299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=62 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:03:11.943831 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2859d-ca7b-403d-b314-b3f0fa4f163a None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:03:11.943831 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2859d-ca7b-403d-b314-b3f0fa4f163a None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:03:11.943831 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2859d-ca7b-403d-b314-b3f0fa4f163a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:03:11.961376 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-92d2859d-ca7b-403d-b314-b3f0fa4f163a None None] MFA Rules not processed for user `9719a17bb03b43a09dcd7bf4f019c81c`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:03:11.962583 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-92d2859d-ca7b-403d-b314-b3f0fa4f163a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:03:11.970477 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1282/2573] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:03:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:03:19.916802 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e604ce-5774-470d-a322-98d99e386664 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:03:19.917318 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e604ce-5774-470d-a322-98d99e386664 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:03:19.917416 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e604ce-5774-470d-a322-98d99e386664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:03:19.935047 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-b8e604ce-5774-470d-a322-98d99e386664 None None] MFA Rules not processed for user `2a0a8cfb2482466a98340adab9980d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:03:19.936293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-b8e604ce-5774-470d-a322-98d99e386664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:03:19.947585 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1292/2574] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 17:03:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:03:19.960421 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2859d-ca7b-403d-b314-b3f0fa4f163a None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:03:19.972334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2859d-ca7b-403d-b314-b3f0fa4f163a None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:03:19.977611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd00df-7f66-472f-b993-ac652325bcd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861452a1dc634bf69ce630d7dcd8a2d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:03:19.978364 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd00df-7f66-472f-b993-ac652325bcd7 service swift] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:03:19.978661 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd00df-7f66-472f-b993-ac652325bcd7 service swift] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:03:19.978939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd00df-7f66-472f-b993-ac652325bcd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:03:19.987725 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd00df-7f66-472f-b993-ac652325bcd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:03:19.989378 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd00df-7f66-472f-b993-ac652325bcd7 service swift] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:03:19.997621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1283/2575] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 17:03:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 17:03:29.929662 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:03:29.994329 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=9 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:03:48.892576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e604ce-5774-470d-a322-98d99e386664 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:03:48.894160 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-b8e604ce-5774-470d-a322-98d99e386664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:03:48.949582 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e604ce-5774-470d-a322-98d99e386664 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:03:48.953135 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab3165-4636-42dc-985d-f5a6b394b570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:03:48.953777 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab3165-4636-42dc-985d-f5a6b394b570 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:03:48.954070 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab3165-4636-42dc-985d-f5a6b394b570 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:03:48.954353 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab3165-4636-42dc-985d-f5a6b394b570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:03:48.956187 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-1dab3165-4636-42dc-985d-f5a6b394b570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:03:48.970122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab3165-4636-42dc-985d-f5a6b394b570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:03:48.971585 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab3165-4636-42dc-985d-f5a6b394b570 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:03:48.983024 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1293/2576] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:03:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:03:50.153742 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd00df-7f66-472f-b993-ac652325bcd7 service swift] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:03:50.155150 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-3ecd00df-7f66-472f-b993-ac652325bcd7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:03:50.167640 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd00df-7f66-472f-b993-ac652325bcd7 service swift] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:03:50.171141 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd722bf-7a24-4562-abd3-dc0750f24b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:03:50.171767 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd722bf-7a24-4562-abd3-dc0750f24b5a service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:03:50.172047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd722bf-7a24-4562-abd3-dc0750f24b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:03:50.172351 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd722bf-7a24-4562-abd3-dc0750f24b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:03:50.174015 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0bd722bf-7a24-4562-abd3-dc0750f24b5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:03:50.186742 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd722bf-7a24-4562-abd3-dc0750f24b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:03:50.188167 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd722bf-7a24-4562-abd3-dc0750f24b5a service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:03:50.198942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1284/2577] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:03:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:03:58.978224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=26 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:04:00.095770 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f6bbf-04ae-4d5f-813b-163c56a10518 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:04:00.096446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f6bbf-04ae-4d5f-813b-163c56a10518 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:04:00.096446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f6bbf-04ae-4d5f-813b-163c56a10518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:04:00.117577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-d47f6bbf-04ae-4d5f-813b-163c56a10518 None None] MFA Rules not processed for user `eaa62b68f6704652b48d08fcba5e4798`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:04:00.118799 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d47f6bbf-04ae-4d5f-813b-163c56a10518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:04:00.177895 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1294/2578] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:04:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:04:00.194560 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=6 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:04:00.411975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd722bf-7a24-4562-abd3-dc0750f24b5a service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:04:00.420511 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd722bf-7a24-4562-abd3-dc0750f24b5a service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:04:00.424269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b8afd-ff97-42c9-b473-04a1ce694755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:04:00.424921 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b8afd-ff97-42c9-b473-04a1ce694755 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:04:00.425204 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b8afd-ff97-42c9-b473-04a1ce694755 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:04:00.425479 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b8afd-ff97-42c9-b473-04a1ce694755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:04:00.427396 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e77b8afd-ff97-42c9-b473-04a1ce694755 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:04:00.437565 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b8afd-ff97-42c9-b473-04a1ce694755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:04:00.438972 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b8afd-ff97-42c9-b473-04a1ce694755 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:04:00.447578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1285/2579] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:04:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:04:00.865275 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f6bbf-04ae-4d5f-813b-163c56a10518 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:04:00.867456 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d47f6bbf-04ae-4d5f-813b-163c56a10518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:04:00.936819 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f6bbf-04ae-4d5f-813b-163c56a10518 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:04:00.941725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e614fa2-982f-4690-9475-26bf4ba37d93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79a71fa89446c3abbb4fdbf2c93aac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:04:00.942366 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e614fa2-982f-4690-9475-26bf4ba37d93 service placement] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:04:00.942653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e614fa2-982f-4690-9475-26bf4ba37d93 service placement] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:04:00.942937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e614fa2-982f-4690-9475-26bf4ba37d93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:04:00.944745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2e614fa2-982f-4690-9475-26bf4ba37d93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:04:00.955770 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e614fa2-982f-4690-9475-26bf4ba37d93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:04:00.957374 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e614fa2-982f-4690-9475-26bf4ba37d93 service placement] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:04:00.967261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1295/2580] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:04:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:04:04.535992 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b8afd-ff97-42c9-b473-04a1ce694755 service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:04:04.545214 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b8afd-ff97-42c9-b473-04a1ce694755 service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:04:04.549122 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446099e8-1e45-4e3e-a1e5-158989426172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:04:04.549776 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446099e8-1e45-4e3e-a1e5-158989426172 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:04:04.550063 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446099e8-1e45-4e3e-a1e5-158989426172 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:04:04.550343 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446099e8-1e45-4e3e-a1e5-158989426172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:04:04.559819 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446099e8-1e45-4e3e-a1e5-158989426172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:04:04.561365 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446099e8-1e45-4e3e-a1e5-158989426172 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:04:04.571238 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1286/2581] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:04:04 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:04:08.994963 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e614fa2-982f-4690-9475-26bf4ba37d93 service placement] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:04:09.004275 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e614fa2-982f-4690-9475-26bf4ba37d93 service placement] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:04:09.008353 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42406833-6de8-4aab-af1f-c8a6af0f4a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:04:09.008989 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42406833-6de8-4aab-af1f-c8a6af0f4a1f service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:04:09.009271 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42406833-6de8-4aab-af1f-c8a6af0f4a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:04:09.009565 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42406833-6de8-4aab-af1f-c8a6af0f4a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:04:09.018598 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42406833-6de8-4aab-af1f-c8a6af0f4a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:04:09.020032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42406833-6de8-4aab-af1f-c8a6af0f4a1f service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:04:09.029738 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1296/2582] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:04:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:04:14.058446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446099e8-1e45-4e3e-a1e5-158989426172 service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:04:14.068857 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446099e8-1e45-4e3e-a1e5-158989426172 service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:04:14.073902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57281b8c-edff-4fbf-a8a4-243f875ad9b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:04:14.074782 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57281b8c-edff-4fbf-a8a4-243f875ad9b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:04:14.075240 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57281b8c-edff-4fbf-a8a4-243f875ad9b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:04:14.075904 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57281b8c-edff-4fbf-a8a4-243f875ad9b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:04:14.078370 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-57281b8c-edff-4fbf-a8a4-243f875ad9b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:04:14.091908 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57281b8c-edff-4fbf-a8a4-243f875ad9b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:04:14.093384 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57281b8c-edff-4fbf-a8a4-243f875ad9b0 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:04:14.105786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1287/2583] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:04:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:04:16.036953 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42406833-6de8-4aab-af1f-c8a6af0f4a1f service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:04:16.040260 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-42406833-6de8-4aab-af1f-c8a6af0f4a1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:04:16.057837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42406833-6de8-4aab-af1f-c8a6af0f4a1f service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:04:16.063420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915db4c-4ada-4c02-9d0b-46a1824c1225 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:04:16.064074 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915db4c-4ada-4c02-9d0b-46a1824c1225 service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:04:16.064411 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915db4c-4ada-4c02-9d0b-46a1824c1225 service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:04:16.064733 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915db4c-4ada-4c02-9d0b-46a1824c1225 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:04:16.066590 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-5915db4c-4ada-4c02-9d0b-46a1824c1225 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:04:16.130826 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915db4c-4ada-4c02-9d0b-46a1824c1225 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:04:16.132607 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915db4c-4ada-4c02-9d0b-46a1824c1225 service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:04:16.143799 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1297/2584] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:04:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:04:24.098710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=18 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:04:26.138420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=91 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:05:03.285471 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57281b8c-edff-4fbf-a8a4-243f875ad9b0 service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:05:03.298243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57281b8c-edff-4fbf-a8a4-243f875ad9b0 service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:05:03.303685 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed3dd7-684a-4e59-95c7-d955d0aeb098 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:05:03.304315 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed3dd7-684a-4e59-95c7-d955d0aeb098 service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:05:03.304601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed3dd7-684a-4e59-95c7-d955d0aeb098 service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:05:03.304877 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed3dd7-684a-4e59-95c7-d955d0aeb098 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:05:03.306649 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-3eed3dd7-684a-4e59-95c7-d955d0aeb098 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:05:03.318965 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed3dd7-684a-4e59-95c7-d955d0aeb098 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:05:03.321100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed3dd7-684a-4e59-95c7-d955d0aeb098 service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:05:03.331632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1288/2585] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:05:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:05:05.332486 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1a98a-4fad-40dd-8fe5-21f895b5c128 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:05:05.336438 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1a98a-4fad-40dd-8fe5-21f895b5c128 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:05:05.336438 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1a98a-4fad-40dd-8fe5-21f895b5c128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:05:05.350979 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-aea1a98a-4fad-40dd-8fe5-21f895b5c128 None None] MFA Rules not processed for user `276147f205ae43da9df678dcd572115a`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:05:05.353602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-aea1a98a-4fad-40dd-8fe5-21f895b5c128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:05:05.359717 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1298/2586] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:05:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:05:11.691636 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed3dd7-684a-4e59-95c7-d955d0aeb098 service nova] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:05:11.703613 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed3dd7-684a-4e59-95c7-d955d0aeb098 service nova] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:05:11.712595 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6680644-ad03-42ef-b893-0595ffea2bf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:05:11.712595 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6680644-ad03-42ef-b893-0595ffea2bf2 service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:05:11.712595 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6680644-ad03-42ef-b893-0595ffea2bf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:05:11.712595 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6680644-ad03-42ef-b893-0595ffea2bf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:05:11.714454 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-a6680644-ad03-42ef-b893-0595ffea2bf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:05:11.727813 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6680644-ad03-42ef-b893-0595ffea2bf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:05:11.729493 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6680644-ad03-42ef-b893-0595ffea2bf2 service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:05:11.740088 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1289/2587] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:05:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:05:15.346518 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:05:21.735708 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=12 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:05:35.791249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1a98a-4fad-40dd-8fe5-21f895b5c128 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:05:35.804281 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1a98a-4fad-40dd-8fe5-21f895b5c128 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:05:35.809564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf965ac-7fe6-44e6-9082-f49bab84b848 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79a71fa89446c3abbb4fdbf2c93aac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:05:35.810249 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf965ac-7fe6-44e6-9082-f49bab84b848 service placement] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:05:35.810534 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf965ac-7fe6-44e6-9082-f49bab84b848 service placement] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:05:35.810812 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf965ac-7fe6-44e6-9082-f49bab84b848 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:05:35.812630 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-5bf965ac-7fe6-44e6-9082-f49bab84b848 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:05:35.824752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf965ac-7fe6-44e6-9082-f49bab84b848 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:05:35.826352 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf965ac-7fe6-44e6-9082-f49bab84b848 service placement] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:05:35.837538 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1299/2588] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:05:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:05:35.907453 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6680644-ad03-42ef-b893-0595ffea2bf2 service nova] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:05:35.914715 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-a6680644-ad03-42ef-b893-0595ffea2bf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:05:35.975917 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6680644-ad03-42ef-b893-0595ffea2bf2 service nova] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:05:35.980491 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c87bb1-e915-4c74-9fb1-ecb74188af77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:05:35.981359 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c87bb1-e915-4c74-9fb1-ecb74188af77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:05:35.981649 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c87bb1-e915-4c74-9fb1-ecb74188af77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:05:35.981929 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c87bb1-e915-4c74-9fb1-ecb74188af77 admin admin] PATH_INFO: `/v3/users/eaa62b68f6704652b48d08fcba5e4798` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:05:35.983134 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c87bb1-e915-4c74-9fb1-ecb74188af77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaa62b68f6704652b48d08fcba5e4798)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:05:35.985100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c87bb1-e915-4c74-9fb1-ecb74188af77 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:05:36.152290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-19c87bb1-e915-4c74-9fb1-ecb74188af77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaa62b68f6704652b48d08fcba5e4798'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:05:36.152937 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-19c87bb1-e915-4c74-9fb1-ecb74188af77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaa62b68f6704652b48d08fcba5e4798'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:05:36.241486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-19c87bb1-e915-4c74-9fb1-ecb74188af77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaa62b68f6704652b48d08fcba5e4798'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:05:36.242090 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-19c87bb1-e915-4c74-9fb1-ecb74188af77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaa62b68f6704652b48d08fcba5e4798'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:05:36.254932 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-19c87bb1-e915-4c74-9fb1-ecb74188af77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaa62b68f6704652b48d08fcba5e4798'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:05:36.267155 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1290/2589] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:05:35 2022] DELETE /identity/v3/users/eaa62b68f6704652b48d08fcba5e4798 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:05:36.495408 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf965ac-7fe6-44e6-9082-f49bab84b848 service placement] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:05:36.506188 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf965ac-7fe6-44e6-9082-f49bab84b848 service placement] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:05:36.565529 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf804aa7-f0bf-48ad-8d94-a6c2dbde08f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:05:36.566407 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf804aa7-f0bf-48ad-8d94-a6c2dbde08f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:05:36.566694 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf804aa7-f0bf-48ad-8d94-a6c2dbde08f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:05:36.566973 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf804aa7-f0bf-48ad-8d94-a6c2dbde08f3 admin admin] PATH_INFO: `/v3/projects/d1b55c4096154398912c80d62bc2430b` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:05:36.568186 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf804aa7-f0bf-48ad-8d94-a6c2dbde08f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b55c4096154398912c80d62bc2430b)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:05:36.570094 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf804aa7-f0bf-48ad-8d94-a6c2dbde08f3 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:05:36.670985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-cf804aa7-f0bf-48ad-8d94-a6c2dbde08f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b55c4096154398912c80d62bc2430b', 'request_id': 'req-cf804aa7-f0bf-48ad-8d94-a6c2dbde08f3'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:05:36.721783 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-cf804aa7-f0bf-48ad-8d94-a6c2dbde08f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b55c4096154398912c80d62bc2430b', 'request_id': 'req-cf804aa7-f0bf-48ad-8d94-a6c2dbde08f3'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:05:36.728567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-cf804aa7-f0bf-48ad-8d94-a6c2dbde08f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b55c4096154398912c80d62bc2430b', 'request_id': 'req-cf804aa7-f0bf-48ad-8d94-a6c2dbde08f3'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:05:36.739009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-cf804aa7-f0bf-48ad-8d94-a6c2dbde08f3 admin admin] The token cache is being invalidate because project d1b55c4096154398912c80d62bc2430b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:05:36.739236 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-cf804aa7-f0bf-48ad-8d94-a6c2dbde08f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:05:36.739847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-cf804aa7-f0bf-48ad-8d94-a6c2dbde08f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:05:36.741434 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1300/2590] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:05:36 2022] DELETE /identity/v3/projects/d1b55c4096154398912c80d62bc2430b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:05:46.263660 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:05:46.735793 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:06:05.683153 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c87bb1-e915-4c74-9fb1-ecb74188af77 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:06:05.684742 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-19c87bb1-e915-4c74-9fb1-ecb74188af77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:06:05.758100 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c87bb1-e915-4c74-9fb1-ecb74188af77 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:06:05.821287 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34202638-f7d0-459f-bdfb-d92ee5a3740f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:06:05.821942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34202638-f7d0-459f-bdfb-d92ee5a3740f service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:06:05.822225 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34202638-f7d0-459f-bdfb-d92ee5a3740f service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:06:05.822500 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34202638-f7d0-459f-bdfb-d92ee5a3740f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:06:05.824315 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-34202638-f7d0-459f-bdfb-d92ee5a3740f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:06:05.880667 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34202638-f7d0-459f-bdfb-d92ee5a3740f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:06:05.882830 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34202638-f7d0-459f-bdfb-d92ee5a3740f service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:06:05.891769 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1291/2591] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:06:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:06:15.887570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=84 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:06:39.242352 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf804aa7-f0bf-48ad-8d94-a6c2dbde08f3 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:06:39.243887 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-cf804aa7-f0bf-48ad-8d94-a6c2dbde08f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:06:39.300611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf804aa7-f0bf-48ad-8d94-a6c2dbde08f3 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:06:39.304047 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5663102-5eb8-45ec-b4df-a70e6991cd36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:06:39.304713 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5663102-5eb8-45ec-b4df-a70e6991cd36 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:06:39.305043 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5663102-5eb8-45ec-b4df-a70e6991cd36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:06:39.305346 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5663102-5eb8-45ec-b4df-a70e6991cd36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:06:39.307112 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f5663102-5eb8-45ec-b4df-a70e6991cd36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:06:39.367591 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5663102-5eb8-45ec-b4df-a70e6991cd36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:06:39.369061 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5663102-5eb8-45ec-b4df-a70e6991cd36 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:06:39.378595 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1301/2592] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:06:43.016344 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34202638-f7d0-459f-bdfb-d92ee5a3740f service nova] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:06:43.021193 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-34202638-f7d0-459f-bdfb-d92ee5a3740f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:06:43.032849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34202638-f7d0-459f-bdfb-d92ee5a3740f service nova] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:06:43.037637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c42eb-8551-4a8e-9636-d4bb8810c4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:06:43.038501 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c42eb-8551-4a8e-9636-d4bb8810c4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:06:43.038784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c42eb-8551-4a8e-9636-d4bb8810c4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:06:43.039079 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c42eb-8551-4a8e-9636-d4bb8810c4ea admin admin] PATH_INFO: `/v3/users/276147f205ae43da9df678dcd572115a` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:06:43.040303 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c42eb-8551-4a8e-9636-d4bb8810c4ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=276147f205ae43da9df678dcd572115a)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:06:43.042215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c42eb-8551-4a8e-9636-d4bb8810c4ea admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:06:43.202672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-b90c42eb-8551-4a8e-9636-d4bb8810c4ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '276147f205ae43da9df678dcd572115a'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:06:43.203351 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-b90c42eb-8551-4a8e-9636-d4bb8810c4ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '276147f205ae43da9df678dcd572115a'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:06:43.257764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-b90c42eb-8551-4a8e-9636-d4bb8810c4ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '276147f205ae43da9df678dcd572115a'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:06:43.258322 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-b90c42eb-8551-4a8e-9636-d4bb8810c4ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '276147f205ae43da9df678dcd572115a'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:06:43.270959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-b90c42eb-8551-4a8e-9636-d4bb8810c4ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '276147f205ae43da9df678dcd572115a'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:06:43.282985 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1292/2593] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:06:43 2022] DELETE /identity/v3/users/276147f205ae43da9df678dcd572115a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:06:43.546894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5663102-5eb8-45ec-b4df-a70e6991cd36 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:06:43.563367 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5663102-5eb8-45ec-b4df-a70e6991cd36 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:06:43.620171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc602a0a-ad63-4991-ad11-d8b50d865f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:06:43.621033 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc602a0a-ad63-4991-ad11-d8b50d865f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:06:43.621323 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc602a0a-ad63-4991-ad11-d8b50d865f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:06:43.621606 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc602a0a-ad63-4991-ad11-d8b50d865f03 admin admin] PATH_INFO: `/v3/projects/47bd5d8cddc94945b967b114d49f086c` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:06:43.622852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc602a0a-ad63-4991-ad11-d8b50d865f03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47bd5d8cddc94945b967b114d49f086c)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:06:43.624877 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc602a0a-ad63-4991-ad11-d8b50d865f03 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:06:43.720636 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fc602a0a-ad63-4991-ad11-d8b50d865f03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47bd5d8cddc94945b967b114d49f086c', 'request_id': 'req-fc602a0a-ad63-4991-ad11-d8b50d865f03'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:06:43.723032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:06:43.795571 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fc602a0a-ad63-4991-ad11-d8b50d865f03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47bd5d8cddc94945b967b114d49f086c', 'request_id': 'req-fc602a0a-ad63-4991-ad11-d8b50d865f03'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:06:43.801987 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fc602a0a-ad63-4991-ad11-d8b50d865f03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47bd5d8cddc94945b967b114d49f086c', 'request_id': 'req-fc602a0a-ad63-4991-ad11-d8b50d865f03'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:06:43.812976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fc602a0a-ad63-4991-ad11-d8b50d865f03 admin admin] The token cache is being invalidate because project 47bd5d8cddc94945b967b114d49f086c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:06:43.813269 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fc602a0a-ad63-4991-ad11-d8b50d865f03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:06:43.813908 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fc602a0a-ad63-4991-ad11-d8b50d865f03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:06:43.815435 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1302/2594] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:06:43 2022] DELETE /identity/v3/projects/47bd5d8cddc94945b967b114d49f086c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:06:43.820386 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576bad2-8b5f-417c-888c-10b8a9572b3a None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:06:43.820678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576bad2-8b5f-417c-888c-10b8a9572b3a None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:06:43.820959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576bad2-8b5f-417c-888c-10b8a9572b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:06:43.838555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-0576bad2-8b5f-417c-888c-10b8a9572b3a None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:06:43.840614 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0576bad2-8b5f-417c-888c-10b8a9572b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:06:43.898193 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1293/2595] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:06:43.905967 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b04b8d-7bfc-4528-b69b-fcf5043a2515 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:06:43.906264 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b04b8d-7bfc-4528-b69b-fcf5043a2515 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:06:43.906552 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b04b8d-7bfc-4528-b69b-fcf5043a2515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:06:43.925693 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-48b04b8d-7bfc-4528-b69b-fcf5043a2515 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:06:43.926926 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-48b04b8d-7bfc-4528-b69b-fcf5043a2515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:06:43.935420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1303/2596] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:06:43.939603 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576bad2-8b5f-417c-888c-10b8a9572b3a None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:06:43.949107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576bad2-8b5f-417c-888c-10b8a9572b3a None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:06:43.953598 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03337f73-570a-49d4-b05b-504bafbbc47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:06:43.954513 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03337f73-570a-49d4-b05b-504bafbbc47e admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:06:43.954801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03337f73-570a-49d4-b05b-504bafbbc47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:06:43.955081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03337f73-570a-49d4-b05b-504bafbbc47e admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:06:43.955832 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03337f73-570a-49d4-b05b-504bafbbc47e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:06:43.956170 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03337f73-570a-49d4-b05b-504bafbbc47e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:06:43.957760 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03337f73-570a-49d4-b05b-504bafbbc47e admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:06:43.969433 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1294/2597] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:06:43.973619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b04b8d-7bfc-4528-b69b-fcf5043a2515 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:06:43.983328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b04b8d-7bfc-4528-b69b-fcf5043a2515 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:06:43.988023 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef66cf-0902-4337-8fbe-165b94076834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:06:43.988687 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef66cf-0902-4337-8fbe-165b94076834 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:06:43.988969 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef66cf-0902-4337-8fbe-165b94076834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:06:43.989412 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef66cf-0902-4337-8fbe-165b94076834 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:06:43.989919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef66cf-0902-4337-8fbe-165b94076834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:06:43.991808 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef66cf-0902-4337-8fbe-165b94076834 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:06:44.083969 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1304/2598] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:06:43 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:06:44.091566 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03337f73-570a-49d4-b05b-504bafbbc47e admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:06:44.101864 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03337f73-570a-49d4-b05b-504bafbbc47e admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:06:44.157607 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e9c11-eb07-4b7f-a080-eddeecd9ed9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:06:44.158322 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e9c11-eb07-4b7f-a080-eddeecd9ed9e admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:06:44.158638 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e9c11-eb07-4b7f-a080-eddeecd9ed9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:06:44.158950 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e9c11-eb07-4b7f-a080-eddeecd9ed9e admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:06:44.160027 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e9c11-eb07-4b7f-a080-eddeecd9ed9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:06:44.162657 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e9c11-eb07-4b7f-a080-eddeecd9ed9e admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:06:44.169317 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:06:44.224376 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1295/2599] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:06:44 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:06:44.229133 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef66cf-0902-4337-8fbe-165b94076834 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:06:44.239585 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef66cf-0902-4337-8fbe-165b94076834 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:06:44.244326 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b2e22-1d89-418d-b5ce-54d10a75f3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:06:44.244985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b2e22-1d89-418d-b5ce-54d10a75f3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:06:44.245270 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b2e22-1d89-418d-b5ce-54d10a75f3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:06:44.245548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b2e22-1d89-418d-b5ce-54d10a75f3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:06:44.246358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b2e22-1d89-418d-b5ce-54d10a75f3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:06:44.247959 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b2e22-1d89-418d-b5ce-54d10a75f3a0 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:06:44.258170 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1305/2600] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:06:44.261959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e9c11-eb07-4b7f-a080-eddeecd9ed9e admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:06:44.272065 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e9c11-eb07-4b7f-a080-eddeecd9ed9e admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:06:44.277255 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb837e6-0380-4094-84bf-ccf7ac16a8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:06:44.277904 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb837e6-0380-4094-84bf-ccf7ac16a8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:06:44.278189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb837e6-0380-4094-84bf-ccf7ac16a8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:06:44.278498 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb837e6-0380-4094-84bf-ccf7ac16a8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:06:44.279263 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb837e6-0380-4094-84bf-ccf7ac16a8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:06:44.280911 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb837e6-0380-4094-84bf-ccf7ac16a8a0 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:06:44.292279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1296/2601] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:06:44.296129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b2e22-1d89-418d-b5ce-54d10a75f3a0 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:06:44.305958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b2e22-1d89-418d-b5ce-54d10a75f3a0 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:06:44.310483 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1ec13-e7cf-4e77-8a6f-64b5503d3e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:06:44.311334 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1ec13-e7cf-4e77-8a6f-64b5503d3e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:06:44.311635 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1ec13-e7cf-4e77-8a6f-64b5503d3e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:06:44.311890 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1ec13-e7cf-4e77-8a6f-64b5503d3e52 admin admin] PATH_INFO: `/v3/projects/8d5f63bad73c4a89b604c29290e4143f/users/afd423384efd459babccf3ff34214973/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:06:44.328308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1ec13-e7cf-4e77-8a6f-64b5503d3e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d5f63bad73c4a89b604c29290e4143f, user_id=afd423384efd459babccf3ff34214973, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:06:44.330930 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1ec13-e7cf-4e77-8a6f-64b5503d3e52 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:06:44.401741 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1306/2602] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:06:44 2022] PUT /identity/v3/projects/8d5f63bad73c4a89b604c29290e4143f/users/afd423384efd459babccf3ff34214973/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:06:44.406743 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4dd74-f8f9-4c2a-a21d-83dcd05a05d9 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:06:44.407058 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4dd74-f8f9-4c2a-a21d-83dcd05a05d9 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:06:44.407378 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4dd74-f8f9-4c2a-a21d-83dcd05a05d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:06:44.426318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-65b4dd74-f8f9-4c2a-a21d-83dcd05a05d9 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:06:44.427527 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-65b4dd74-f8f9-4c2a-a21d-83dcd05a05d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:06:44.485763 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1297/2603] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:06:44.495379 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1ec13-e7cf-4e77-8a6f-64b5503d3e52 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:06:44.497158 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-91c1ec13-e7cf-4e77-8a6f-64b5503d3e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:06:44.552873 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1ec13-e7cf-4e77-8a6f-64b5503d3e52 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:06:44.556440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647c673-5024-4d2b-9c3b-15361719385b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:06:44.557071 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647c673-5024-4d2b-9c3b-15361719385b service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:06:44.557351 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647c673-5024-4d2b-9c3b-15361719385b service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:06:44.557651 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647c673-5024-4d2b-9c3b-15361719385b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:06:44.566754 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647c673-5024-4d2b-9c3b-15361719385b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:06:44.568196 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647c673-5024-4d2b-9c3b-15361719385b service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:06:44.577901 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1307/2604] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:06:49.559683 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d2028-901c-4d79-b9dc-d7d19e331975 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:06:49.560276 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d2028-901c-4d79-b9dc-d7d19e331975 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:06:49.560380 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d2028-901c-4d79-b9dc-d7d19e331975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:06:49.599708 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-4f9d2028-901c-4d79-b9dc-d7d19e331975 None None] MFA Rules not processed for user `afd423384efd459babccf3ff34214973`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:06:49.600985 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-4f9d2028-901c-4d79-b9dc-d7d19e331975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:06:49.673497 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1298/2605] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:06:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:06:49.689279 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647c673-5024-4d2b-9c3b-15361719385b service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:06:49.690766 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f647c673-5024-4d2b-9c3b-15361719385b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:06:49.767315 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647c673-5024-4d2b-9c3b-15361719385b service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:06:49.772745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179605d-f819-4345-98c7-31e91bc4e007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:06:49.773402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179605d-f819-4345-98c7-31e91bc4e007 service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:06:49.773685 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179605d-f819-4345-98c7-31e91bc4e007 service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:06:49.773958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179605d-f819-4345-98c7-31e91bc4e007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:06:49.781363 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:06:49.783856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179605d-f819-4345-98c7-31e91bc4e007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:06:49.785535 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179605d-f819-4345-98c7-31e91bc4e007 service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:06:49.795497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1308/2606] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:06:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:06:52.216203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54371b30-91ec-479f-83b1-404d05fa570d None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:06:52.216781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54371b30-91ec-479f-83b1-404d05fa570d None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:06:52.216781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54371b30-91ec-479f-83b1-404d05fa570d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:06:52.236178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-54371b30-91ec-479f-83b1-404d05fa570d None None] MFA Rules not processed for user `afd423384efd459babccf3ff34214973`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:06:52.237719 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-54371b30-91ec-479f-83b1-404d05fa570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:06:52.244997 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1299/2607] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:06:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:06:52.590806 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179605d-f819-4345-98c7-31e91bc4e007 service nova] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:06:52.600432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179605d-f819-4345-98c7-31e91bc4e007 service nova] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:06:52.604094 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94027e20-6446-43f4-9f9a-ebc0accc0e7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:06:52.604759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94027e20-6446-43f4-9f9a-ebc0accc0e7b service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:06:52.605042 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94027e20-6446-43f4-9f9a-ebc0accc0e7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:06:52.605318 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94027e20-6446-43f4-9f9a-ebc0accc0e7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:06:52.607104 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-94027e20-6446-43f4-9f9a-ebc0accc0e7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:06:52.617327 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94027e20-6446-43f4-9f9a-ebc0accc0e7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:06:52.618794 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94027e20-6446-43f4-9f9a-ebc0accc0e7b service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:06:52.626991 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1309/2608] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:06:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:07:02.230983 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:07:02.627719 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=8 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:07:03.725092 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54371b30-91ec-479f-83b1-404d05fa570d None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:07:03.726503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-54371b30-91ec-479f-83b1-404d05fa570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:07:03.796321 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54371b30-91ec-479f-83b1-404d05fa570d None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:07:03.801250 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c9d31-341d-4d02-954e-ab69240c5550 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79a71fa89446c3abbb4fdbf2c93aac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:07:03.801893 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c9d31-341d-4d02-954e-ab69240c5550 service placement] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:07:03.802179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c9d31-341d-4d02-954e-ab69240c5550 service placement] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:07:03.802459 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c9d31-341d-4d02-954e-ab69240c5550 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:07:03.804290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0f6c9d31-341d-4d02-954e-ab69240c5550 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:07:03.817491 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c9d31-341d-4d02-954e-ab69240c5550 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:07:03.819114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c9d31-341d-4d02-954e-ab69240c5550 service placement] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:07:03.830047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1300/2609] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:07:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:07:04.441863 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94027e20-6446-43f4-9f9a-ebc0accc0e7b service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:07:04.443979 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-94027e20-6446-43f4-9f9a-ebc0accc0e7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:07:04.460725 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94027e20-6446-43f4-9f9a-ebc0accc0e7b service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:07:04.466925 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32557f-77a9-41b2-967c-8b40121d190c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:07:04.469273 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32557f-77a9-41b2-967c-8b40121d190c service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:07:04.469273 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32557f-77a9-41b2-967c-8b40121d190c service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:07:04.469273 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32557f-77a9-41b2-967c-8b40121d190c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:07:04.470518 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-6c32557f-77a9-41b2-967c-8b40121d190c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:07:04.483947 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32557f-77a9-41b2-967c-8b40121d190c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:07:04.485584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32557f-77a9-41b2-967c-8b40121d190c service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:07:04.496735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1310/2610] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:07:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:07:13.826297 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=32 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:07:14.492655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=6 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:07:17.143624 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b79da5-944b-4032-9b59-714b65e385ed None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:07:17.144076 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b79da5-944b-4032-9b59-714b65e385ed None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:07:17.144204 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b79da5-944b-4032-9b59-714b65e385ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:07:17.162195 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-b4b79da5-944b-4032-9b59-714b65e385ed None None] MFA Rules not processed for user `2a0a8cfb2482466a98340adab9980d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:07:17.163325 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b4b79da5-944b-4032-9b59-714b65e385ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:07:17.217967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1301/2611] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jun 22 17:07:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:07:17.258156 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32557f-77a9-41b2-967c-8b40121d190c service nova] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:07:17.259631 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-6c32557f-77a9-41b2-967c-8b40121d190c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:07:17.327576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32557f-77a9-41b2-967c-8b40121d190c service nova] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:07:17.332626 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a34f2-532c-41b0-ad0e-0e9548d250e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861452a1dc634bf69ce630d7dcd8a2d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:07:17.333260 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a34f2-532c-41b0-ad0e-0e9548d250e8 service swift] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:07:17.333542 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a34f2-532c-41b0-ad0e-0e9548d250e8 service swift] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:07:17.333819 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a34f2-532c-41b0-ad0e-0e9548d250e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:07:17.343802 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a34f2-532c-41b0-ad0e-0e9548d250e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:07:17.345481 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a34f2-532c-41b0-ad0e-0e9548d250e8 service swift] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:07:17.355504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1311/2612] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 17:07:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 17:07:21.907358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245245c7-2718-438a-be79-3b30ac615049 None None] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:07:21.907849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245245c7-2718-438a-be79-3b30ac615049 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:07:21.908064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245245c7-2718-438a-be79-3b30ac615049 None None] PATH_INFO: `/` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:07:21.909521 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1302/2613] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 17:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 17:07:21.916439 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7029c3-5ddd-4c89-84a8-d3cc84abd847 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:07:21.916879 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7029c3-5ddd-4c89-84a8-d3cc84abd847 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:07:21.917200 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7029c3-5ddd-4c89-84a8-d3cc84abd847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:07:21.934659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-7e7029c3-5ddd-4c89-84a8-d3cc84abd847 None None] MFA Rules not processed for user `9090c22ba9f041e2a8d00750d853435a`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:07:21.936044 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-7e7029c3-5ddd-4c89-84a8-d3cc84abd847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:07:21.942490 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1312/2614] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 17:07:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:07:21.959446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245245c7-2718-438a-be79-3b30ac615049 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:07:21.969655 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-245245c7-2718-438a-be79-3b30ac615049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:07:21.975976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245245c7-2718-438a-be79-3b30ac615049 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:07:21.979545 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a2f2f-c4c1-4e31-94b3-9e4501e96f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:07:21.980148 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a2f2f-c4c1-4e31-94b3-9e4501e96f7d service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:07:21.980435 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a2f2f-c4c1-4e31-94b3-9e4501e96f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:07:21.980710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a2f2f-c4c1-4e31-94b3-9e4501e96f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:07:21.987990 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a2f2f-c4c1-4e31-94b3-9e4501e96f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:07:21.989438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a2f2f-c4c1-4e31-94b3-9e4501e96f7d service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:07:21.998768 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1303/2615] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:07:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:07:22.112784 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c497b-3d6f-450e-9e74-d6c3839a8c83 None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:07:22.113077 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c497b-3d6f-450e-9e74-d6c3839a8c83 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:07:22.113359 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c497b-3d6f-450e-9e74-d6c3839a8c83 None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:07:22.114745 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1313/2616] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 17:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 17:07:22.120134 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa20bee-4d0e-4ad1-a1b6-6b21825eb40e None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:07:22.120438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa20bee-4d0e-4ad1-a1b6-6b21825eb40e None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:07:22.120719 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa20bee-4d0e-4ad1-a1b6-6b21825eb40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:07:22.158058 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-aaa20bee-4d0e-4ad1-a1b6-6b21825eb40e None None] MFA Rules not processed for user `78e7bdfffdc84465a570d135d1d86380`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:07:22.159292 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-aaa20bee-4d0e-4ad1-a1b6-6b21825eb40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:07:22.168920 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1304/2617] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 17:07:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:07:22.179387 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c497b-3d6f-450e-9e74-d6c3839a8c83 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:07:22.190770 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c497b-3d6f-450e-9e74-d6c3839a8c83 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:07:22.194179 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083ae2d-0354-42b3-8145-12ef0d487b7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:07:22.194803 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083ae2d-0354-42b3-8145-12ef0d487b7e service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:07:22.195087 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083ae2d-0354-42b3-8145-12ef0d487b7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:07:22.195361 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083ae2d-0354-42b3-8145-12ef0d487b7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:07:22.206565 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083ae2d-0354-42b3-8145-12ef0d487b7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:07:22.207997 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083ae2d-0354-42b3-8145-12ef0d487b7e service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:07:22.221240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1314/2618] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:07:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:07:26.084200 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa20bee-4d0e-4ad1-a1b6-6b21825eb40e None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:07:26.084200 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-aaa20bee-4d0e-4ad1-a1b6-6b21825eb40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:07:26.096702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa20bee-4d0e-4ad1-a1b6-6b21825eb40e None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:07:26.101665 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb7287-9c74-4a39-9e52-d4196afab06a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79a71fa89446c3abbb4fdbf2c93aac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:07:26.102297 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb7287-9c74-4a39-9e52-d4196afab06a service placement] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:07:26.102583 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb7287-9c74-4a39-9e52-d4196afab06a service placement] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:07:26.102862 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb7287-9c74-4a39-9e52-d4196afab06a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:07:26.104694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-63eb7287-9c74-4a39-9e52-d4196afab06a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:07:26.116273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb7287-9c74-4a39-9e52-d4196afab06a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:07:26.117847 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb7287-9c74-4a39-9e52-d4196afab06a service placement] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:07:26.128797 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1305/2619] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:07:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:07:26.202796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083ae2d-0354-42b3-8145-12ef0d487b7e service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:07:26.204256 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2083ae2d-0354-42b3-8145-12ef0d487b7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:07:26.218443 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083ae2d-0354-42b3-8145-12ef0d487b7e service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:07:26.223046 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3570d-3bc5-48d5-8dab-8abf5e9a7a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:07:26.223896 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3570d-3bc5-48d5-8dab-8abf5e9a7a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:07:26.224207 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3570d-3bc5-48d5-8dab-8abf5e9a7a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:07:26.224483 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3570d-3bc5-48d5-8dab-8abf5e9a7a08 admin admin] PATH_INFO: `/v3/users/9719a17bb03b43a09dcd7bf4f019c81c` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:07:26.225665 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3570d-3bc5-48d5-8dab-8abf5e9a7a08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9719a17bb03b43a09dcd7bf4f019c81c)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:07:26.227578 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3570d-3bc5-48d5-8dab-8abf5e9a7a08 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:07:26.369407 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-f8d3570d-3bc5-48d5-8dab-8abf5e9a7a08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9719a17bb03b43a09dcd7bf4f019c81c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:07:26.376740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-f8d3570d-3bc5-48d5-8dab-8abf5e9a7a08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9719a17bb03b43a09dcd7bf4f019c81c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:07:26.377392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-f8d3570d-3bc5-48d5-8dab-8abf5e9a7a08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9719a17bb03b43a09dcd7bf4f019c81c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:07:26.388876 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-f8d3570d-3bc5-48d5-8dab-8abf5e9a7a08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9719a17bb03b43a09dcd7bf4f019c81c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:07:26.389495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-f8d3570d-3bc5-48d5-8dab-8abf5e9a7a08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9719a17bb03b43a09dcd7bf4f019c81c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:07:26.458182 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1315/2620] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:07:26 2022] DELETE /identity/v3/users/9719a17bb03b43a09dcd7bf4f019c81c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:07:26.698874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb7287-9c74-4a39-9e52-d4196afab06a service placement] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:07:26.710101 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb7287-9c74-4a39-9e52-d4196afab06a service placement] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:07:26.784037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d986cea-4168-4cac-ac93-4d8b0ad88a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:07:26.784989 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d986cea-4168-4cac-ac93-4d8b0ad88a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:07:26.785270 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d986cea-4168-4cac-ac93-4d8b0ad88a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:07:26.785548 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d986cea-4168-4cac-ac93-4d8b0ad88a34 admin admin] PATH_INFO: `/v3/projects/fb2f9e80471c4d6b93febc9534cb9be6` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:07:26.787289 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d986cea-4168-4cac-ac93-4d8b0ad88a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb2f9e80471c4d6b93febc9534cb9be6)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:07:26.789289 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d986cea-4168-4cac-ac93-4d8b0ad88a34 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:07:26.892890 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-5d986cea-4168-4cac-ac93-4d8b0ad88a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb2f9e80471c4d6b93febc9534cb9be6', 'request_id': 'req-5d986cea-4168-4cac-ac93-4d8b0ad88a34'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:07:26.971682 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-5d986cea-4168-4cac-ac93-4d8b0ad88a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb2f9e80471c4d6b93febc9534cb9be6', 'request_id': 'req-5d986cea-4168-4cac-ac93-4d8b0ad88a34'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:07:26.976235 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:07:26.978509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-5d986cea-4168-4cac-ac93-4d8b0ad88a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb2f9e80471c4d6b93febc9534cb9be6', 'request_id': 'req-5d986cea-4168-4cac-ac93-4d8b0ad88a34'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:07:26.990431 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-5d986cea-4168-4cac-ac93-4d8b0ad88a34 admin admin] The token cache is being invalidate because project fb2f9e80471c4d6b93febc9534cb9be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:07:26.990720 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-5d986cea-4168-4cac-ac93-4d8b0ad88a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:07:26.991380 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-5d986cea-4168-4cac-ac93-4d8b0ad88a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:07:26.992975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1306/2621] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:07:26 2022] DELETE /identity/v3/projects/fb2f9e80471c4d6b93febc9534cb9be6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:07:26.996896 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3570d-3bc5-48d5-8dab-8abf5e9a7a08 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:07:26.998328 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f8d3570d-3bc5-48d5-8dab-8abf5e9a7a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:07:27.013132 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3570d-3bc5-48d5-8dab-8abf5e9a7a08 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:07:27.056558 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:07:27.072524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c28b6-eed8-4d30-92eb-fba31ecfad65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:07:27.073847 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c28b6-eed8-4d30-92eb-fba31ecfad65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:07:27.074125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c28b6-eed8-4d30-92eb-fba31ecfad65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:07:27.079842 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c28b6-eed8-4d30-92eb-fba31ecfad65 admin admin] PATH_INFO: `/v3/users/bf4dc9441c3c4080874712d9f9522089` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:07:27.079842 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c28b6-eed8-4d30-92eb-fba31ecfad65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf4dc9441c3c4080874712d9f9522089)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:07:27.079842 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c28b6-eed8-4d30-92eb-fba31ecfad65 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:07:27.283788 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-719c28b6-eed8-4d30-92eb-fba31ecfad65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf4dc9441c3c4080874712d9f9522089'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:07:27.290625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-719c28b6-eed8-4d30-92eb-fba31ecfad65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf4dc9441c3c4080874712d9f9522089'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:07:27.291292 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-719c28b6-eed8-4d30-92eb-fba31ecfad65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf4dc9441c3c4080874712d9f9522089'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:07:27.302652 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-719c28b6-eed8-4d30-92eb-fba31ecfad65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf4dc9441c3c4080874712d9f9522089'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:07:27.305973 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-719c28b6-eed8-4d30-92eb-fba31ecfad65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf4dc9441c3c4080874712d9f9522089'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:07:27.382498 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1316/2622] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:07:26 2022] DELETE /identity/v3/users/bf4dc9441c3c4080874712d9f9522089 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:07:27.654319 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d986cea-4168-4cac-ac93-4d8b0ad88a34 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:07:27.655971 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-5d986cea-4168-4cac-ac93-4d8b0ad88a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:07:27.668884 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d986cea-4168-4cac-ac93-4d8b0ad88a34 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:07:27.725685 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c86510-68f7-4bea-a9d8-91f36649fbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:07:27.726540 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c86510-68f7-4bea-a9d8-91f36649fbd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:07:27.726849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c86510-68f7-4bea-a9d8-91f36649fbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:07:27.727123 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c86510-68f7-4bea-a9d8-91f36649fbd9 admin admin] PATH_INFO: `/v3/projects/ba769b4f49d94b66a81859b409ae59cd` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:07:27.728366 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c86510-68f7-4bea-a9d8-91f36649fbd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba769b4f49d94b66a81859b409ae59cd)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:07:27.730298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c86510-68f7-4bea-a9d8-91f36649fbd9 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:07:27.829663 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-01c86510-68f7-4bea-a9d8-91f36649fbd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba769b4f49d94b66a81859b409ae59cd', 'request_id': 'req-01c86510-68f7-4bea-a9d8-91f36649fbd9'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:07:27.898284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-01c86510-68f7-4bea-a9d8-91f36649fbd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba769b4f49d94b66a81859b409ae59cd', 'request_id': 'req-01c86510-68f7-4bea-a9d8-91f36649fbd9'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:07:27.903855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-01c86510-68f7-4bea-a9d8-91f36649fbd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba769b4f49d94b66a81859b409ae59cd', 'request_id': 'req-01c86510-68f7-4bea-a9d8-91f36649fbd9'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:07:27.914854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-01c86510-68f7-4bea-a9d8-91f36649fbd9 admin admin] The token cache is being invalidate because project ba769b4f49d94b66a81859b409ae59cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:07:27.915136 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-01c86510-68f7-4bea-a9d8-91f36649fbd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:07:27.915768 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-01c86510-68f7-4bea-a9d8-91f36649fbd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:07:27.917333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1307/2623] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:07:27 2022] DELETE /identity/v3/projects/ba769b4f49d94b66a81859b409ae59cd => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:07:37.457358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=34,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:07:37.911665 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:DELETE=8,keystone:SELECT=55,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:07:38.117030 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9929ec-518e-457c-bf53-7a6fe1bdbf05 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:07:38.117030 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9929ec-518e-457c-bf53-7a6fe1bdbf05 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:07:38.117030 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9929ec-518e-457c-bf53-7a6fe1bdbf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:07:38.133906 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-4f9929ec-518e-457c-bf53-7a6fe1bdbf05 None None] MFA Rules not processed for user `7c35fb18d4f44f26a6a0939503da0b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:07:38.135099 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-4f9929ec-518e-457c-bf53-7a6fe1bdbf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:07:38.188663 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1317/2624] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:07:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:07:48.181830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=25 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:08:45.591223 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d3c9d-7fe5-458f-9395-f839133dc08a None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:08:45.591758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d3c9d-7fe5-458f-9395-f839133dc08a None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:08:45.591910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d3c9d-7fe5-458f-9395-f839133dc08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:08:45.609936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-be2d3c9d-7fe5-458f-9395-f839133dc08a None None] MFA Rules not processed for user `2a0a8cfb2482466a98340adab9980d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:08:45.611124 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-be2d3c9d-7fe5-458f-9395-f839133dc08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:08:45.665636 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1308/2625] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 17:08:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:08:45.799522 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9929ec-518e-457c-bf53-7a6fe1bdbf05 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:08:45.800973 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-4f9929ec-518e-457c-bf53-7a6fe1bdbf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:08:45.872221 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9929ec-518e-457c-bf53-7a6fe1bdbf05 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:08:45.877111 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e42e98-55ce-4fd3-9a35-398c16ebcada service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861452a1dc634bf69ce630d7dcd8a2d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:08:45.877751 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e42e98-55ce-4fd3-9a35-398c16ebcada service swift] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:08:45.878037 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e42e98-55ce-4fd3-9a35-398c16ebcada service swift] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:08:45.878317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e42e98-55ce-4fd3-9a35-398c16ebcada service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:08:45.886222 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e42e98-55ce-4fd3-9a35-398c16ebcada service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:08:45.887802 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e42e98-55ce-4fd3-9a35-398c16ebcada service swift] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:08:45.895793 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1318/2626] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 17:08:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 17:08:49.939302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d3c9d-7fe5-458f-9395-f839133dc08a None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:08:49.942095 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-be2d3c9d-7fe5-458f-9395-f839133dc08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:08:50.009042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d3c9d-7fe5-458f-9395-f839133dc08a None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:08:50.013131 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f81f33-033c-4bcb-a647-dfeec943f34e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:08:50.014923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f81f33-033c-4bcb-a647-dfeec943f34e service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:08:50.014923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f81f33-033c-4bcb-a647-dfeec943f34e service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:08:50.014923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f81f33-033c-4bcb-a647-dfeec943f34e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:08:50.016376 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-05f81f33-033c-4bcb-a647-dfeec943f34e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:08:50.104809 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f81f33-033c-4bcb-a647-dfeec943f34e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:08:50.106254 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f81f33-033c-4bcb-a647-dfeec943f34e service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:08:50.122542 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1309/2627] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:08:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:08:51.324399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e42e98-55ce-4fd3-9a35-398c16ebcada service swift] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:08:51.326039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-10e42e98-55ce-4fd3-9a35-398c16ebcada service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:08:51.338744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e42e98-55ce-4fd3-9a35-398c16ebcada service swift] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:08:51.343680 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512bc5c-9b5d-4d13-a4b2-40b37151f810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:08:51.344577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512bc5c-9b5d-4d13-a4b2-40b37151f810 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:08:51.344868 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512bc5c-9b5d-4d13-a4b2-40b37151f810 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:08:51.345156 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512bc5c-9b5d-4d13-a4b2-40b37151f810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:08:51.347068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-b512bc5c-9b5d-4d13-a4b2-40b37151f810 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:08:51.361671 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b512bc5c-9b5d-4d13-a4b2-40b37151f810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:08:51.363170 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b512bc5c-9b5d-4d13-a4b2-40b37151f810 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:08:51.376437 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1319/2628] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:08:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:09:00.116316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=79 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:09:01.370546 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=38 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:09:02.134509 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f81f33-033c-4bcb-a647-dfeec943f34e service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:09:02.143679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f81f33-033c-4bcb-a647-dfeec943f34e service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:09:02.147403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed32bb-cc2e-4a17-94f2-8a790dcd8b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:09:02.148038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed32bb-cc2e-4a17-94f2-8a790dcd8b39 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:09:02.148353 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed32bb-cc2e-4a17-94f2-8a790dcd8b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:09:02.148635 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed32bb-cc2e-4a17-94f2-8a790dcd8b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:09:02.150419 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e9ed32bb-cc2e-4a17-94f2-8a790dcd8b39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:09:02.160856 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed32bb-cc2e-4a17-94f2-8a790dcd8b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:09:02.162276 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed32bb-cc2e-4a17-94f2-8a790dcd8b39 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:09:02.170616 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1310/2629] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:09:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:09:02.436933 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f719e-dff9-4f45-9ea0-92c2f052688e None None] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:09:02.437497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f719e-dff9-4f45-9ea0-92c2f052688e None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:09:02.437646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f719e-dff9-4f45-9ea0-92c2f052688e None None] PATH_INFO: `/` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:09:02.439101 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1320/2630] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jun 22 17:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 22 17:09:02.443997 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200704d-cc7f-4c69-a914-ff0bd2a9a704 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:09:02.444378 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200704d-cc7f-4c69-a914-ff0bd2a9a704 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:09:02.444726 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200704d-cc7f-4c69-a914-ff0bd2a9a704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:09:02.463662 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-8200704d-cc7f-4c69-a914-ff0bd2a9a704 None None] MFA Rules not processed for user `78e7bdfffdc84465a570d135d1d86380`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:09:02.465045 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-8200704d-cc7f-4c69-a914-ff0bd2a9a704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:09:02.474738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1311/2631] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jun 22 17:09:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:09:02.486361 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f719e-dff9-4f45-9ea0-92c2f052688e None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:09:02.488050 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-a12f719e-dff9-4f45-9ea0-92c2f052688e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:09:02.546242 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f719e-dff9-4f45-9ea0-92c2f052688e None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:09:02.549684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57daffd-9ac6-4620-b045-df538975aae5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '144e0074ab4d4e5c8743e4f7d68a89b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:09:02.550316 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57daffd-9ac6-4620-b045-df538975aae5 service glance] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:09:02.550598 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57daffd-9ac6-4620-b045-df538975aae5 service glance] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:09:02.550875 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57daffd-9ac6-4620-b045-df538975aae5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:09:02.561180 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57daffd-9ac6-4620-b045-df538975aae5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:09:02.562601 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57daffd-9ac6-4620-b045-df538975aae5 service glance] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:09:02.573578 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1321/2632] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:09:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:09:02.935986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200704d-cc7f-4c69-a914-ff0bd2a9a704 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:09:02.937391 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-8200704d-cc7f-4c69-a914-ff0bd2a9a704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:09:03.004075 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200704d-cc7f-4c69-a914-ff0bd2a9a704 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:09:03.009135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995a858-a811-4b61-9674-c1a4376c473d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79a71fa89446c3abbb4fdbf2c93aac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:09:03.009786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995a858-a811-4b61-9674-c1a4376c473d service placement] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:09:03.010070 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995a858-a811-4b61-9674-c1a4376c473d service placement] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:09:03.010350 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995a858-a811-4b61-9674-c1a4376c473d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:09:03.012212 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0995a858-a811-4b61-9674-c1a4376c473d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:09:03.023816 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995a858-a811-4b61-9674-c1a4376c473d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:09:03.025987 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995a858-a811-4b61-9674-c1a4376c473d service placement] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:09:03.035331 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1312/2633] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:09:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:09:06.563809 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5ecfd-ae0d-4e77-9997-0624ce2a5216 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:09:06.564323 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5ecfd-ae0d-4e77-9997-0624ce2a5216 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:09:06.564441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5ecfd-ae0d-4e77-9997-0624ce2a5216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:09:06.582413 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-9bd5ecfd-ae0d-4e77-9997-0624ce2a5216 None None] MFA Rules not processed for user `2a0a8cfb2482466a98340adab9980d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:09:06.583617 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-9bd5ecfd-ae0d-4e77-9997-0624ce2a5216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:09:06.591268 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1322/2634] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 17:09:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:09:06.602829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995a858-a811-4b61-9674-c1a4376c473d service placement] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:09:06.613893 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995a858-a811-4b61-9674-c1a4376c473d service placement] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:09:06.618829 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4edbb7-4fb2-4eaf-870d-39bc16dafb0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861452a1dc634bf69ce630d7dcd8a2d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:09:06.619396 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4edbb7-4fb2-4eaf-870d-39bc16dafb0f service swift] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:09:06.619677 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4edbb7-4fb2-4eaf-870d-39bc16dafb0f service swift] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:09:06.619953 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4edbb7-4fb2-4eaf-870d-39bc16dafb0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:09:06.627798 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4edbb7-4fb2-4eaf-870d-39bc16dafb0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:09:06.629401 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4edbb7-4fb2-4eaf-870d-39bc16dafb0f service swift] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:09:06.637809 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1313/2635] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 17:09:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 17:09:14.826002 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5ecfd-ae0d-4e77-9997-0624ce2a5216 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:09:14.836608 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5ecfd-ae0d-4e77-9997-0624ce2a5216 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:09:14.840286 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c9876-29c1-4dc9-94e8-01aa4ec918eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:09:14.840932 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c9876-29c1-4dc9-94e8-01aa4ec918eb service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:09:14.841216 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c9876-29c1-4dc9-94e8-01aa4ec918eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:09:14.841494 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c9876-29c1-4dc9-94e8-01aa4ec918eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:09:14.843302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-774c9876-29c1-4dc9-94e8-01aa4ec918eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:09:14.904659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c9876-29c1-4dc9-94e8-01aa4ec918eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:09:14.906112 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c9876-29c1-4dc9-94e8-01aa4ec918eb service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:09:14.916980 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1323/2636] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:09:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:09:16.634104 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=47 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:09:19.785894 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4edbb7-4fb2-4eaf-870d-39bc16dafb0f service swift] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:09:19.802590 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4edbb7-4fb2-4eaf-870d-39bc16dafb0f service swift] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:09:19.810201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c8a4d-cfce-49a8-9463-a926ff05b6f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:09:19.810201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c8a4d-cfce-49a8-9463-a926ff05b6f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:09:19.810201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c8a4d-cfce-49a8-9463-a926ff05b6f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:09:19.810201 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c8a4d-cfce-49a8-9463-a926ff05b6f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:09:19.811106 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-122c8a4d-cfce-49a8-9463-a926ff05b6f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:09:19.821002 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c8a4d-cfce-49a8-9463-a926ff05b6f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:09:19.822413 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c8a4d-cfce-49a8-9463-a926ff05b6f1 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:09:19.831293 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1314/2637] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:09:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:09:24.624481 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c9876-29c1-4dc9-94e8-01aa4ec918eb service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:09:24.633154 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c9876-29c1-4dc9-94e8-01aa4ec918eb service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:09:24.636820 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dae2dd-4cf2-4358-8dfa-eb951bfb25ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:09:24.637461 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dae2dd-4cf2-4358-8dfa-eb951bfb25ec service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:09:24.637729 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dae2dd-4cf2-4358-8dfa-eb951bfb25ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:09:24.638002 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dae2dd-4cf2-4358-8dfa-eb951bfb25ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:09:24.639740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-24dae2dd-4cf2-4358-8dfa-eb951bfb25ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:09:24.703744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dae2dd-4cf2-4358-8dfa-eb951bfb25ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:09:24.705392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dae2dd-4cf2-4358-8dfa-eb951bfb25ec service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:09:24.714976 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1324/2638] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:09:29.827557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=6 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:09:32.388284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c8a4d-cfce-49a8-9463-a926ff05b6f1 service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:09:32.389760 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-122c8a4d-cfce-49a8-9463-a926ff05b6f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:09:32.404282 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c8a4d-cfce-49a8-9463-a926ff05b6f1 service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:09:32.408791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27270a6-5ade-42f8-b069-9d30621ecd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:09:32.409660 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27270a6-5ade-42f8-b069-9d30621ecd45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:09:32.409942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27270a6-5ade-42f8-b069-9d30621ecd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:09:32.410218 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27270a6-5ade-42f8-b069-9d30621ecd45 admin admin] PATH_INFO: `/v3/users/4bd8f30d0f834973a0e9f5d8dfc1a9ee` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:09:32.414047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27270a6-5ade-42f8-b069-9d30621ecd45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bd8f30d0f834973a0e9f5d8dfc1a9ee)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:09:32.414047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27270a6-5ade-42f8-b069-9d30621ecd45 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:09:32.600499 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-b27270a6-5ade-42f8-b069-9d30621ecd45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bd8f30d0f834973a0e9f5d8dfc1a9ee'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:09:32.601178 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-b27270a6-5ade-42f8-b069-9d30621ecd45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bd8f30d0f834973a0e9f5d8dfc1a9ee'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:09:32.678130 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-b27270a6-5ade-42f8-b069-9d30621ecd45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bd8f30d0f834973a0e9f5d8dfc1a9ee'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:09:32.678754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-b27270a6-5ade-42f8-b069-9d30621ecd45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bd8f30d0f834973a0e9f5d8dfc1a9ee'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:09:32.691783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-b27270a6-5ade-42f8-b069-9d30621ecd45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bd8f30d0f834973a0e9f5d8dfc1a9ee'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:09:32.703738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1315/2639] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:09:32 2022] DELETE /identity/v3/users/4bd8f30d0f834973a0e9f5d8dfc1a9ee => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:09:32.968321 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dae2dd-4cf2-4358-8dfa-eb951bfb25ec service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:09:32.973334 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=88 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:09:32.980350 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dae2dd-4cf2-4358-8dfa-eb951bfb25ec service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:09:33.043072 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5f414-191f-4b60-ae60-9af1f20e4111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:09:33.043919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5f414-191f-4b60-ae60-9af1f20e4111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:09:33.044243 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5f414-191f-4b60-ae60-9af1f20e4111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:09:33.044521 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5f414-191f-4b60-ae60-9af1f20e4111 admin admin] PATH_INFO: `/v3/projects/053f13e36c374b3ca47073594406fe26` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:09:33.045747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5f414-191f-4b60-ae60-9af1f20e4111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=053f13e36c374b3ca47073594406fe26)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:09:33.047646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5f414-191f-4b60-ae60-9af1f20e4111 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:09:33.181100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-82d5f414-191f-4b60-ae60-9af1f20e4111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '053f13e36c374b3ca47073594406fe26', 'request_id': 'req-82d5f414-191f-4b60-ae60-9af1f20e4111'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:09:33.271850 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-82d5f414-191f-4b60-ae60-9af1f20e4111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '053f13e36c374b3ca47073594406fe26', 'request_id': 'req-82d5f414-191f-4b60-ae60-9af1f20e4111'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:09:33.279100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-82d5f414-191f-4b60-ae60-9af1f20e4111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '053f13e36c374b3ca47073594406fe26', 'request_id': 'req-82d5f414-191f-4b60-ae60-9af1f20e4111'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:09:33.289739 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-82d5f414-191f-4b60-ae60-9af1f20e4111 admin admin] The token cache is being invalidate because project 053f13e36c374b3ca47073594406fe26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:09:33.290028 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-82d5f414-191f-4b60-ae60-9af1f20e4111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:09:33.290648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-82d5f414-191f-4b60-ae60-9af1f20e4111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:09:33.292804 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1325/2640] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:09:32 2022] DELETE /identity/v3/projects/053f13e36c374b3ca47073594406fe26 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:09:33.296751 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27270a6-5ade-42f8-b069-9d30621ecd45 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:09:33.298206 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b27270a6-5ade-42f8-b069-9d30621ecd45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:09:33.311224 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27270a6-5ade-42f8-b069-9d30621ecd45 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:09:33.368615 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a679b45-0c92-48bd-b467-3ba183fe2ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:09:33.369487 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a679b45-0c92-48bd-b467-3ba183fe2ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:09:33.369768 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a679b45-0c92-48bd-b467-3ba183fe2ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:09:33.370042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a679b45-0c92-48bd-b467-3ba183fe2ebd admin admin] PATH_INFO: `/v3/users/d5cbcd6e9dac46f0a9e1117e2573b90e` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:09:33.371238 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a679b45-0c92-48bd-b467-3ba183fe2ebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5cbcd6e9dac46f0a9e1117e2573b90e)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:09:33.373189 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a679b45-0c92-48bd-b467-3ba183fe2ebd admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:09:33.482522 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae858bb4-39df-4a05-b366-312ece93d703 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:09:33.482522 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae858bb4-39df-4a05-b366-312ece93d703 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:09:33.482522 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae858bb4-39df-4a05-b366-312ece93d703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:09:33.500695 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-ae858bb4-39df-4a05-b366-312ece93d703 None None] MFA Rules not processed for user `2a0a8cfb2482466a98340adab9980d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:09:33.501912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-ae858bb4-39df-4a05-b366-312ece93d703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:09:33.552038 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0a679b45-0c92-48bd-b467-3ba183fe2ebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5cbcd6e9dac46f0a9e1117e2573b90e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:09:33.553340 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0a679b45-0c92-48bd-b467-3ba183fe2ebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5cbcd6e9dac46f0a9e1117e2573b90e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:09:33.562001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1326/2641] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jun 22 17:09:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:09:33.574641 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae858bb4-39df-4a05-b366-312ece93d703 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:09:33.579711 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-ae858bb4-39df-4a05-b366-312ece93d703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:09:33.616116 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:09:33.638203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0a679b45-0c92-48bd-b467-3ba183fe2ebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5cbcd6e9dac46f0a9e1117e2573b90e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:09:33.638953 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0a679b45-0c92-48bd-b467-3ba183fe2ebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5cbcd6e9dac46f0a9e1117e2573b90e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:09:33.649205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae858bb4-39df-4a05-b366-312ece93d703 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:09:33.652656 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b147f-76df-4ad8-aa16-bfa16543aafa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861452a1dc634bf69ce630d7dcd8a2d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:09:33.653423 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b147f-76df-4ad8-aa16-bfa16543aafa service swift] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:09:33.653795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b147f-76df-4ad8-aa16-bfa16543aafa service swift] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:09:33.654076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b147f-76df-4ad8-aa16-bfa16543aafa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:09:33.654436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0a679b45-0c92-48bd-b467-3ba183fe2ebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5cbcd6e9dac46f0a9e1117e2573b90e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:09:33.656544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:09:33.664721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b147f-76df-4ad8-aa16-bfa16543aafa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:09:33.666405 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b147f-76df-4ad8-aa16-bfa16543aafa service swift] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:09:33.676439 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1327/2643] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 17:09:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 22 17:09:33.677416 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1316/2643] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:09:33 2022] DELETE /identity/v3/users/d5cbcd6e9dac46f0a9e1117e2573b90e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:09:33.914613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b147f-76df-4ad8-aa16-bfa16543aafa service swift] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:09:33.916037 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-333b147f-76df-4ad8-aa16-bfa16543aafa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:09:33.934226 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b147f-76df-4ad8-aa16-bfa16543aafa service swift] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:09:33.990200 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d41083-4df6-4d17-819b-784ffbd3602b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:09:33.991048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d41083-4df6-4d17-819b-784ffbd3602b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:09:33.991336 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d41083-4df6-4d17-819b-784ffbd3602b admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:09:33.991612 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d41083-4df6-4d17-819b-784ffbd3602b admin admin] PATH_INFO: `/v3/projects/a0929cf097964bf3a874fab0abc20a6b` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:09:33.992808 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d41083-4df6-4d17-819b-784ffbd3602b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0929cf097964bf3a874fab0abc20a6b)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:09:33.995234 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d41083-4df6-4d17-819b-784ffbd3602b admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:09:34.118486 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c4d41083-4df6-4d17-819b-784ffbd3602b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0929cf097964bf3a874fab0abc20a6b', 'request_id': 'req-c4d41083-4df6-4d17-819b-784ffbd3602b'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:09:34.224514 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c4d41083-4df6-4d17-819b-784ffbd3602b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0929cf097964bf3a874fab0abc20a6b', 'request_id': 'req-c4d41083-4df6-4d17-819b-784ffbd3602b'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:09:34.231825 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c4d41083-4df6-4d17-819b-784ffbd3602b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0929cf097964bf3a874fab0abc20a6b', 'request_id': 'req-c4d41083-4df6-4d17-819b-784ffbd3602b'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:09:34.242431 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c4d41083-4df6-4d17-819b-784ffbd3602b admin admin] The token cache is being invalidate because project a0929cf097964bf3a874fab0abc20a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:09:34.242707 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c4d41083-4df6-4d17-819b-784ffbd3602b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:09:34.243336 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-c4d41083-4df6-4d17-819b-784ffbd3602b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:09:34.245940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1328/2644] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:09:33 2022] DELETE /identity/v3/projects/a0929cf097964bf3a874fab0abc20a6b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:09:44.001107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=4 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:09:44.239229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:09:57.099243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a679b45-0c92-48bd-b467-3ba183fe2ebd admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:09:57.100711 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0a679b45-0c92-48bd-b467-3ba183fe2ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:09:57.155917 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a679b45-0c92-48bd-b467-3ba183fe2ebd admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:09:57.202011 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831f278-7589-4fc2-af13-52f3f186beb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:09:57.202586 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831f278-7589-4fc2-af13-52f3f186beb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:09:57.202868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831f278-7589-4fc2-af13-52f3f186beb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:09:57.203783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831f278-7589-4fc2-af13-52f3f186beb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:09:57.205559 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0831f278-7589-4fc2-af13-52f3f186beb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:09:57.264820 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831f278-7589-4fc2-af13-52f3f186beb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:09:57.266834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831f278-7589-4fc2-af13-52f3f186beb2 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:09:57.276290 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1317/2645] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:10:00.893882 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d41083-4df6-4d17-819b-784ffbd3602b admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:10:00.895575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c4d41083-4df6-4d17-819b-784ffbd3602b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:10:00.911252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d41083-4df6-4d17-819b-784ffbd3602b admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:10:00.916168 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5f96f-717d-47a5-85cc-1e7e7609686a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:10:00.916974 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5f96f-717d-47a5-85cc-1e7e7609686a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:10:00.917260 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5f96f-717d-47a5-85cc-1e7e7609686a admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:10:00.917540 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5f96f-717d-47a5-85cc-1e7e7609686a admin admin] PATH_INFO: `/v3/users/7c35fb18d4f44f26a6a0939503da0b0e` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:10:00.918739 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5f96f-717d-47a5-85cc-1e7e7609686a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c35fb18d4f44f26a6a0939503da0b0e)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:10:00.920713 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5f96f-717d-47a5-85cc-1e7e7609686a admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:10:01.151461 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-edf5f96f-717d-47a5-85cc-1e7e7609686a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c35fb18d4f44f26a6a0939503da0b0e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:10:01.158397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-edf5f96f-717d-47a5-85cc-1e7e7609686a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c35fb18d4f44f26a6a0939503da0b0e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:10:01.159178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-edf5f96f-717d-47a5-85cc-1e7e7609686a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c35fb18d4f44f26a6a0939503da0b0e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:10:01.171168 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-edf5f96f-717d-47a5-85cc-1e7e7609686a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c35fb18d4f44f26a6a0939503da0b0e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:10:01.172368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-edf5f96f-717d-47a5-85cc-1e7e7609686a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c35fb18d4f44f26a6a0939503da0b0e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:10:01.259521 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1329/2646] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:10:00 2022] DELETE /identity/v3/users/7c35fb18d4f44f26a6a0939503da0b0e => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:10:01.501836 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831f278-7589-4fc2-af13-52f3f186beb2 service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:10:01.512877 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831f278-7589-4fc2-af13-52f3f186beb2 service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:10:01.585561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918fe3b-57a6-499d-96c8-3962c36e7f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:10:01.585561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918fe3b-57a6-499d-96c8-3962c36e7f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:10:01.585561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918fe3b-57a6-499d-96c8-3962c36e7f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:10:01.585561 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918fe3b-57a6-499d-96c8-3962c36e7f0e admin admin] PATH_INFO: `/v3/projects/0cdd096da8704dd3bc211b07e7f1f27e` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:10:01.586074 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918fe3b-57a6-499d-96c8-3962c36e7f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cdd096da8704dd3bc211b07e7f1f27e)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:10:01.587753 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918fe3b-57a6-499d-96c8-3962c36e7f0e admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:10:01.597764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=100 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:10:01.683579 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f918fe3b-57a6-499d-96c8-3962c36e7f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cdd096da8704dd3bc211b07e7f1f27e', 'request_id': 'req-f918fe3b-57a6-499d-96c8-3962c36e7f0e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:10:01.774281 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f918fe3b-57a6-499d-96c8-3962c36e7f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cdd096da8704dd3bc211b07e7f1f27e', 'request_id': 'req-f918fe3b-57a6-499d-96c8-3962c36e7f0e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:10:01.780717 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f918fe3b-57a6-499d-96c8-3962c36e7f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cdd096da8704dd3bc211b07e7f1f27e', 'request_id': 'req-f918fe3b-57a6-499d-96c8-3962c36e7f0e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:10:01.792936 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f918fe3b-57a6-499d-96c8-3962c36e7f0e admin admin] The token cache is being invalidate because project 0cdd096da8704dd3bc211b07e7f1f27e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:10:01.793223 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f918fe3b-57a6-499d-96c8-3962c36e7f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:10:01.793870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f918fe3b-57a6-499d-96c8-3962c36e7f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:10:01.795404 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1318/2647] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:10:01 2022] DELETE /identity/v3/projects/0cdd096da8704dd3bc211b07e7f1f27e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:10:01.800540 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335955d-de75-4648-9894-e10c43efc077 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:10:01.800937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335955d-de75-4648-9894-e10c43efc077 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:10:01.801225 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335955d-de75-4648-9894-e10c43efc077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:10:01.819205 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-9335955d-de75-4648-9894-e10c43efc077 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:10:01.820428 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-9335955d-de75-4648-9894-e10c43efc077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:10:01.878027 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1330/2648] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:10:01.886024 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf2ea6-1e3b-4eb7-9181-50f5c6f445e3 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:10:01.886312 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf2ea6-1e3b-4eb7-9181-50f5c6f445e3 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:10:01.886590 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf2ea6-1e3b-4eb7-9181-50f5c6f445e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:10:01.905302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-93cf2ea6-1e3b-4eb7-9181-50f5c6f445e3 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:10:01.907136 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-93cf2ea6-1e3b-4eb7-9181-50f5c6f445e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:10:01.915248 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1319/2649] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:10:01.919550 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335955d-de75-4648-9894-e10c43efc077 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:10:01.930054 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335955d-de75-4648-9894-e10c43efc077 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:10:01.934910 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9515d2-16be-4670-85ed-5c79b46c25f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:10:01.935562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9515d2-16be-4670-85ed-5c79b46c25f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:10:01.935865 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9515d2-16be-4670-85ed-5c79b46c25f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:10:01.936195 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9515d2-16be-4670-85ed-5c79b46c25f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:10:01.936924 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9515d2-16be-4670-85ed-5c79b46c25f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:10:01.937232 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9515d2-16be-4670-85ed-5c79b46c25f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:10:01.938886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9515d2-16be-4670-85ed-5c79b46c25f9 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:10:01.950575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1331/2650] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:10:01.955403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf2ea6-1e3b-4eb7-9181-50f5c6f445e3 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:10:01.964543 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf2ea6-1e3b-4eb7-9181-50f5c6f445e3 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:10:01.969786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e64480-a69b-4b52-b0b8-379ccf7dd64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:10:01.970426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e64480-a69b-4b52-b0b8-379ccf7dd64b admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:10:01.970738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e64480-a69b-4b52-b0b8-379ccf7dd64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:10:01.971015 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e64480-a69b-4b52-b0b8-379ccf7dd64b admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:10:01.971711 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e64480-a69b-4b52-b0b8-379ccf7dd64b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:10:01.973672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e64480-a69b-4b52-b0b8-379ccf7dd64b admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:10:02.065458 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1320/2651] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:10:01 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:10:02.069632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9515d2-16be-4670-85ed-5c79b46c25f9 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:10:02.080956 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9515d2-16be-4670-85ed-5c79b46c25f9 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:10:02.135867 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a969603-bffd-4770-95ee-0a004d6bb5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:10:02.136463 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a969603-bffd-4770-95ee-0a004d6bb5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:10:02.136752 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a969603-bffd-4770-95ee-0a004d6bb5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:10:02.137031 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a969603-bffd-4770-95ee-0a004d6bb5a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:10:02.137716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a969603-bffd-4770-95ee-0a004d6bb5a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:10:02.139635 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a969603-bffd-4770-95ee-0a004d6bb5a2 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:10:02.146666 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:10:02.234575 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1332/2652] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:10:02 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:10:02.238722 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e64480-a69b-4b52-b0b8-379ccf7dd64b admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:10:02.249228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e64480-a69b-4b52-b0b8-379ccf7dd64b admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:10:02.254569 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3c2ae-6a49-4cd5-9ff0-349ec9ddbd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:10:02.255258 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3c2ae-6a49-4cd5-9ff0-349ec9ddbd54 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:10:02.255517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3c2ae-6a49-4cd5-9ff0-349ec9ddbd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:10:02.255797 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3c2ae-6a49-4cd5-9ff0-349ec9ddbd54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:10:02.256576 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3c2ae-6a49-4cd5-9ff0-349ec9ddbd54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:10:02.258300 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3c2ae-6a49-4cd5-9ff0-349ec9ddbd54 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:10:02.269226 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1321/2653] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:10:02.273278 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a969603-bffd-4770-95ee-0a004d6bb5a2 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:10:02.283209 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a969603-bffd-4770-95ee-0a004d6bb5a2 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:10:02.288251 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207eb076-912f-43c1-bb00-a8cbed0c475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:10:02.288977 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207eb076-912f-43c1-bb00-a8cbed0c475f admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:10:02.289515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207eb076-912f-43c1-bb00-a8cbed0c475f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:10:02.289793 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207eb076-912f-43c1-bb00-a8cbed0c475f admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:10:02.290522 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207eb076-912f-43c1-bb00-a8cbed0c475f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:10:02.292162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207eb076-912f-43c1-bb00-a8cbed0c475f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:10:02.301899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1333/2654] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:10:02.305997 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3c2ae-6a49-4cd5-9ff0-349ec9ddbd54 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:10:02.316250 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3c2ae-6a49-4cd5-9ff0-349ec9ddbd54 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:10:02.320756 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03231733-c2e5-402d-bee6-6c3975b8b8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:10:02.321612 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03231733-c2e5-402d-bee6-6c3975b8b8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:10:02.321893 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03231733-c2e5-402d-bee6-6c3975b8b8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:10:02.322168 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03231733-c2e5-402d-bee6-6c3975b8b8b5 admin admin] PATH_INFO: `/v3/projects/069840ebd26e434c861568668776df52/users/05951aa9ba2344a994f9fa1aa6fdb3bf/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:10:02.336778 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03231733-c2e5-402d-bee6-6c3975b8b8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=069840ebd26e434c861568668776df52, user_id=05951aa9ba2344a994f9fa1aa6fdb3bf, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:10:02.339380 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03231733-c2e5-402d-bee6-6c3975b8b8b5 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:10:02.395615 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1322/2655] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:10:02 2022] PUT /identity/v3/projects/069840ebd26e434c861568668776df52/users/05951aa9ba2344a994f9fa1aa6fdb3bf/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:10:02.400689 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94e1b0-edfa-4262-9a34-cdd2efe592ca None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:10:02.400985 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94e1b0-edfa-4262-9a34-cdd2efe592ca None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:10:02.403727 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94e1b0-edfa-4262-9a34-cdd2efe592ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:10:02.419171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-2a94e1b0-edfa-4262-9a34-cdd2efe592ca None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:10:02.420406 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2a94e1b0-edfa-4262-9a34-cdd2efe592ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:10:02.478210 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1334/2656] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:10:02.487761 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03231733-c2e5-402d-bee6-6c3975b8b8b5 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:10:02.489551 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-03231733-c2e5-402d-bee6-6c3975b8b8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:10:02.545093 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03231733-c2e5-402d-bee6-6c3975b8b8b5 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:10:02.549416 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33e457-bb44-44e0-898e-aef08c811b22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:10:02.550053 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33e457-bb44-44e0-898e-aef08c811b22 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:10:02.550351 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33e457-bb44-44e0-898e-aef08c811b22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:10:02.550626 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33e457-bb44-44e0-898e-aef08c811b22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:10:02.559656 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33e457-bb44-44e0-898e-aef08c811b22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:10:02.561108 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33e457-bb44-44e0-898e-aef08c811b22 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:10:02.571122 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1323/2657] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:10:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:10:07.853027 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e2747-5ef4-48b0-9ba0-4448e3a4e89a None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:10:07.853882 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e2747-5ef4-48b0-9ba0-4448e3a4e89a None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:10:07.854167 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e2747-5ef4-48b0-9ba0-4448e3a4e89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:10:07.886767 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-028e2747-5ef4-48b0-9ba0-4448e3a4e89a None None] MFA Rules not processed for user `05951aa9ba2344a994f9fa1aa6fdb3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:10:07.888861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-028e2747-5ef4-48b0-9ba0-4448e3a4e89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:10:07.959559 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1335/2658] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:10:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:10:07.975597 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33e457-bb44-44e0-898e-aef08c811b22 service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:10:07.977121 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-5f33e457-bb44-44e0-898e-aef08c811b22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:10:08.029969 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:10:08.069132 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33e457-bb44-44e0-898e-aef08c811b22 service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:10:08.075234 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dc73d-a27e-4aca-8f52-06117df23543 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:10:08.075976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dc73d-a27e-4aca-8f52-06117df23543 service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:10:08.076396 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dc73d-a27e-4aca-8f52-06117df23543 service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:10:08.076753 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dc73d-a27e-4aca-8f52-06117df23543 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:10:08.085831 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dc73d-a27e-4aca-8f52-06117df23543 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:10:08.087570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dc73d-a27e-4aca-8f52-06117df23543 service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:10:08.097506 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1324/2659] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:10:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:10:10.360888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95e806-6626-4772-8e38-9d41c942fd31 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:10:10.361423 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95e806-6626-4772-8e38-9d41c942fd31 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:10:10.361423 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95e806-6626-4772-8e38-9d41c942fd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:10:10.379398 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-3f95e806-6626-4772-8e38-9d41c942fd31 None None] MFA Rules not processed for user `05951aa9ba2344a994f9fa1aa6fdb3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:10:10.380659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3f95e806-6626-4772-8e38-9d41c942fd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:10:10.387701 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1336/2660] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:10:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:10:18.457486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=18 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:10:19.252645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dc73d-a27e-4aca-8f52-06117df23543 service nova] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:10:19.263980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dc73d-a27e-4aca-8f52-06117df23543 service nova] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:10:19.270087 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bc73e-f283-4cf2-bf0e-970136dedb33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:10:19.270746 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bc73e-f283-4cf2-bf0e-970136dedb33 service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:10:19.271029 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bc73e-f283-4cf2-bf0e-970136dedb33 service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:10:19.271300 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bc73e-f283-4cf2-bf0e-970136dedb33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:10:19.273705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-cc3bc73e-f283-4cf2-bf0e-970136dedb33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:10:19.287162 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bc73e-f283-4cf2-bf0e-970136dedb33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:10:19.288732 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bc73e-f283-4cf2-bf0e-970136dedb33 service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:10:19.300980 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1325/2661] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:10:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:10:20.373935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:10:29.295670 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=6 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:10:29.655917 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95e806-6626-4772-8e38-9d41c942fd31 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:10:29.657374 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3f95e806-6626-4772-8e38-9d41c942fd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:10:29.673452 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95e806-6626-4772-8e38-9d41c942fd31 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:10:29.679602 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfcb56-6746-4b14-ab14-394bd89560e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:10:29.680409 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfcb56-6746-4b14-ab14-394bd89560e4 service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:10:29.680755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfcb56-6746-4b14-ab14-394bd89560e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:10:29.681039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfcb56-6746-4b14-ab14-394bd89560e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:10:29.682848 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-71dfcb56-6746-4b14-ab14-394bd89560e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:10:29.695938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfcb56-6746-4b14-ab14-394bd89560e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:10:29.697591 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfcb56-6746-4b14-ab14-394bd89560e4 service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:10:29.708430 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1337/2662] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:10:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:10:39.703800 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=6 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:10:41.689982 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74fe19-65cb-496d-b1f7-684ab78c6fbc None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:10:41.690465 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74fe19-65cb-496d-b1f7-684ab78c6fbc None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:10:41.690587 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74fe19-65cb-496d-b1f7-684ab78c6fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:10:41.708273 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-0d74fe19-65cb-496d-b1f7-684ab78c6fbc None None] MFA Rules not processed for user `afd423384efd459babccf3ff34214973`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:10:41.709551 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0d74fe19-65cb-496d-b1f7-684ab78c6fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:10:41.763707 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1326/2663] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:10:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:10:51.757112 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=25 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:11:57.939440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc596fbd-4c21-4e20-bb23-aa061abec443 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:11:57.945791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc596fbd-4c21-4e20-bb23-aa061abec443 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:11:57.945791 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc596fbd-4c21-4e20-bb23-aa061abec443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:11:57.966633 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-cc596fbd-4c21-4e20-bb23-aa061abec443 None None] MFA Rules not processed for user `05951aa9ba2344a994f9fa1aa6fdb3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:11:57.967953 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-cc596fbd-4c21-4e20-bb23-aa061abec443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:11:57.991256 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1338/2664] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:11:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:12:07.989278 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=15 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:12:09.610483 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74fe19-65cb-496d-b1f7-684ab78c6fbc None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:12:09.662345 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74fe19-65cb-496d-b1f7-684ab78c6fbc None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:12:09.667439 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc596fbd-4c21-4e20-bb23-aa061abec443 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:12:09.669226 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52c575-7eb8-47a3-a657-e11018a4a2c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:12:09.669367 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-cc596fbd-4c21-4e20-bb23-aa061abec443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:12:09.669466 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52c575-7eb8-47a3-a657-e11018a4a2c6 service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:12:09.669572 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52c575-7eb8-47a3-a657-e11018a4a2c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:12:09.669773 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52c575-7eb8-47a3-a657-e11018a4a2c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:12:09.672118 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-9e52c575-7eb8-47a3-a657-e11018a4a2c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:12:09.702532 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52c575-7eb8-47a3-a657-e11018a4a2c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:12:09.704381 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52c575-7eb8-47a3-a657-e11018a4a2c6 service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:12:09.716965 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1327/2665] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:12:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:12:09.785726 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc596fbd-4c21-4e20-bb23-aa061abec443 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:12:09.791408 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511af69-ec53-4f18-a47b-d13aee1f226a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79a71fa89446c3abbb4fdbf2c93aac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:12:09.792063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511af69-ec53-4f18-a47b-d13aee1f226a service placement] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:12:09.792394 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511af69-ec53-4f18-a47b-d13aee1f226a service placement] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:12:09.792677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511af69-ec53-4f18-a47b-d13aee1f226a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:12:09.794464 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f511af69-ec53-4f18-a47b-d13aee1f226a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:12:09.806586 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511af69-ec53-4f18-a47b-d13aee1f226a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:12:09.808202 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511af69-ec53-4f18-a47b-d13aee1f226a service placement] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:12:09.818681 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1339/2666] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:12:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:12:10.211516 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52c575-7eb8-47a3-a657-e11018a4a2c6 service nova] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:12:10.222611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52c575-7eb8-47a3-a657-e11018a4a2c6 service nova] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:12:10.228196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3af4c7-04b9-4618-a0c4-05b4f8bbda06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:12:10.228833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3af4c7-04b9-4618-a0c4-05b4f8bbda06 service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:12:10.229116 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3af4c7-04b9-4618-a0c4-05b4f8bbda06 service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:12:10.229435 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3af4c7-04b9-4618-a0c4-05b4f8bbda06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:12:10.231214 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-8d3af4c7-04b9-4618-a0c4-05b4f8bbda06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:12:10.243159 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3af4c7-04b9-4618-a0c4-05b4f8bbda06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:12:10.244906 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3af4c7-04b9-4618-a0c4-05b4f8bbda06 service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:12:10.254706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1328/2667] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:12:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:12:19.814178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=45 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:12:20.250479 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=33 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:12:29.419732 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750e418-58d6-4c5b-a435-58f4f7a7a290 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:12:29.420184 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750e418-58d6-4c5b-a435-58f4f7a7a290 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:12:29.420550 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750e418-58d6-4c5b-a435-58f4f7a7a290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:12:29.450781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-6750e418-58d6-4c5b-a435-58f4f7a7a290 None None] MFA Rules not processed for user `2a0a8cfb2482466a98340adab9980d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:12:29.452009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-6750e418-58d6-4c5b-a435-58f4f7a7a290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:12:29.507501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1340/2668] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 17:12:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:12:29.663500 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3af4c7-04b9-4618-a0c4-05b4f8bbda06 service nova] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:12:29.666684 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-8d3af4c7-04b9-4618-a0c4-05b4f8bbda06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:12:29.740956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3af4c7-04b9-4618-a0c4-05b4f8bbda06 service nova] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:12:29.745939 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b467b8-787f-4490-9d3e-bec64c6c7b05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861452a1dc634bf69ce630d7dcd8a2d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:12:29.747899 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b467b8-787f-4490-9d3e-bec64c6c7b05 service swift] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:12:29.747899 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b467b8-787f-4490-9d3e-bec64c6c7b05 service swift] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:12:29.747899 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b467b8-787f-4490-9d3e-bec64c6c7b05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:12:29.755932 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b467b8-787f-4490-9d3e-bec64c6c7b05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:12:29.757577 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b467b8-787f-4490-9d3e-bec64c6c7b05 service swift] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:12:29.765903 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1329/2669] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 17:12:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 17:12:39.500800 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=29 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:12:39.762539 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=32 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:12:46.192585 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750e418-58d6-4c5b-a435-58f4f7a7a290 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:12:46.211841 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750e418-58d6-4c5b-a435-58f4f7a7a290 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:12:46.215442 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed5c73-352c-4b95-9670-f0f1d158f1e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:12:46.216079 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed5c73-352c-4b95-9670-f0f1d158f1e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:12:46.216408 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed5c73-352c-4b95-9670-f0f1d158f1e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:12:46.216670 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed5c73-352c-4b95-9670-f0f1d158f1e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:12:46.218508 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-dfed5c73-352c-4b95-9670-f0f1d158f1e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:12:46.239521 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed5c73-352c-4b95-9670-f0f1d158f1e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:12:46.241009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed5c73-352c-4b95-9670-f0f1d158f1e7 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:12:46.248697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1341/2670] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:12:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:12:46.329824 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b467b8-787f-4490-9d3e-bec64c6c7b05 service swift] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:12:46.339629 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b467b8-787f-4490-9d3e-bec64c6c7b05 service swift] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:12:46.343299 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1802a9-b356-4b4a-a188-598a299d31b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:12:46.343934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1802a9-b356-4b4a-a188-598a299d31b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:12:46.344259 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1802a9-b356-4b4a-a188-598a299d31b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:12:46.344538 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1802a9-b356-4b4a-a188-598a299d31b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:12:46.346349 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-2d1802a9-b356-4b4a-a188-598a299d31b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:12:46.359824 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1802a9-b356-4b4a-a188-598a299d31b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:12:46.361268 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1802a9-b356-4b4a-a188-598a299d31b7 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:12:46.371992 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1330/2671] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:12:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:12:48.570226 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806edb4-fce2-4929-91b7-41af175cd660 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:12:48.570672 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806edb4-fce2-4929-91b7-41af175cd660 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:12:48.570766 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806edb4-fce2-4929-91b7-41af175cd660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:12:48.588051 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-2806edb4-fce2-4929-91b7-41af175cd660 None None] MFA Rules not processed for user `2a0a8cfb2482466a98340adab9980d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:12:48.589272 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2806edb4-fce2-4929-91b7-41af175cd660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:12:48.597006 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1342/2672] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jun 22 17:12:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:12:48.608507 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1802a9-b356-4b4a-a188-598a299d31b7 service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:12:48.619932 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1802a9-b356-4b4a-a188-598a299d31b7 service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:12:48.624825 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676df63-6589-49b3-9dba-632d2982155f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861452a1dc634bf69ce630d7dcd8a2d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:12:48.625467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676df63-6589-49b3-9dba-632d2982155f service swift] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:12:48.625754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676df63-6589-49b3-9dba-632d2982155f service swift] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:12:48.626035 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676df63-6589-49b3-9dba-632d2982155f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:12:48.635115 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676df63-6589-49b3-9dba-632d2982155f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:12:48.636708 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676df63-6589-49b3-9dba-632d2982155f service swift] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:12:48.645437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1331/2673] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 17:12:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 17:12:58.583198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=18 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:12:58.641422 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=12 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:13:07.903482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e3c1d-a06a-4f09-a7e9-4b5e6fd37144 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:13:07.903934 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e3c1d-a06a-4f09-a7e9-4b5e6fd37144 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:13:07.904041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e3c1d-a06a-4f09-a7e9-4b5e6fd37144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:13:07.952993 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-b55e3c1d-a06a-4f09-a7e9-4b5e6fd37144 None None] MFA Rules not processed for user `2a0a8cfb2482466a98340adab9980d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:13:07.954219 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-b55e3c1d-a06a-4f09-a7e9-4b5e6fd37144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:13:07.971237 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1343/2674] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jun 22 17:13:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:13:07.983508 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676df63-6589-49b3-9dba-632d2982155f service swift] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:13:08.004225 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676df63-6589-49b3-9dba-632d2982155f service swift] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:13:08.009251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce04f1-17a7-4d6e-b6af-d46cdb17fa67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861452a1dc634bf69ce630d7dcd8a2d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:13:08.009890 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce04f1-17a7-4d6e-b6af-d46cdb17fa67 service swift] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:13:08.010227 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce04f1-17a7-4d6e-b6af-d46cdb17fa67 service swift] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:13:08.010504 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce04f1-17a7-4d6e-b6af-d46cdb17fa67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:13:08.019095 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce04f1-17a7-4d6e-b6af-d46cdb17fa67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:13:08.020752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce04f1-17a7-4d6e-b6af-d46cdb17fa67 service swift] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:13:08.030940 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1332/2675] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jun 22 17:13:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 22 17:13:17.967822 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=18 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:13:18.027070 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=10 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:13:45.479977 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8a756-7abc-4459-bce3-97824a167584 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:13:45.480516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8a756-7abc-4459-bce3-97824a167584 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:13:45.480616 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8a756-7abc-4459-bce3-97824a167584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:13:45.499532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-01b8a756-7abc-4459-bce3-97824a167584 None None] MFA Rules not processed for user `05951aa9ba2344a994f9fa1aa6fdb3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:13:45.500796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-01b8a756-7abc-4459-bce3-97824a167584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:13:45.508094 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1344/2676] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:13:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:13:52.019037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce04f1-17a7-4d6e-b6af-d46cdb17fa67 service swift] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:13:52.020652 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-7cce04f1-17a7-4d6e-b6af-d46cdb17fa67 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:13:52.033347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce04f1-17a7-4d6e-b6af-d46cdb17fa67 service swift] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:13:52.036878 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8d28d-9985-47f4-a9c3-049ba9678b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:13:52.037508 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8d28d-9985-47f4-a9c3-049ba9678b81 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:13:52.037811 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8d28d-9985-47f4-a9c3-049ba9678b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:13:52.038114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8d28d-9985-47f4-a9c3-049ba9678b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:13:52.039831 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-34b8d28d-9985-47f4-a9c3-049ba9678b81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:13:52.065674 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8d28d-9985-47f4-a9c3-049ba9678b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:13:52.067079 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8d28d-9985-47f4-a9c3-049ba9678b81 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:13:52.087926 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1333/2677] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:13:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:13:53.257502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8a756-7abc-4459-bce3-97824a167584 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:13:53.267076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8a756-7abc-4459-bce3-97824a167584 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:13:53.270633 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433005bc-6d86-491b-b8e1-46df767c3a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:13:53.271261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433005bc-6d86-491b-b8e1-46df767c3a52 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:13:53.271547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433005bc-6d86-491b-b8e1-46df767c3a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:13:53.271823 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433005bc-6d86-491b-b8e1-46df767c3a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:13:53.273647 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-433005bc-6d86-491b-b8e1-46df767c3a52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:13:53.286693 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433005bc-6d86-491b-b8e1-46df767c3a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:13:53.288683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433005bc-6d86-491b-b8e1-46df767c3a52 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:13:53.299739 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1345/2678] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:13:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:14:02.084579 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=15 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:03.294993 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=9 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:13.923012 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8d28d-9985-47f4-a9c3-049ba9678b81 service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:13.932305 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8d28d-9985-47f4-a9c3-049ba9678b81 service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:13.935958 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a3b00-ef52-4488-a827-bec151ef9808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:13.936637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a3b00-ef52-4488-a827-bec151ef9808 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:13.941460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a3b00-ef52-4488-a827-bec151ef9808 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:13.941460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a3b00-ef52-4488-a827-bec151ef9808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:13.941460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-9d3a3b00-ef52-4488-a827-bec151ef9808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:13.972904 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a3b00-ef52-4488-a827-bec151ef9808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:13.974338 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a3b00-ef52-4488-a827-bec151ef9808 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:13.995374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1334/2679] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:14:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:14:17.428359 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433005bc-6d86-491b-b8e1-46df767c3a52 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:17.429852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-433005bc-6d86-491b-b8e1-46df767c3a52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:17.443761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433005bc-6d86-491b-b8e1-46df767c3a52 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:17.449503 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1e93d-f0e0-4b3e-80e9-4fd0e5be7814 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79a71fa89446c3abbb4fdbf2c93aac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:17.450145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1e93d-f0e0-4b3e-80e9-4fd0e5be7814 service placement] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:17.450429 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1e93d-f0e0-4b3e-80e9-4fd0e5be7814 service placement] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:17.450701 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1e93d-f0e0-4b3e-80e9-4fd0e5be7814 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:17.452504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-25c1e93d-f0e0-4b3e-80e9-4fd0e5be7814 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:17.466115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1e93d-f0e0-4b3e-80e9-4fd0e5be7814 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:17.467768 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1e93d-f0e0-4b3e-80e9-4fd0e5be7814 service placement] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:17.478648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1346/2680] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:14:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:14:17.542204 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a3b00-ef52-4488-a827-bec151ef9808 service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:17.543962 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-9d3a3b00-ef52-4488-a827-bec151ef9808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:17.556891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a3b00-ef52-4488-a827-bec151ef9808 service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:17.561636 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d97450-eab7-4f40-98cc-03b154a41ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:17.562494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d97450-eab7-4f40-98cc-03b154a41ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:17.562772 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d97450-eab7-4f40-98cc-03b154a41ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:17.563044 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d97450-eab7-4f40-98cc-03b154a41ca8 admin admin] PATH_INFO: `/v3/users/afd423384efd459babccf3ff34214973` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:17.564285 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d97450-eab7-4f40-98cc-03b154a41ca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd423384efd459babccf3ff34214973)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:17.566186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d97450-eab7-4f40-98cc-03b154a41ca8 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:17.731284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e0d97450-eab7-4f40-98cc-03b154a41ca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd423384efd459babccf3ff34214973'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:17.731856 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e0d97450-eab7-4f40-98cc-03b154a41ca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd423384efd459babccf3ff34214973'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:17.781328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e0d97450-eab7-4f40-98cc-03b154a41ca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd423384efd459babccf3ff34214973'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:17.781947 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e0d97450-eab7-4f40-98cc-03b154a41ca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd423384efd459babccf3ff34214973'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:17.795659 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e0d97450-eab7-4f40-98cc-03b154a41ca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd423384efd459babccf3ff34214973'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:17.809403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1335/2681] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:14:17 2022] DELETE /identity/v3/users/afd423384efd459babccf3ff34214973 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:14:18.024096 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1e93d-f0e0-4b3e-80e9-4fd0e5be7814 service placement] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:18.034992 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1e93d-f0e0-4b3e-80e9-4fd0e5be7814 service placement] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:18.091785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd07863-1a6f-45d1-9bbc-059a266e92c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:18.092678 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd07863-1a6f-45d1-9bbc-059a266e92c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:18.092968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd07863-1a6f-45d1-9bbc-059a266e92c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:18.093275 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd07863-1a6f-45d1-9bbc-059a266e92c3 admin admin] PATH_INFO: `/v3/projects/8d5f63bad73c4a89b604c29290e4143f` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:18.094451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd07863-1a6f-45d1-9bbc-059a266e92c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d5f63bad73c4a89b604c29290e4143f)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:18.096396 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd07863-1a6f-45d1-9bbc-059a266e92c3 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:18.197782 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4cd07863-1a6f-45d1-9bbc-059a266e92c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d5f63bad73c4a89b604c29290e4143f', 'request_id': 'req-4cd07863-1a6f-45d1-9bbc-059a266e92c3'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:18.283843 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4cd07863-1a6f-45d1-9bbc-059a266e92c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d5f63bad73c4a89b604c29290e4143f', 'request_id': 'req-4cd07863-1a6f-45d1-9bbc-059a266e92c3'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:18.290730 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4cd07863-1a6f-45d1-9bbc-059a266e92c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d5f63bad73c4a89b604c29290e4143f', 'request_id': 'req-4cd07863-1a6f-45d1-9bbc-059a266e92c3'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:18.301170 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4cd07863-1a6f-45d1-9bbc-059a266e92c3 admin admin] The token cache is being invalidate because project 8d5f63bad73c4a89b604c29290e4143f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:14:18.303564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4cd07863-1a6f-45d1-9bbc-059a266e92c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:18.303564 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-4cd07863-1a6f-45d1-9bbc-059a266e92c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:18.304315 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1347/2682] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:14:18 2022] DELETE /identity/v3/projects/8d5f63bad73c4a89b604c29290e4143f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:14:18.309317 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffdce3-e8f8-435c-a870-26b5923a5c82 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:18.309613 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffdce3-e8f8-435c-a870-26b5923a5c82 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:18.309895 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffdce3-e8f8-435c-a870-26b5923a5c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:18.364728 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-d2ffdce3-e8f8-435c-a870-26b5923a5c82 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:14:18.365923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-d2ffdce3-e8f8-435c-a870-26b5923a5c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:18.416511 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:18.425088 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1336/2683] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:14:18.432829 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb2567-cf52-4fb4-a4ab-6e9ae34d1022 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:18.438084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb2567-cf52-4fb4-a4ab-6e9ae34d1022 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:18.438084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb2567-cf52-4fb4-a4ab-6e9ae34d1022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:18.451715 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-c8fb2567-cf52-4fb4-a4ab-6e9ae34d1022 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:14:18.452948 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c8fb2567-cf52-4fb4-a4ab-6e9ae34d1022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:18.461579 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1348/2684] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:14:18.465727 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffdce3-e8f8-435c-a870-26b5923a5c82 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:18.475208 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffdce3-e8f8-435c-a870-26b5923a5c82 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:18.480397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e713483-91e3-45da-bdfb-e6acf1bc904e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:18.481042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e713483-91e3-45da-bdfb-e6acf1bc904e admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:18.481377 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e713483-91e3-45da-bdfb-e6acf1bc904e admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:18.481657 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e713483-91e3-45da-bdfb-e6acf1bc904e admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:18.482390 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e713483-91e3-45da-bdfb-e6acf1bc904e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:14:18.482745 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e713483-91e3-45da-bdfb-e6acf1bc904e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:18.484378 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e713483-91e3-45da-bdfb-e6acf1bc904e admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:18.496081 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1337/2685] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:14:18.506721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb2567-cf52-4fb4-a4ab-6e9ae34d1022 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:18.516720 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb2567-cf52-4fb4-a4ab-6e9ae34d1022 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:18.521442 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80ca91-8981-423b-860e-78e2553d58d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:18.522121 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80ca91-8981-423b-860e-78e2553d58d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:18.522929 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80ca91-8981-423b-860e-78e2553d58d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:18.523200 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80ca91-8981-423b-860e-78e2553d58d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:18.523920 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80ca91-8981-423b-860e-78e2553d58d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:18.525849 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80ca91-8981-423b-860e-78e2553d58d1 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:18.617424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1349/2686] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:14:18 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:14:18.621397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e713483-91e3-45da-bdfb-e6acf1bc904e admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:18.631259 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e713483-91e3-45da-bdfb-e6acf1bc904e admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:18.686912 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ceeaed-cc32-4ff4-8d86-82995eeb268c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:18.687568 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceeaed-cc32-4ff4-8d86-82995eeb268c admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:18.687854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceeaed-cc32-4ff4-8d86-82995eeb268c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:18.688157 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceeaed-cc32-4ff4-8d86-82995eeb268c admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:18.688858 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ceeaed-cc32-4ff4-8d86-82995eeb268c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:18.690775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ceeaed-cc32-4ff4-8d86-82995eeb268c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:18.776117 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1338/2687] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:14:18 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:14:18.780211 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80ca91-8981-423b-860e-78e2553d58d1 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:18.791500 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80ca91-8981-423b-860e-78e2553d58d1 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:18.796448 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed214aa-0528-4cf9-8023-b0eb2532f8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:18.797148 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed214aa-0528-4cf9-8023-b0eb2532f8bb admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:18.797441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed214aa-0528-4cf9-8023-b0eb2532f8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:18.797723 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed214aa-0528-4cf9-8023-b0eb2532f8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:18.798459 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed214aa-0528-4cf9-8023-b0eb2532f8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:18.800133 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed214aa-0528-4cf9-8023-b0eb2532f8bb admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:18.819894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1350/2688] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:14:18.821144 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ceeaed-cc32-4ff4-8d86-82995eeb268c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:18.831405 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ceeaed-cc32-4ff4-8d86-82995eeb268c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:18.836632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33818a-c46f-4261-a2af-b725a70bafee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:18.837344 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33818a-c46f-4261-a2af-b725a70bafee admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:18.837627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33818a-c46f-4261-a2af-b725a70bafee admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:18.837986 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33818a-c46f-4261-a2af-b725a70bafee admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:18.838749 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33818a-c46f-4261-a2af-b725a70bafee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:18.840361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33818a-c46f-4261-a2af-b725a70bafee admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:18.850678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1339/2689] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:14:18.854735 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed214aa-0528-4cf9-8023-b0eb2532f8bb admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:18.864563 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed214aa-0528-4cf9-8023-b0eb2532f8bb admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:18.869083 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1f442-c21d-4c86-8371-322ea74c2fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:18.869886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1f442-c21d-4c86-8371-322ea74c2fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:18.870164 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1f442-c21d-4c86-8371-322ea74c2fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:18.870433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1f442-c21d-4c86-8371-322ea74c2fb7 admin admin] PATH_INFO: `/v3/projects/619d0b5681cd441dbb28042b0cb8bf46/users/4fbee68a3587459b89081c9453b0fc2c/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:18.885611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1f442-c21d-4c86-8371-322ea74c2fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=619d0b5681cd441dbb28042b0cb8bf46, user_id=4fbee68a3587459b89081c9453b0fc2c, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:18.888304 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1f442-c21d-4c86-8371-322ea74c2fb7 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:18.953639 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1351/2690] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:14:18 2022] PUT /identity/v3/projects/619d0b5681cd441dbb28042b0cb8bf46/users/4fbee68a3587459b89081c9453b0fc2c/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:14:18.964735 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aafe5-cb25-43bd-b019-a00bb92014d3 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:18.965035 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aafe5-cb25-43bd-b019-a00bb92014d3 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:18.965323 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aafe5-cb25-43bd-b019-a00bb92014d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:18.992800 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-9e1aafe5-cb25-43bd-b019-a00bb92014d3 None None] MFA Rules not processed for user `4fbee68a3587459b89081c9453b0fc2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:14:18.994015 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-9e1aafe5-cb25-43bd-b019-a00bb92014d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:19.059607 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1340/2691] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:14:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:14:19.071457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1f442-c21d-4c86-8371-322ea74c2fb7 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:19.073223 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-7bf1f442-c21d-4c86-8371-322ea74c2fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:19.088173 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:19.145629 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1f442-c21d-4c86-8371-322ea74c2fb7 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:19.151710 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3b3bd-6a12-4ce7-a61b-fe7cfc547687 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:19.152391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3b3bd-6a12-4ce7-a61b-fe7cfc547687 service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:19.152683 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3b3bd-6a12-4ce7-a61b-fe7cfc547687 service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:19.152968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3b3bd-6a12-4ce7-a61b-fe7cfc547687 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:19.160638 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3b3bd-6a12-4ce7-a61b-fe7cfc547687 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:19.162227 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3b3bd-6a12-4ce7-a61b-fe7cfc547687 service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:19.172384 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1352/2692] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:14:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:14:29.056707 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=72,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:29.168041 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=28 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:29.234062 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aafe5-cb25-43bd-b019-a00bb92014d3 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:29.290944 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aafe5-cb25-43bd-b019-a00bb92014d3 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:29.296318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ee54c-fae4-4595-83d9-362bd404ac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:29.297207 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ee54c-fae4-4595-83d9-362bd404ac4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:29.297486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ee54c-fae4-4595-83d9-362bd404ac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:29.297757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ee54c-fae4-4595-83d9-362bd404ac4e admin admin] PATH_INFO: `/v3/users/4fbee68a3587459b89081c9453b0fc2c` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:29.298991 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ee54c-fae4-4595-83d9-362bd404ac4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fbee68a3587459b89081c9453b0fc2c)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:29.300974 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ee54c-fae4-4595-83d9-362bd404ac4e admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:29.463578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ce3ee54c-fae4-4595-83d9-362bd404ac4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fbee68a3587459b89081c9453b0fc2c'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:29.464259 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ce3ee54c-fae4-4595-83d9-362bd404ac4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fbee68a3587459b89081c9453b0fc2c'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:29.540702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ce3ee54c-fae4-4595-83d9-362bd404ac4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fbee68a3587459b89081c9453b0fc2c'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:29.541275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ce3ee54c-fae4-4595-83d9-362bd404ac4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fbee68a3587459b89081c9453b0fc2c'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:29.555904 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ce3ee54c-fae4-4595-83d9-362bd404ac4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fbee68a3587459b89081c9453b0fc2c'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:29.568072 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1341/2693] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:14:29 2022] DELETE /identity/v3/users/4fbee68a3587459b89081c9453b0fc2c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:14:29.572573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec908b57-f556-4523-9a71-066a7c870007 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:29.572859 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec908b57-f556-4523-9a71-066a7c870007 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:29.573135 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec908b57-f556-4523-9a71-066a7c870007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:29.591393 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-ec908b57-f556-4523-9a71-066a7c870007 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:14:29.592651 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-ec908b57-f556-4523-9a71-066a7c870007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:29.660093 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1353/2694] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:14:29.672035 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ee54c-fae4-4595-83d9-362bd404ac4e admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:29.673567 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-ce3ee54c-fae4-4595-83d9-362bd404ac4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:29.733322 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ee54c-fae4-4595-83d9-362bd404ac4e admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:29.736956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61808c0c-1402-43c1-8047-66cbc1ad1560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:29.737596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61808c0c-1402-43c1-8047-66cbc1ad1560 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:29.737882 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61808c0c-1402-43c1-8047-66cbc1ad1560 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:29.738162 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61808c0c-1402-43c1-8047-66cbc1ad1560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:29.747249 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61808c0c-1402-43c1-8047-66cbc1ad1560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:29.748729 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61808c0c-1402-43c1-8047-66cbc1ad1560 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:29.758068 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1342/2695] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:14:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:14:30.148664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec908b57-f556-4523-9a71-066a7c870007 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:30.150280 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-ec908b57-f556-4523-9a71-066a7c870007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:30.163392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec908b57-f556-4523-9a71-066a7c870007 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:30.168872 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cfbe0-d628-43e8-b095-7970bf357d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:30.169759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cfbe0-d628-43e8-b095-7970bf357d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:30.170045 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cfbe0-d628-43e8-b095-7970bf357d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:30.170319 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cfbe0-d628-43e8-b095-7970bf357d45 admin admin] PATH_INFO: `/v3/projects/619d0b5681cd441dbb28042b0cb8bf46` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:30.171549 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cfbe0-d628-43e8-b095-7970bf357d45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=619d0b5681cd441dbb28042b0cb8bf46)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:30.173571 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cfbe0-d628-43e8-b095-7970bf357d45 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:30.290678 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-216cfbe0-d628-43e8-b095-7970bf357d45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619d0b5681cd441dbb28042b0cb8bf46', 'request_id': 'req-216cfbe0-d628-43e8-b095-7970bf357d45'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:30.346896 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-216cfbe0-d628-43e8-b095-7970bf357d45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619d0b5681cd441dbb28042b0cb8bf46', 'request_id': 'req-216cfbe0-d628-43e8-b095-7970bf357d45'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:30.353595 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-216cfbe0-d628-43e8-b095-7970bf357d45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619d0b5681cd441dbb28042b0cb8bf46', 'request_id': 'req-216cfbe0-d628-43e8-b095-7970bf357d45'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:30.363895 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-216cfbe0-d628-43e8-b095-7970bf357d45 admin admin] The token cache is being invalidate because project 619d0b5681cd441dbb28042b0cb8bf46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:14:30.364209 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-216cfbe0-d628-43e8-b095-7970bf357d45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:30.364822 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-216cfbe0-d628-43e8-b095-7970bf357d45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:30.366342 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1354/2696] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:14:30 2022] DELETE /identity/v3/projects/619d0b5681cd441dbb28042b0cb8bf46 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:14:30.371733 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d273a-c28d-407d-ad72-6c930236b406 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:30.376323 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d273a-c28d-407d-ad72-6c930236b406 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:30.376323 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d273a-c28d-407d-ad72-6c930236b406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:30.389983 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-308d273a-c28d-407d-ad72-6c930236b406 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:14:30.391325 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-308d273a-c28d-407d-ad72-6c930236b406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:30.408308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:30.450263 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1343/2697] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:14:30.457842 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961b1aa-bfa6-4e0f-ad69-5cf83ceff728 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:30.458168 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961b1aa-bfa6-4e0f-ad69-5cf83ceff728 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:30.458452 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961b1aa-bfa6-4e0f-ad69-5cf83ceff728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:30.476857 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-d961b1aa-bfa6-4e0f-ad69-5cf83ceff728 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:14:30.482903 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d961b1aa-bfa6-4e0f-ad69-5cf83ceff728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:30.486375 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1355/2698] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:14:30.490524 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d273a-c28d-407d-ad72-6c930236b406 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:30.500188 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d273a-c28d-407d-ad72-6c930236b406 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:30.504708 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf90f1b-45c5-4a88-8a46-a2817d319989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:30.505356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf90f1b-45c5-4a88-8a46-a2817d319989 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:30.505640 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf90f1b-45c5-4a88-8a46-a2817d319989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:30.505923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf90f1b-45c5-4a88-8a46-a2817d319989 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:30.506652 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf90f1b-45c5-4a88-8a46-a2817d319989 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:14:30.506983 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf90f1b-45c5-4a88-8a46-a2817d319989 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:30.508606 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf90f1b-45c5-4a88-8a46-a2817d319989 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:30.520047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1344/2699] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:14:30.523921 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961b1aa-bfa6-4e0f-ad69-5cf83ceff728 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:30.533853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961b1aa-bfa6-4e0f-ad69-5cf83ceff728 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:30.538457 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008c224-a066-4f7f-9494-e89b408eb9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:30.539094 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008c224-a066-4f7f-9494-e89b408eb9ce admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:30.539376 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008c224-a066-4f7f-9494-e89b408eb9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:30.539653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008c224-a066-4f7f-9494-e89b408eb9ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:30.540374 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008c224-a066-4f7f-9494-e89b408eb9ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:30.542253 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008c224-a066-4f7f-9494-e89b408eb9ce admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:30.611615 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1356/2700] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:14:30 2022] POST /identity/v3/projects => generated 367 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:14:30.615764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf90f1b-45c5-4a88-8a46-a2817d319989 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:30.625807 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf90f1b-45c5-4a88-8a46-a2817d319989 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:30.688575 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68857cf1-5ce5-4aa3-9113-ba1ae116a60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:30.689161 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68857cf1-5ce5-4aa3-9113-ba1ae116a60d admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:30.689449 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68857cf1-5ce5-4aa3-9113-ba1ae116a60d admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:30.689729 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68857cf1-5ce5-4aa3-9113-ba1ae116a60d admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:30.690428 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68857cf1-5ce5-4aa3-9113-ba1ae116a60d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:30.692343 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68857cf1-5ce5-4aa3-9113-ba1ae116a60d admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:30.764722 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1345/2701] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:14:30 2022] POST /identity/v3/users => generated 284 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:14:30.768938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008c224-a066-4f7f-9494-e89b408eb9ce admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:30.779682 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008c224-a066-4f7f-9494-e89b408eb9ce admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:30.784476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c7a5b-2d50-45bb-85d5-94d2978f4c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:30.785139 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c7a5b-2d50-45bb-85d5-94d2978f4c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:30.785426 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c7a5b-2d50-45bb-85d5-94d2978f4c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:30.785705 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c7a5b-2d50-45bb-85d5-94d2978f4c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:30.786470 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c7a5b-2d50-45bb-85d5-94d2978f4c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:30.788261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c7a5b-2d50-45bb-85d5-94d2978f4c80 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:30.798916 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1357/2702] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:14:30.806923 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68857cf1-5ce5-4aa3-9113-ba1ae116a60d admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:30.816869 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68857cf1-5ce5-4aa3-9113-ba1ae116a60d admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:30.821459 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c659ee7-79a0-478d-ae66-478900a785ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:30.822104 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c659ee7-79a0-478d-ae66-478900a785ba admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:30.822386 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c659ee7-79a0-478d-ae66-478900a785ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:30.822664 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c659ee7-79a0-478d-ae66-478900a785ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:30.823395 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c659ee7-79a0-478d-ae66-478900a785ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:30.825535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c659ee7-79a0-478d-ae66-478900a785ba admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:30.835559 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1346/2703] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:14:30.839558 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c7a5b-2d50-45bb-85d5-94d2978f4c80 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:30.852917 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c7a5b-2d50-45bb-85d5-94d2978f4c80 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:30.862029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f98e25-e9d5-42ea-a609-2eb62d1d8806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:30.862935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f98e25-e9d5-42ea-a609-2eb62d1d8806 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:30.863201 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f98e25-e9d5-42ea-a609-2eb62d1d8806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:30.863481 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f98e25-e9d5-42ea-a609-2eb62d1d8806 admin admin] PATH_INFO: `/v3/projects/1d4ecdefce024dac849d7c8f26bb9ec8/users/edf1c5e88679479cbea7aedab45f3424/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:30.878610 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f98e25-e9d5-42ea-a609-2eb62d1d8806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d4ecdefce024dac849d7c8f26bb9ec8, user_id=edf1c5e88679479cbea7aedab45f3424, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:30.881336 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f98e25-e9d5-42ea-a609-2eb62d1d8806 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:30.963514 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1358/2704] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:14:30 2022] PUT /identity/v3/projects/1d4ecdefce024dac849d7c8f26bb9ec8/users/edf1c5e88679479cbea7aedab45f3424/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:14:30.975511 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadc4a5-6254-4a9a-bfae-eb45dce48a51 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:30.975806 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadc4a5-6254-4a9a-bfae-eb45dce48a51 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:30.976134 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadc4a5-6254-4a9a-bfae-eb45dce48a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:31.001865 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-7dadc4a5-6254-4a9a-bfae-eb45dce48a51 None None] MFA Rules not processed for user `edf1c5e88679479cbea7aedab45f3424`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:14:31.003199 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-7dadc4a5-6254-4a9a-bfae-eb45dce48a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:31.066971 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1347/2705] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:14:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:14:31.078515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f98e25-e9d5-42ea-a609-2eb62d1d8806 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:31.080792 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-55f98e25-e9d5-42ea-a609-2eb62d1d8806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:31.102481 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:31.156844 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f98e25-e9d5-42ea-a609-2eb62d1d8806 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:31.160917 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde09a7-d551-4de3-8bba-79a737358ecf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:31.161550 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde09a7-d551-4de3-8bba-79a737358ecf service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:31.161831 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde09a7-d551-4de3-8bba-79a737358ecf service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:31.162108 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde09a7-d551-4de3-8bba-79a737358ecf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:31.170496 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde09a7-d551-4de3-8bba-79a737358ecf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:31.172233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde09a7-d551-4de3-8bba-79a737358ecf service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:31.180497 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1359/2706] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:14:31 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:14:40.800929 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadc4a5-6254-4a9a-bfae-eb45dce48a51 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:40.819358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:40.863258 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadc4a5-6254-4a9a-bfae-eb45dce48a51 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:40.867742 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac199d-b732-4e63-8efe-aa8e0d294ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:40.868639 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac199d-b732-4e63-8efe-aa8e0d294ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:40.868919 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac199d-b732-4e63-8efe-aa8e0d294ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:40.869194 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac199d-b732-4e63-8efe-aa8e0d294ee0 admin admin] PATH_INFO: `/v3/users/edf1c5e88679479cbea7aedab45f3424` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:40.870385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac199d-b732-4e63-8efe-aa8e0d294ee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edf1c5e88679479cbea7aedab45f3424)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:40.872316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac199d-b732-4e63-8efe-aa8e0d294ee0 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:41.074620 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-d2ac199d-b732-4e63-8efe-aa8e0d294ee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edf1c5e88679479cbea7aedab45f3424'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:41.075203 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-d2ac199d-b732-4e63-8efe-aa8e0d294ee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edf1c5e88679479cbea7aedab45f3424'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:41.152265 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-d2ac199d-b732-4e63-8efe-aa8e0d294ee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edf1c5e88679479cbea7aedab45f3424'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:41.153460 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-d2ac199d-b732-4e63-8efe-aa8e0d294ee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edf1c5e88679479cbea7aedab45f3424'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:41.165609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-d2ac199d-b732-4e63-8efe-aa8e0d294ee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edf1c5e88679479cbea7aedab45f3424'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:41.178004 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1348/2707] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:14:40 2022] DELETE /identity/v3/users/edf1c5e88679479cbea7aedab45f3424 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:14:41.182635 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166ba44-9d88-4264-b7a3-47313d56c070 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:41.183101 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166ba44-9d88-4264-b7a3-47313d56c070 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:41.183234 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166ba44-9d88-4264-b7a3-47313d56c070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:41.200660 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-e166ba44-9d88-4264-b7a3-47313d56c070 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:14:41.201880 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e166ba44-9d88-4264-b7a3-47313d56c070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:41.258501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1360/2708] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:14:41.268608 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac199d-b732-4e63-8efe-aa8e0d294ee0 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:41.270054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-d2ac199d-b732-4e63-8efe-aa8e0d294ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:41.327590 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac199d-b732-4e63-8efe-aa8e0d294ee0 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:41.331116 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b4ee9-864a-4c1b-a394-77adb5c0ee1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:41.331781 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b4ee9-864a-4c1b-a394-77adb5c0ee1c service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:41.332068 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b4ee9-864a-4c1b-a394-77adb5c0ee1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:41.332383 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b4ee9-864a-4c1b-a394-77adb5c0ee1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:41.341959 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b4ee9-864a-4c1b-a394-77adb5c0ee1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:41.343413 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b4ee9-864a-4c1b-a394-77adb5c0ee1c service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:41.353013 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1349/2709] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:14:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:14:41.788666 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166ba44-9d88-4264-b7a3-47313d56c070 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:41.790219 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e166ba44-9d88-4264-b7a3-47313d56c070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:41.802614 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166ba44-9d88-4264-b7a3-47313d56c070 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:41.807068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1833c1-58aa-4ebd-b288-c5d3b0a2cad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:41.807923 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1833c1-58aa-4ebd-b288-c5d3b0a2cad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:41.812935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1833c1-58aa-4ebd-b288-c5d3b0a2cad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:41.812935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1833c1-58aa-4ebd-b288-c5d3b0a2cad6 admin admin] PATH_INFO: `/v3/projects/1d4ecdefce024dac849d7c8f26bb9ec8` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:41.812935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1833c1-58aa-4ebd-b288-c5d3b0a2cad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d4ecdefce024dac849d7c8f26bb9ec8)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:41.812935 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1833c1-58aa-4ebd-b288-c5d3b0a2cad6 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:41.947262 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-8d1833c1-58aa-4ebd-b288-c5d3b0a2cad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d4ecdefce024dac849d7c8f26bb9ec8', 'request_id': 'req-8d1833c1-58aa-4ebd-b288-c5d3b0a2cad6'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:42.027011 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-8d1833c1-58aa-4ebd-b288-c5d3b0a2cad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d4ecdefce024dac849d7c8f26bb9ec8', 'request_id': 'req-8d1833c1-58aa-4ebd-b288-c5d3b0a2cad6'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:42.033758 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-8d1833c1-58aa-4ebd-b288-c5d3b0a2cad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d4ecdefce024dac849d7c8f26bb9ec8', 'request_id': 'req-8d1833c1-58aa-4ebd-b288-c5d3b0a2cad6'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:42.045402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-8d1833c1-58aa-4ebd-b288-c5d3b0a2cad6 admin admin] The token cache is being invalidate because project 1d4ecdefce024dac849d7c8f26bb9ec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:14:42.045714 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-8d1833c1-58aa-4ebd-b288-c5d3b0a2cad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:42.047657 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-8d1833c1-58aa-4ebd-b288-c5d3b0a2cad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:42.047991 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1361/2710] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:14:41 2022] DELETE /identity/v3/projects/1d4ecdefce024dac849d7c8f26bb9ec8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:14:42.052884 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf9a1c-b078-4b71-9749-da94d31acc17 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:42.053358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf9a1c-b078-4b71-9749-da94d31acc17 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:42.053469 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf9a1c-b078-4b71-9749-da94d31acc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:42.071607 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-b5bf9a1c-b078-4b71-9749-da94d31acc17 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:14:42.077556 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b5bf9a1c-b078-4b71-9749-da94d31acc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:42.105391 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:42.133226 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1350/2711] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:14:42.141032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504659c-4c9d-4145-9114-c28ccfaf1822 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:42.143340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504659c-4c9d-4145-9114-c28ccfaf1822 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:42.143340 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504659c-4c9d-4145-9114-c28ccfaf1822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:42.159689 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-9504659c-4c9d-4145-9114-c28ccfaf1822 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:14:42.160927 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-9504659c-4c9d-4145-9114-c28ccfaf1822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:42.169996 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1362/2712] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:14:42.174135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf9a1c-b078-4b71-9749-da94d31acc17 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:42.183578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf9a1c-b078-4b71-9749-da94d31acc17 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:42.188697 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956bf74-6f87-4b34-bd5c-b45919effe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:42.189340 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956bf74-6f87-4b34-bd5c-b45919effe34 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:42.189620 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956bf74-6f87-4b34-bd5c-b45919effe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:42.189899 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956bf74-6f87-4b34-bd5c-b45919effe34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:42.190630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956bf74-6f87-4b34-bd5c-b45919effe34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:14:42.190937 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956bf74-6f87-4b34-bd5c-b45919effe34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:42.192643 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956bf74-6f87-4b34-bd5c-b45919effe34 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:42.204527 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1351/2713] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:14:42.208649 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504659c-4c9d-4145-9114-c28ccfaf1822 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:42.218402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504659c-4c9d-4145-9114-c28ccfaf1822 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:42.222898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17523cfa-dbe8-4b75-ab97-fe9ea2a3086f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:42.223533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17523cfa-dbe8-4b75-ab97-fe9ea2a3086f admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:42.223813 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17523cfa-dbe8-4b75-ab97-fe9ea2a3086f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:42.224262 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17523cfa-dbe8-4b75-ab97-fe9ea2a3086f admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:42.224949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17523cfa-dbe8-4b75-ab97-fe9ea2a3086f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:42.226828 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17523cfa-dbe8-4b75-ab97-fe9ea2a3086f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:42.357861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:42.365102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1363/2714] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:14:42 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:14:42.369264 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956bf74-6f87-4b34-bd5c-b45919effe34 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:42.379170 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956bf74-6f87-4b34-bd5c-b45919effe34 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:42.434515 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6740f-ee32-4ce7-adb9-3e3ce205dcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:42.435179 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6740f-ee32-4ce7-adb9-3e3ce205dcbe admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:42.435466 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6740f-ee32-4ce7-adb9-3e3ce205dcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:42.435746 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6740f-ee32-4ce7-adb9-3e3ce205dcbe admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:42.436486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6740f-ee32-4ce7-adb9-3e3ce205dcbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:42.438392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6740f-ee32-4ce7-adb9-3e3ce205dcbe admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:42.550915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1352/2715] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:14:42 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:14:42.554826 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17523cfa-dbe8-4b75-ab97-fe9ea2a3086f admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:42.565273 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17523cfa-dbe8-4b75-ab97-fe9ea2a3086f admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:42.569941 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d551e-f5d1-4653-a770-023446926900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:42.570594 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d551e-f5d1-4653-a770-023446926900 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:42.570881 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d551e-f5d1-4653-a770-023446926900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:42.571161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d551e-f5d1-4653-a770-023446926900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:42.571897 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d551e-f5d1-4653-a770-023446926900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:42.573655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d551e-f5d1-4653-a770-023446926900 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:42.588418 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1364/2716] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:14:42.592808 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6740f-ee32-4ce7-adb9-3e3ce205dcbe admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:42.602766 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6740f-ee32-4ce7-adb9-3e3ce205dcbe admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:42.607967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50b804-e8ad-4b67-af6e-165afd4eb978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:42.608651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50b804-e8ad-4b67-af6e-165afd4eb978 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:42.608942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50b804-e8ad-4b67-af6e-165afd4eb978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:42.609223 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50b804-e8ad-4b67-af6e-165afd4eb978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:42.609955 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50b804-e8ad-4b67-af6e-165afd4eb978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:42.611548 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50b804-e8ad-4b67-af6e-165afd4eb978 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:42.621518 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1353/2717] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:14:42.625553 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d551e-f5d1-4653-a770-023446926900 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:42.635420 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d551e-f5d1-4653-a770-023446926900 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:42.640495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68b5a2-3772-471a-bd02-63c149bd1c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:42.641353 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68b5a2-3772-471a-bd02-63c149bd1c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:42.641630 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68b5a2-3772-471a-bd02-63c149bd1c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:42.641903 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68b5a2-3772-471a-bd02-63c149bd1c0d admin admin] PATH_INFO: `/v3/projects/fffa824b076f4c10b614848cbd29f983/users/040114be605749bb8bd8f37c3303acd4/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:42.656579 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68b5a2-3772-471a-bd02-63c149bd1c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fffa824b076f4c10b614848cbd29f983, user_id=040114be605749bb8bd8f37c3303acd4, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:42.659204 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68b5a2-3772-471a-bd02-63c149bd1c0d admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:42.735775 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1365/2718] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:14:42 2022] PUT /identity/v3/projects/fffa824b076f4c10b614848cbd29f983/users/040114be605749bb8bd8f37c3303acd4/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:14:42.746021 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422930e4-1ae0-4c17-812a-bb327e4018f3 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:42.746325 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422930e4-1ae0-4c17-812a-bb327e4018f3 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:42.746614 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422930e4-1ae0-4c17-812a-bb327e4018f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:42.772806 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-422930e4-1ae0-4c17-812a-bb327e4018f3 None None] MFA Rules not processed for user `040114be605749bb8bd8f37c3303acd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:14:42.774022 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-422930e4-1ae0-4c17-812a-bb327e4018f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:42.837686 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1354/2719] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:14:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:14:42.842653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68b5a2-3772-471a-bd02-63c149bd1c0d admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:42.910644 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68b5a2-3772-471a-bd02-63c149bd1c0d admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:42.915332 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ce0c1-c913-4ab3-be0c-4e15d14f5ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:42.915993 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ce0c1-c913-4ab3-be0c-4e15d14f5ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:42.916305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ce0c1-c913-4ab3-be0c-4e15d14f5ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:42.916586 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ce0c1-c913-4ab3-be0c-4e15d14f5ce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:42.917287 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ce0c1-c913-4ab3-be0c-4e15d14f5ce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:42.919496 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ce0c1-c913-4ab3-be0c-4e15d14f5ce6 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:42.988919 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1366/2720] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:14:42 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:14:42.992797 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422930e4-1ae0-4c17-812a-bb327e4018f3 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:43.004146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422930e4-1ae0-4c17-812a-bb327e4018f3 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:43.036863 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:43.060919 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c5c3e-0bbd-4bad-9ba3-ee204023fa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:43.061713 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c5c3e-0bbd-4bad-9ba3-ee204023fa57 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:43.062424 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c5c3e-0bbd-4bad-9ba3-ee204023fa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:43.062705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c5c3e-0bbd-4bad-9ba3-ee204023fa57 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:43.063392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c5c3e-0bbd-4bad-9ba3-ee204023fa57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:43.065312 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c5c3e-0bbd-4bad-9ba3-ee204023fa57 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:43.140893 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1355/2721] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:14:42 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:14:43.144693 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ce0c1-c913-4ab3-be0c-4e15d14f5ce6 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:43.155592 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ce0c1-c913-4ab3-be0c-4e15d14f5ce6 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:43.160188 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60752a9c-2f05-4efd-97ab-86b6cc8e9087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:43.160848 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60752a9c-2f05-4efd-97ab-86b6cc8e9087 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:43.161134 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60752a9c-2f05-4efd-97ab-86b6cc8e9087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:43.161411 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60752a9c-2f05-4efd-97ab-86b6cc8e9087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:43.162144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60752a9c-2f05-4efd-97ab-86b6cc8e9087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:43.163744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60752a9c-2f05-4efd-97ab-86b6cc8e9087 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:43.175274 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1367/2722] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:14:43.179311 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c5c3e-0bbd-4bad-9ba3-ee204023fa57 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:43.189133 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c5c3e-0bbd-4bad-9ba3-ee204023fa57 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:43.193620 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f4fa0-d1ca-40fc-8655-4d805b30618b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:43.194471 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f4fa0-d1ca-40fc-8655-4d805b30618b admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:43.194754 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f4fa0-d1ca-40fc-8655-4d805b30618b admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:43.195029 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f4fa0-d1ca-40fc-8655-4d805b30618b admin admin] PATH_INFO: `/v3/projects/dd957be3d0d84eafb3efbb06be4040f9/users/d686d26291254bf8985da386720c7070/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:43.209753 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f4fa0-d1ca-40fc-8655-4d805b30618b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd957be3d0d84eafb3efbb06be4040f9, user_id=d686d26291254bf8985da386720c7070, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:43.212420 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f4fa0-d1ca-40fc-8655-4d805b30618b admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:43.289257 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1356/2723] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:14:43 2022] PUT /identity/v3/projects/dd957be3d0d84eafb3efbb06be4040f9/users/d686d26291254bf8985da386720c7070/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:14:43.294024 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60752a9c-2f05-4efd-97ab-86b6cc8e9087 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:43.303938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60752a9c-2f05-4efd-97ab-86b6cc8e9087 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:43.358403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c834b3-a004-4871-ac3e-c49d1209dd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:43.359068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c834b3-a004-4871-ac3e-c49d1209dd04 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:43.359360 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c834b3-a004-4871-ac3e-c49d1209dd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:43.359637 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c834b3-a004-4871-ac3e-c49d1209dd04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:43.360396 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c834b3-a004-4871-ac3e-c49d1209dd04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:43.362050 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c834b3-a004-4871-ac3e-c49d1209dd04 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:43.371755 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1368/2724] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:14:43.376007 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f4fa0-d1ca-40fc-8655-4d805b30618b admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:43.386355 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f4fa0-d1ca-40fc-8655-4d805b30618b admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:43.391587 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1309f1a-d817-46dc-8968-52c30eee8d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:43.392400 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1309f1a-d817-46dc-8968-52c30eee8d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:43.392680 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1309f1a-d817-46dc-8968-52c30eee8d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:43.392955 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1309f1a-d817-46dc-8968-52c30eee8d83 admin admin] PATH_INFO: `/v3/projects/dd957be3d0d84eafb3efbb06be4040f9/users/d686d26291254bf8985da386720c7070/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:43.394927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1309f1a-d817-46dc-8968-52c30eee8d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd957be3d0d84eafb3efbb06be4040f9, user_id=d686d26291254bf8985da386720c7070, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:43.397679 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1309f1a-d817-46dc-8968-52c30eee8d83 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:43.408496 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1357/2725] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:14:43 2022] PUT /identity/v3/projects/dd957be3d0d84eafb3efbb06be4040f9/users/d686d26291254bf8985da386720c7070/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:14:43.419950 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdadf63-5b06-4eeb-94d4-2cf1ef93114f None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:43.420286 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdadf63-5b06-4eeb-94d4-2cf1ef93114f None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:43.420578 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdadf63-5b06-4eeb-94d4-2cf1ef93114f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:43.446296 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-acdadf63-5b06-4eeb-94d4-2cf1ef93114f None None] MFA Rules not processed for user `d686d26291254bf8985da386720c7070`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:14:43.447545 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-acdadf63-5b06-4eeb-94d4-2cf1ef93114f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:43.468339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:43.514627 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1369/2726] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:14:43 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:14:43.525905 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1309f1a-d817-46dc-8968-52c30eee8d83 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:43.528263 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b1309f1a-d817-46dc-8968-52c30eee8d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:43.583692 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1309f1a-d817-46dc-8968-52c30eee8d83 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:43.587362 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7401b-f839-46b3-8942-7071ae527612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:43.587989 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7401b-f839-46b3-8942-7071ae527612 service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:43.588304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7401b-f839-46b3-8942-7071ae527612 service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:43.588578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7401b-f839-46b3-8942-7071ae527612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:43.597931 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7401b-f839-46b3-8942-7071ae527612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:43.599339 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7401b-f839-46b3-8942-7071ae527612 service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:43.608619 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1358/2727] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:14:43 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:14:44.562478 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdadf63-5b06-4eeb-94d4-2cf1ef93114f None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:44.622563 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdadf63-5b06-4eeb-94d4-2cf1ef93114f None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:44.627304 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b70931-c465-4566-a6d6-56f14ff7f7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:44.628188 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b70931-c465-4566-a6d6-56f14ff7f7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:44.628505 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b70931-c465-4566-a6d6-56f14ff7f7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:44.628783 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b70931-c465-4566-a6d6-56f14ff7f7fd admin admin] PATH_INFO: `/v3/users/040114be605749bb8bd8f37c3303acd4` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:44.630006 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b70931-c465-4566-a6d6-56f14ff7f7fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=040114be605749bb8bd8f37c3303acd4)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:44.632029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b70931-c465-4566-a6d6-56f14ff7f7fd admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:44.784014 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-10b70931-c465-4566-a6d6-56f14ff7f7fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '040114be605749bb8bd8f37c3303acd4'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:44.791036 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-10b70931-c465-4566-a6d6-56f14ff7f7fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '040114be605749bb8bd8f37c3303acd4'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:44.791760 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-10b70931-c465-4566-a6d6-56f14ff7f7fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '040114be605749bb8bd8f37c3303acd4'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:44.804747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-10b70931-c465-4566-a6d6-56f14ff7f7fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '040114be605749bb8bd8f37c3303acd4'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:44.805368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-10b70931-c465-4566-a6d6-56f14ff7f7fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '040114be605749bb8bd8f37c3303acd4'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:44.870539 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1370/2728] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:14:44 2022] DELETE /identity/v3/users/040114be605749bb8bd8f37c3303acd4 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:14:44.875035 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082acc0-5407-46be-8643-46c9461e038f None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:44.885291 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082acc0-5407-46be-8643-46c9461e038f None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:44.885291 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082acc0-5407-46be-8643-46c9461e038f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:44.893863 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-e082acc0-5407-46be-8643-46c9461e038f None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:14:44.895757 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e082acc0-5407-46be-8643-46c9461e038f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:44.955962 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1359/2729] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:14:44.965510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b70931-c465-4566-a6d6-56f14ff7f7fd admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:44.967571 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-10b70931-c465-4566-a6d6-56f14ff7f7fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:45.008571 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:45.023772 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b70931-c465-4566-a6d6-56f14ff7f7fd admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:45.028310 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd87e3-dce4-4ee5-a9b2-8efee00b913f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:45.028310 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd87e3-dce4-4ee5-a9b2-8efee00b913f service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:45.029612 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd87e3-dce4-4ee5-a9b2-8efee00b913f service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:45.029612 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd87e3-dce4-4ee5-a9b2-8efee00b913f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:45.038601 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd87e3-dce4-4ee5-a9b2-8efee00b913f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:45.040053 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd87e3-dce4-4ee5-a9b2-8efee00b913f service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:45.050394 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1371/2730] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:14:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:14:45.559689 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082acc0-5407-46be-8643-46c9461e038f None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:45.559689 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e082acc0-5407-46be-8643-46c9461e038f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:45.559689 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082acc0-5407-46be-8643-46c9461e038f None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:45.561576 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cfab1-015f-4172-9535-1901f7fbe410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:45.562438 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cfab1-015f-4172-9535-1901f7fbe410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:45.562853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cfab1-015f-4172-9535-1901f7fbe410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:45.563142 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cfab1-015f-4172-9535-1901f7fbe410 admin admin] PATH_INFO: `/v3/projects/fffa824b076f4c10b614848cbd29f983` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:45.564481 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680cfab1-015f-4172-9535-1901f7fbe410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fffa824b076f4c10b614848cbd29f983)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:45.566295 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680cfab1-015f-4172-9535-1901f7fbe410 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:45.685712 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:45.702416 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-680cfab1-015f-4172-9535-1901f7fbe410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fffa824b076f4c10b614848cbd29f983', 'request_id': 'req-680cfab1-015f-4172-9535-1901f7fbe410'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:45.803665 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-680cfab1-015f-4172-9535-1901f7fbe410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fffa824b076f4c10b614848cbd29f983', 'request_id': 'req-680cfab1-015f-4172-9535-1901f7fbe410'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:45.809196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-680cfab1-015f-4172-9535-1901f7fbe410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fffa824b076f4c10b614848cbd29f983', 'request_id': 'req-680cfab1-015f-4172-9535-1901f7fbe410'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:45.820275 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-680cfab1-015f-4172-9535-1901f7fbe410 admin admin] The token cache is being invalidate because project fffa824b076f4c10b614848cbd29f983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:14:45.820563 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-680cfab1-015f-4172-9535-1901f7fbe410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:45.825519 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-680cfab1-015f-4172-9535-1901f7fbe410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:45.825519 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1360/2731] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:14:45 2022] DELETE /identity/v3/projects/fffa824b076f4c10b614848cbd29f983 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:14:45.827298 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd87e3-dce4-4ee5-a9b2-8efee00b913f service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:45.836856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd87e3-dce4-4ee5-a9b2-8efee00b913f service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:45.891572 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9a9be-95d9-4fd6-8f6c-c94134b340f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:45.892495 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9a9be-95d9-4fd6-8f6c-c94134b340f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:45.892781 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9a9be-95d9-4fd6-8f6c-c94134b340f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:45.893062 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9a9be-95d9-4fd6-8f6c-c94134b340f9 admin admin] PATH_INFO: `/v3/users/d686d26291254bf8985da386720c7070` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:45.894261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9a9be-95d9-4fd6-8f6c-c94134b340f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d686d26291254bf8985da386720c7070)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:45.896222 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9a9be-95d9-4fd6-8f6c-c94134b340f9 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:46.116707 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-9ee9a9be-95d9-4fd6-8f6c-c94134b340f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd686d26291254bf8985da386720c7070'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:46.124093 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-9ee9a9be-95d9-4fd6-8f6c-c94134b340f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd686d26291254bf8985da386720c7070'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:46.124790 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-9ee9a9be-95d9-4fd6-8f6c-c94134b340f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd686d26291254bf8985da386720c7070'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:46.137816 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-9ee9a9be-95d9-4fd6-8f6c-c94134b340f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd686d26291254bf8985da386720c7070'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:46.138598 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-9ee9a9be-95d9-4fd6-8f6c-c94134b340f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd686d26291254bf8985da386720c7070'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:46.232189 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1372/2732] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:14:45 2022] DELETE /identity/v3/users/d686d26291254bf8985da386720c7070 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:14:46.719926 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cfab1-015f-4172-9535-1901f7fbe410 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:46.721404 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-680cfab1-015f-4172-9535-1901f7fbe410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:46.736146 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cfab1-015f-4172-9535-1901f7fbe410 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:46.792741 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea7a52-21f6-495b-a23f-3d36160ce81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:46.793853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea7a52-21f6-495b-a23f-3d36160ce81f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:46.794161 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea7a52-21f6-495b-a23f-3d36160ce81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:46.794435 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea7a52-21f6-495b-a23f-3d36160ce81f admin admin] PATH_INFO: `/v3/projects/dd957be3d0d84eafb3efbb06be4040f9` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:46.796403 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea7a52-21f6-495b-a23f-3d36160ce81f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd957be3d0d84eafb3efbb06be4040f9)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:46.798351 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea7a52-21f6-495b-a23f-3d36160ce81f admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:46.936253 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-7cea7a52-21f6-495b-a23f-3d36160ce81f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd957be3d0d84eafb3efbb06be4040f9', 'request_id': 'req-7cea7a52-21f6-495b-a23f-3d36160ce81f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:47.066704 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-7cea7a52-21f6-495b-a23f-3d36160ce81f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd957be3d0d84eafb3efbb06be4040f9', 'request_id': 'req-7cea7a52-21f6-495b-a23f-3d36160ce81f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:47.072845 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-7cea7a52-21f6-495b-a23f-3d36160ce81f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd957be3d0d84eafb3efbb06be4040f9', 'request_id': 'req-7cea7a52-21f6-495b-a23f-3d36160ce81f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:47.083979 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-7cea7a52-21f6-495b-a23f-3d36160ce81f admin admin] The token cache is being invalidate because project dd957be3d0d84eafb3efbb06be4040f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:14:47.087116 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-7cea7a52-21f6-495b-a23f-3d36160ce81f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:47.087116 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-7cea7a52-21f6-495b-a23f-3d36160ce81f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:14:47.087116 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1361/2733] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:14:46 2022] DELETE /identity/v3/projects/dd957be3d0d84eafb3efbb06be4040f9 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:14:47.093504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634846cd-36f5-43ac-8e7b-0ff2d84f4b35 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:47.094100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634846cd-36f5-43ac-8e7b-0ff2d84f4b35 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:47.094199 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634846cd-36f5-43ac-8e7b-0ff2d84f4b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:47.111573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-634846cd-36f5-43ac-8e7b-0ff2d84f4b35 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:14:47.112906 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-634846cd-36f5-43ac-8e7b-0ff2d84f4b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:47.162677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:47.170780 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1373/2734] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:14:47.184263 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddcb3c-29d4-451b-a1dd-9780abce3495 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:47.184582 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddcb3c-29d4-451b-a1dd-9780abce3495 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:47.184864 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddcb3c-29d4-451b-a1dd-9780abce3495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:47.204485 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-e7ddcb3c-29d4-451b-a1dd-9780abce3495 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:14:47.205670 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e7ddcb3c-29d4-451b-a1dd-9780abce3495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:47.213642 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1362/2735] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:14:47.218362 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634846cd-36f5-43ac-8e7b-0ff2d84f4b35 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:47.228171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634846cd-36f5-43ac-8e7b-0ff2d84f4b35 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:47.232872 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2003b1-c432-4d1c-aa2c-33f81e37bd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:47.233521 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2003b1-c432-4d1c-aa2c-33f81e37bd22 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:47.233806 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2003b1-c432-4d1c-aa2c-33f81e37bd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:47.234085 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2003b1-c432-4d1c-aa2c-33f81e37bd22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:47.234815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2003b1-c432-4d1c-aa2c-33f81e37bd22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:14:47.235128 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2003b1-c432-4d1c-aa2c-33f81e37bd22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:47.236831 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2003b1-c432-4d1c-aa2c-33f81e37bd22 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:47.248527 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1374/2736] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:14:47.252933 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddcb3c-29d4-451b-a1dd-9780abce3495 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:47.271315 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddcb3c-29d4-451b-a1dd-9780abce3495 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:47.276801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d5360-9266-4720-b790-d96186bd7112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:47.277397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d5360-9266-4720-b790-d96186bd7112 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:47.277680 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d5360-9266-4720-b790-d96186bd7112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:47.278087 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d5360-9266-4720-b790-d96186bd7112 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:47.278882 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d5360-9266-4720-b790-d96186bd7112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:47.281699 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d5360-9266-4720-b790-d96186bd7112 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:47.386797 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1363/2737] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:14:47 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:14:47.391445 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2003b1-c432-4d1c-aa2c-33f81e37bd22 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:47.401459 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2003b1-c432-4d1c-aa2c-33f81e37bd22 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:47.457929 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905ae82-0fd9-494f-9074-25b28df21065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:47.458644 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905ae82-0fd9-494f-9074-25b28df21065 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:47.458928 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905ae82-0fd9-494f-9074-25b28df21065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:47.459209 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905ae82-0fd9-494f-9074-25b28df21065 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:47.459911 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905ae82-0fd9-494f-9074-25b28df21065 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:47.461863 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905ae82-0fd9-494f-9074-25b28df21065 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:47.551858 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1375/2738] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:14:47 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:14:47.557510 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d5360-9266-4720-b790-d96186bd7112 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:47.570606 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d5360-9266-4720-b790-d96186bd7112 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:47.575409 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01bd91-8307-4c1d-94f9-bbd7997d8a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:47.576121 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01bd91-8307-4c1d-94f9-bbd7997d8a9d admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:47.576420 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01bd91-8307-4c1d-94f9-bbd7997d8a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:47.576725 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01bd91-8307-4c1d-94f9-bbd7997d8a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:47.577470 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01bd91-8307-4c1d-94f9-bbd7997d8a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:47.579054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01bd91-8307-4c1d-94f9-bbd7997d8a9d admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:47.590164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1364/2739] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:14:47.594759 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905ae82-0fd9-494f-9074-25b28df21065 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:47.605129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905ae82-0fd9-494f-9074-25b28df21065 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:47.610494 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2711583-16db-4618-bf08-4fb6d4c0ce33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:47.611145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2711583-16db-4618-bf08-4fb6d4c0ce33 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:47.611433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2711583-16db-4618-bf08-4fb6d4c0ce33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:47.611714 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2711583-16db-4618-bf08-4fb6d4c0ce33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:47.612479 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2711583-16db-4618-bf08-4fb6d4c0ce33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:47.614084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2711583-16db-4618-bf08-4fb6d4c0ce33 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:47.623961 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1376/2740] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:14:47.628012 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01bd91-8307-4c1d-94f9-bbd7997d8a9d admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:47.634321 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:47.638142 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01bd91-8307-4c1d-94f9-bbd7997d8a9d admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:47.642834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f96634-7a8a-4453-bfba-2e85eca9d983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:47.646996 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f96634-7a8a-4453-bfba-2e85eca9d983 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:47.646996 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f96634-7a8a-4453-bfba-2e85eca9d983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:47.646996 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f96634-7a8a-4453-bfba-2e85eca9d983 admin admin] PATH_INFO: `/v3/projects/099b0e0a63034c8495b1ad69e17ce60b/users/e544cef7097541ba962bb043c8d39af4/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:47.658934 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f96634-7a8a-4453-bfba-2e85eca9d983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=099b0e0a63034c8495b1ad69e17ce60b, user_id=e544cef7097541ba962bb043c8d39af4, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:47.661624 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f96634-7a8a-4453-bfba-2e85eca9d983 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:47.746161 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1365/2741] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:14:47 2022] PUT /identity/v3/projects/099b0e0a63034c8495b1ad69e17ce60b/users/e544cef7097541ba962bb043c8d39af4/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:14:47.756301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223c784-c244-4130-95b3-14d4914a984c None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:47.756596 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223c784-c244-4130-95b3-14d4914a984c None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:47.756876 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223c784-c244-4130-95b3-14d4914a984c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:47.783142 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-e223c784-c244-4130-95b3-14d4914a984c None None] MFA Rules not processed for user `e544cef7097541ba962bb043c8d39af4`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:14:47.784412 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e223c784-c244-4130-95b3-14d4914a984c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:47.847321 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1377/2742] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:14:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:14:47.858651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f96634-7a8a-4453-bfba-2e85eca9d983 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:14:47.860347 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-d3f96634-7a8a-4453-bfba-2e85eca9d983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:14:47.939645 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f96634-7a8a-4453-bfba-2e85eca9d983 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:14:47.943341 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ec36f-5860-42b6-8dbc-1b1026bb1a70 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '144e0074ab4d4e5c8743e4f7d68a89b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:14:47.943982 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ec36f-5860-42b6-8dbc-1b1026bb1a70 service glance] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:14:47.944297 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ec36f-5860-42b6-8dbc-1b1026bb1a70 service glance] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:14:47.944578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ec36f-5860-42b6-8dbc-1b1026bb1a70 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:14:47.952752 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ec36f-5860-42b6-8dbc-1b1026bb1a70 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:14:47.954169 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ec36f-5860-42b6-8dbc-1b1026bb1a70 service glance] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:14:47.962789 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1366/2743] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:14:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:14:57.844570 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=72,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:14:57.958870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:15:12.317848 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223c784-c244-4130-95b3-14d4914a984c None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:15:12.351096 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ec36f-5860-42b6-8dbc-1b1026bb1a70 service glance] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:15:12.352750 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-613ec36f-5860-42b6-8dbc-1b1026bb1a70 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:15:12.382524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223c784-c244-4130-95b3-14d4914a984c None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:15:12.388392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056c4ce-4a8c-4775-a711-2dc02fe38eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:15:12.388737 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056c4ce-4a8c-4775-a711-2dc02fe38eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:15:12.389025 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056c4ce-4a8c-4775-a711-2dc02fe38eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:15:12.389303 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056c4ce-4a8c-4775-a711-2dc02fe38eea admin admin] PATH_INFO: `/v3/users/e544cef7097541ba962bb043c8d39af4` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:15:12.390533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056c4ce-4a8c-4775-a711-2dc02fe38eea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e544cef7097541ba962bb043c8d39af4)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:15:12.392501 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056c4ce-4a8c-4775-a711-2dc02fe38eea admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:15:12.409828 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ec36f-5860-42b6-8dbc-1b1026bb1a70 service glance] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:15:12.413459 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8eb08f-eb6b-46be-8db8-98e421b08bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:15:12.416770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8eb08f-eb6b-46be-8db8-98e421b08bbf service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:15:12.416770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8eb08f-eb6b-46be-8db8-98e421b08bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:15:12.416770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8eb08f-eb6b-46be-8db8-98e421b08bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:15:12.416770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-8b8eb08f-eb6b-46be-8db8-98e421b08bbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:15:12.426398 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8eb08f-eb6b-46be-8db8-98e421b08bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:15:12.427823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8eb08f-eb6b-46be-8db8-98e421b08bbf service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:15:12.435803 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1367/2744] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:15:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:15:12.634795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-e056c4ce-4a8c-4775-a711-2dc02fe38eea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e544cef7097541ba962bb043c8d39af4'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:15:12.642456 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-e056c4ce-4a8c-4775-a711-2dc02fe38eea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e544cef7097541ba962bb043c8d39af4'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:15:12.643129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-e056c4ce-4a8c-4775-a711-2dc02fe38eea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e544cef7097541ba962bb043c8d39af4'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:15:12.656392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-e056c4ce-4a8c-4775-a711-2dc02fe38eea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e544cef7097541ba962bb043c8d39af4'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:15:12.657124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-e056c4ce-4a8c-4775-a711-2dc02fe38eea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e544cef7097541ba962bb043c8d39af4'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:15:12.735321 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1378/2745] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:15:12 2022] DELETE /identity/v3/users/e544cef7097541ba962bb043c8d39af4 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:15:12.739958 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58463d2d-3264-4c9f-b444-91627bc3760d None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:15:12.740283 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58463d2d-3264-4c9f-b444-91627bc3760d None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:15:12.740566 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58463d2d-3264-4c9f-b444-91627bc3760d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:15:12.758158 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-58463d2d-3264-4c9f-b444-91627bc3760d None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:15:12.759368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-58463d2d-3264-4c9f-b444-91627bc3760d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:15:12.819918 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1368/2746] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:15:12.830442 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056c4ce-4a8c-4775-a711-2dc02fe38eea admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:15:12.831881 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e056c4ce-4a8c-4775-a711-2dc02fe38eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:15:12.889403 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056c4ce-4a8c-4775-a711-2dc02fe38eea admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:15:12.892938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7966a-ecd3-4d57-b96b-0dafc1020a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:15:12.893580 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7966a-ecd3-4d57-b96b-0dafc1020a92 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:15:12.893863 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7966a-ecd3-4d57-b96b-0dafc1020a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:15:12.894138 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7966a-ecd3-4d57-b96b-0dafc1020a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:15:12.903411 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7966a-ecd3-4d57-b96b-0dafc1020a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:15:12.904871 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7966a-ecd3-4d57-b96b-0dafc1020a92 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:15:12.914807 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1379/2747] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:15:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:15:13.325352 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58463d2d-3264-4c9f-b444-91627bc3760d None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:15:13.327837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-58463d2d-3264-4c9f-b444-91627bc3760d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:15:13.341803 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58463d2d-3264-4c9f-b444-91627bc3760d None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:15:13.348402 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a51db-0bcb-484a-8858-498ae0c58a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:15:13.349783 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a51db-0bcb-484a-8858-498ae0c58a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:15:13.350316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a51db-0bcb-484a-8858-498ae0c58a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:15:13.350836 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a51db-0bcb-484a-8858-498ae0c58a8e admin admin] PATH_INFO: `/v3/projects/099b0e0a63034c8495b1ad69e17ce60b` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:15:13.352797 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a51db-0bcb-484a-8858-498ae0c58a8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=099b0e0a63034c8495b1ad69e17ce60b)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:15:13.354963 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a51db-0bcb-484a-8858-498ae0c58a8e admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:15:13.466707 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ba3a51db-0bcb-484a-8858-498ae0c58a8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '099b0e0a63034c8495b1ad69e17ce60b', 'request_id': 'req-ba3a51db-0bcb-484a-8858-498ae0c58a8e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:15:13.539035 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ba3a51db-0bcb-484a-8858-498ae0c58a8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '099b0e0a63034c8495b1ad69e17ce60b', 'request_id': 'req-ba3a51db-0bcb-484a-8858-498ae0c58a8e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:15:13.545740 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ba3a51db-0bcb-484a-8858-498ae0c58a8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '099b0e0a63034c8495b1ad69e17ce60b', 'request_id': 'req-ba3a51db-0bcb-484a-8858-498ae0c58a8e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:15:13.556861 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ba3a51db-0bcb-484a-8858-498ae0c58a8e admin admin] The token cache is being invalidate because project 099b0e0a63034c8495b1ad69e17ce60b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:15:13.557147 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ba3a51db-0bcb-484a-8858-498ae0c58a8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:15:13.557785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-ba3a51db-0bcb-484a-8858-498ae0c58a8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:15:13.559476 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1369/2748] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:15:13 2022] DELETE /identity/v3/projects/099b0e0a63034c8495b1ad69e17ce60b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:15:13.564690 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffbabf-8457-47c2-9d61-0d035530ab21 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:15:13.565159 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffbabf-8457-47c2-9d61-0d035530ab21 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:15:13.565267 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdffbabf-8457-47c2-9d61-0d035530ab21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:15:13.582751 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-bdffbabf-8457-47c2-9d61-0d035530ab21 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:15:13.583950 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-bdffbabf-8457-47c2-9d61-0d035530ab21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:15:13.600933 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:15:13.641863 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1380/2749] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:15:13.649683 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb310df1-8dcb-4ba1-b645-300d5b871a9b None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:15:13.649972 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb310df1-8dcb-4ba1-b645-300d5b871a9b None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:15:13.650278 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb310df1-8dcb-4ba1-b645-300d5b871a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:15:13.669143 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-fb310df1-8dcb-4ba1-b645-300d5b871a9b None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:15:13.670398 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-fb310df1-8dcb-4ba1-b645-300d5b871a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:15:13.678675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1370/2750] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:15:13.682671 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffbabf-8457-47c2-9d61-0d035530ab21 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:15:13.692974 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdffbabf-8457-47c2-9d61-0d035530ab21 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:15:13.697562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562be38c-5e45-430a-83b9-b7486001624e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:15:13.699939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562be38c-5e45-430a-83b9-b7486001624e admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:15:13.699939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562be38c-5e45-430a-83b9-b7486001624e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:15:13.699939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562be38c-5e45-430a-83b9-b7486001624e admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:15:13.699939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562be38c-5e45-430a-83b9-b7486001624e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:15:13.699939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562be38c-5e45-430a-83b9-b7486001624e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:15:13.701386 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562be38c-5e45-430a-83b9-b7486001624e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:15:13.713456 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1381/2751] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:15:13.718478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb310df1-8dcb-4ba1-b645-300d5b871a9b None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:15:13.727633 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb310df1-8dcb-4ba1-b645-300d5b871a9b None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:15:13.733248 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984e7d4-5c7b-47d0-9c48-a27610944abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:15:13.733885 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984e7d4-5c7b-47d0-9c48-a27610944abb admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:15:13.734166 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984e7d4-5c7b-47d0-9c48-a27610944abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:15:13.734439 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984e7d4-5c7b-47d0-9c48-a27610944abb admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:15:13.735399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984e7d4-5c7b-47d0-9c48-a27610944abb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:15:13.737321 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984e7d4-5c7b-47d0-9c48-a27610944abb admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:15:13.814097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:15:13.822818 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1371/2752] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:15:13 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:15:13.825704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562be38c-5e45-430a-83b9-b7486001624e admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:15:13.837554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562be38c-5e45-430a-83b9-b7486001624e admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:15:13.894677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb064a-7208-487d-a220-2f67bc60fd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:15:13.895338 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb064a-7208-487d-a220-2f67bc60fd71 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:15:13.895622 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb064a-7208-487d-a220-2f67bc60fd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:15:13.895898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb064a-7208-487d-a220-2f67bc60fd71 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:15:13.896628 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb064a-7208-487d-a220-2f67bc60fd71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:15:13.898576 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb064a-7208-487d-a220-2f67bc60fd71 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:15:14.002160 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1382/2753] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:15:13 2022] POST /identity/v3/users => generated 283 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:15:14.006194 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984e7d4-5c7b-47d0-9c48-a27610944abb admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:15:14.016881 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984e7d4-5c7b-47d0-9c48-a27610944abb admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:15:14.022087 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94621b3f-5c05-4d0c-9c28-6d8854e2c0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:15:14.025716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94621b3f-5c05-4d0c-9c28-6d8854e2c0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:15:14.025716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94621b3f-5c05-4d0c-9c28-6d8854e2c0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:15:14.025716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94621b3f-5c05-4d0c-9c28-6d8854e2c0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:15:14.025716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94621b3f-5c05-4d0c-9c28-6d8854e2c0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:15:14.025716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94621b3f-5c05-4d0c-9c28-6d8854e2c0f2 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:15:14.036624 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1372/2754] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:15:14.040562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb064a-7208-487d-a220-2f67bc60fd71 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:15:14.050942 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb064a-7208-487d-a220-2f67bc60fd71 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:15:14.055657 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b54ce9-8124-47f8-98ca-5503502d8bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:15:14.056339 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b54ce9-8124-47f8-98ca-5503502d8bfd admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:15:14.056632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b54ce9-8124-47f8-98ca-5503502d8bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:15:14.056915 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b54ce9-8124-47f8-98ca-5503502d8bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:15:14.057653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b54ce9-8124-47f8-98ca-5503502d8bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:15:14.059275 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b54ce9-8124-47f8-98ca-5503502d8bfd admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:15:14.069837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1383/2755] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:15:14.073629 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94621b3f-5c05-4d0c-9c28-6d8854e2c0f2 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:15:14.083768 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94621b3f-5c05-4d0c-9c28-6d8854e2c0f2 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:15:14.088358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2c2e1-69d3-4c0a-b787-b07067a73975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:15:14.089206 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2c2e1-69d3-4c0a-b787-b07067a73975 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:15:14.089484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2c2e1-69d3-4c0a-b787-b07067a73975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:15:14.089755 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2c2e1-69d3-4c0a-b787-b07067a73975 admin admin] PATH_INFO: `/v3/projects/f706c5a9579744f6be61163fd8831e08/users/bda8be61595f48bfb9bb060918931ac5/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:15:14.104356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2c2e1-69d3-4c0a-b787-b07067a73975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f706c5a9579744f6be61163fd8831e08, user_id=bda8be61595f48bfb9bb060918931ac5, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:15:14.106975 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2c2e1-69d3-4c0a-b787-b07067a73975 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:15:14.178819 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1373/2756] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:15:14 2022] PUT /identity/v3/projects/f706c5a9579744f6be61163fd8831e08/users/bda8be61595f48bfb9bb060918931ac5/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:15:14.189492 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598aac6d-f1c2-4a51-8478-30cae2d3558e None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:15:14.189802 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598aac6d-f1c2-4a51-8478-30cae2d3558e None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:15:14.190083 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598aac6d-f1c2-4a51-8478-30cae2d3558e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:15:14.216436 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-598aac6d-f1c2-4a51-8478-30cae2d3558e None None] MFA Rules not processed for user `bda8be61595f48bfb9bb060918931ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:15:14.217623 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-598aac6d-f1c2-4a51-8478-30cae2d3558e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:15:14.279753 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1384/2757] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:15:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:15:14.290630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2c2e1-69d3-4c0a-b787-b07067a73975 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:15:14.292349 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e0e2c2e1-69d3-4c0a-b787-b07067a73975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:15:14.350094 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2c2e1-69d3-4c0a-b787-b07067a73975 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:15:14.353684 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407583a7-6a3a-4bb9-8c0a-149127a55d1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:15:14.354323 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407583a7-6a3a-4bb9-8c0a-149127a55d1b service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:15:14.354603 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407583a7-6a3a-4bb9-8c0a-149127a55d1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:15:14.354879 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407583a7-6a3a-4bb9-8c0a-149127a55d1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:15:14.363105 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407583a7-6a3a-4bb9-8c0a-149127a55d1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:15:14.364560 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407583a7-6a3a-4bb9-8c0a-149127a55d1b service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:15:14.374230 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1374/2758] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:15:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:15:24.276938 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:15:24.369437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:15:27.804922 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598aac6d-f1c2-4a51-8478-30cae2d3558e None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:15:27.806432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-598aac6d-f1c2-4a51-8478-30cae2d3558e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:15:27.878367 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598aac6d-f1c2-4a51-8478-30cae2d3558e None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:15:27.884147 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82126bfd-bbb1-4f29-a423-14a5b774b338 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:15:27.884795 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82126bfd-bbb1-4f29-a423-14a5b774b338 service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:15:27.885081 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82126bfd-bbb1-4f29-a423-14a5b774b338 service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:15:27.885362 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82126bfd-bbb1-4f29-a423-14a5b774b338 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:15:27.887105 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-82126bfd-bbb1-4f29-a423-14a5b774b338 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:15:27.944939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82126bfd-bbb1-4f29-a423-14a5b774b338 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:15:27.946517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82126bfd-bbb1-4f29-a423-14a5b774b338 service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:15:27.956222 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1385/2759] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:15:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:15:37.951358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=56 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:15:44.989708 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407583a7-6a3a-4bb9-8c0a-149127a55d1b service cinder] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:15:44.991397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-407583a7-6a3a-4bb9-8c0a-149127a55d1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:15:45.008658 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407583a7-6a3a-4bb9-8c0a-149127a55d1b service cinder] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:15:45.014433 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f6c86-24af-436b-95e9-2b69b85cba97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:15:45.015116 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f6c86-24af-436b-95e9-2b69b85cba97 service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:15:45.015400 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f6c86-24af-436b-95e9-2b69b85cba97 service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:15:45.015685 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f6c86-24af-436b-95e9-2b69b85cba97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:15:45.017609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-576f6c86-24af-436b-95e9-2b69b85cba97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:15:45.031437 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f6c86-24af-436b-95e9-2b69b85cba97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:15:45.033092 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f6c86-24af-436b-95e9-2b69b85cba97 service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:15:45.050914 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1375/2760] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:15:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:15:49.739392 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca902c-567b-41b3-bed6-67befa48ca52 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:15:49.739861 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca902c-567b-41b3-bed6-67befa48ca52 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:15:49.739984 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca902c-567b-41b3-bed6-67befa48ca52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:15:49.757297 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-7aca902c-567b-41b3-bed6-67befa48ca52 None None] MFA Rules not processed for user `05951aa9ba2344a994f9fa1aa6fdb3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:15:49.758423 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-7aca902c-567b-41b3-bed6-67befa48ca52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:15:49.765224 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1386/2761] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:15:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:15:50.064288 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f6c86-24af-436b-95e9-2b69b85cba97 service nova] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:15:50.065680 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-576f6c86-24af-436b-95e9-2b69b85cba97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:15:50.120048 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f6c86-24af-436b-95e9-2b69b85cba97 service nova] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:15:50.123710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2b03a-7d59-4d4b-a683-dfb5d5a37cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:15:50.124378 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2b03a-7d59-4d4b-a683-dfb5d5a37cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:15:50.124662 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2b03a-7d59-4d4b-a683-dfb5d5a37cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:15:50.124942 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2b03a-7d59-4d4b-a683-dfb5d5a37cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:15:50.126700 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-56d2b03a-7d59-4d4b-a683-dfb5d5a37cf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:15:50.136665 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2b03a-7d59-4d4b-a683-dfb5d5a37cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:15:50.138082 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2b03a-7d59-4d4b-a683-dfb5d5a37cf5 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:15:50.145970 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1376/2762] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:15:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:15:50.543834 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca902c-567b-41b3-bed6-67befa48ca52 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:15:50.545238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-7aca902c-567b-41b3-bed6-67befa48ca52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:15:50.615774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca902c-567b-41b3-bed6-67befa48ca52 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:15:50.621082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6179b85-2da2-49b6-8533-5ba15bf79712 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79a71fa89446c3abbb4fdbf2c93aac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:15:50.621722 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6179b85-2da2-49b6-8533-5ba15bf79712 service placement] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:15:50.622002 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6179b85-2da2-49b6-8533-5ba15bf79712 service placement] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:15:50.622278 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6179b85-2da2-49b6-8533-5ba15bf79712 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:15:50.624043 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e6179b85-2da2-49b6-8533-5ba15bf79712 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:15:50.635400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6179b85-2da2-49b6-8533-5ba15bf79712 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:15:50.636987 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6179b85-2da2-49b6-8533-5ba15bf79712 service placement] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:15:50.646743 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1387/2763] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:15:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:16:00.142445 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=32 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:00.642499 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=35 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:02.273904 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2b03a-7d59-4d4b-a683-dfb5d5a37cf5 service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:16:02.339349 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2b03a-7d59-4d4b-a683-dfb5d5a37cf5 service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:16:02.343727 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7263915-573e-49d2-a56f-b631feb00d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:16:02.344625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7263915-573e-49d2-a56f-b631feb00d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:02.344908 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7263915-573e-49d2-a56f-b631feb00d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:02.345185 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7263915-573e-49d2-a56f-b631feb00d66 admin admin] PATH_INFO: `/v3/users/bda8be61595f48bfb9bb060918931ac5` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:02.346374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7263915-573e-49d2-a56f-b631feb00d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda8be61595f48bfb9bb060918931ac5)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:16:02.348352 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7263915-573e-49d2-a56f-b631feb00d66 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:16:02.571433 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e7263915-573e-49d2-a56f-b631feb00d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda8be61595f48bfb9bb060918931ac5'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:16:02.572087 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e7263915-573e-49d2-a56f-b631feb00d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda8be61595f48bfb9bb060918931ac5'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:16:02.620415 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e7263915-573e-49d2-a56f-b631feb00d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda8be61595f48bfb9bb060918931ac5'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:16:02.621054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e7263915-573e-49d2-a56f-b631feb00d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda8be61595f48bfb9bb060918931ac5'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:16:02.634164 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e7263915-573e-49d2-a56f-b631feb00d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda8be61595f48bfb9bb060918931ac5'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:16:02.646339 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1377/2764] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:16:02 2022] DELETE /identity/v3/users/bda8be61595f48bfb9bb060918931ac5 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:16:02.650888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6035e32-11e0-4388-bf7e-06617225dc70 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:02.651378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6035e32-11e0-4388-bf7e-06617225dc70 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:02.651509 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6035e32-11e0-4388-bf7e-06617225dc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:02.673998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-c6035e32-11e0-4388-bf7e-06617225dc70 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:16:02.675232 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c6035e32-11e0-4388-bf7e-06617225dc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:16:02.748675 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1388/2765] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:16:02.758868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7263915-573e-49d2-a56f-b631feb00d66 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:16:02.760305 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e7263915-573e-49d2-a56f-b631feb00d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:16:02.817558 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7263915-573e-49d2-a56f-b631feb00d66 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:16:02.821217 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26950aaf-ee6f-490f-9960-e40082c325ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:16:02.821861 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26950aaf-ee6f-490f-9960-e40082c325ff service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:02.822152 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26950aaf-ee6f-490f-9960-e40082c325ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:02.822425 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26950aaf-ee6f-490f-9960-e40082c325ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:02.831191 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26950aaf-ee6f-490f-9960-e40082c325ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:16:02.832654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26950aaf-ee6f-490f-9960-e40082c325ff service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:16:02.841905 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1378/2766] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:16:03.381516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6035e32-11e0-4388-bf7e-06617225dc70 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:16:03.385042 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c6035e32-11e0-4388-bf7e-06617225dc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:16:03.395100 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6035e32-11e0-4388-bf7e-06617225dc70 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:16:03.400369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682231b9-5bd4-4ce3-a219-98ac43d8d73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:16:03.401295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682231b9-5bd4-4ce3-a219-98ac43d8d73d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:03.401793 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682231b9-5bd4-4ce3-a219-98ac43d8d73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:03.401944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682231b9-5bd4-4ce3-a219-98ac43d8d73d admin admin] PATH_INFO: `/v3/projects/f706c5a9579744f6be61163fd8831e08` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:03.403037 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682231b9-5bd4-4ce3-a219-98ac43d8d73d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f706c5a9579744f6be61163fd8831e08)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:16:03.405000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682231b9-5bd4-4ce3-a219-98ac43d8d73d admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:16:03.544065 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-682231b9-5bd4-4ce3-a219-98ac43d8d73d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f706c5a9579744f6be61163fd8831e08', 'request_id': 'req-682231b9-5bd4-4ce3-a219-98ac43d8d73d'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:16:03.606446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-682231b9-5bd4-4ce3-a219-98ac43d8d73d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f706c5a9579744f6be61163fd8831e08', 'request_id': 'req-682231b9-5bd4-4ce3-a219-98ac43d8d73d'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:16:03.612962 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-682231b9-5bd4-4ce3-a219-98ac43d8d73d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f706c5a9579744f6be61163fd8831e08', 'request_id': 'req-682231b9-5bd4-4ce3-a219-98ac43d8d73d'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:16:03.623461 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-682231b9-5bd4-4ce3-a219-98ac43d8d73d admin admin] The token cache is being invalidate because project f706c5a9579744f6be61163fd8831e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80542) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:16:03.623751 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-682231b9-5bd4-4ce3-a219-98ac43d8d73d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:16:03.624400 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-682231b9-5bd4-4ce3-a219-98ac43d8d73d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:16:03.626294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1389/2767] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:16:03 2022] DELETE /identity/v3/projects/f706c5a9579744f6be61163fd8831e08 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:16:03.631254 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549c6e1-23d7-45a3-ba74-e5023dda1e5c None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:03.631763 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549c6e1-23d7-45a3-ba74-e5023dda1e5c None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:03.631909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549c6e1-23d7-45a3-ba74-e5023dda1e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:03.650334 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-7549c6e1-23d7-45a3-ba74-e5023dda1e5c None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:16:03.651570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-7549c6e1-23d7-45a3-ba74-e5023dda1e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:16:03.667897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:03.708825 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1379/2768] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:16:03.766074 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea9ea9-ac18-4ad7-92ec-b450c97a77d9 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:03.766882 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea9ea9-ac18-4ad7-92ec-b450c97a77d9 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:03.766882 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea9ea9-ac18-4ad7-92ec-b450c97a77d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:03.785270 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-0eea9ea9-ac18-4ad7-92ec-b450c97a77d9 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:16:03.786455 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-0eea9ea9-ac18-4ad7-92ec-b450c97a77d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:16:03.794605 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1390/2769] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:16:03.798601 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549c6e1-23d7-45a3-ba74-e5023dda1e5c None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:16:03.808577 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549c6e1-23d7-45a3-ba74-e5023dda1e5c None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:16:03.813173 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad979f6-4a16-4cb7-8bf5-4cc9c6b5462a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:16:03.813811 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad979f6-4a16-4cb7-8bf5-4cc9c6b5462a admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:03.814093 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad979f6-4a16-4cb7-8bf5-4cc9c6b5462a admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:03.814374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad979f6-4a16-4cb7-8bf5-4cc9c6b5462a admin admin] PATH_INFO: `/v3/domains` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:03.815099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad979f6-4a16-4cb7-8bf5-4cc9c6b5462a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80543) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:16:03.815405 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad979f6-4a16-4cb7-8bf5-4cc9c6b5462a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:16:03.817018 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad979f6-4a16-4cb7-8bf5-4cc9c6b5462a admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:16:03.829310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1380/2770] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:16:03.833476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea9ea9-ac18-4ad7-92ec-b450c97a77d9 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:16:03.842775 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea9ea9-ac18-4ad7-92ec-b450c97a77d9 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:16:03.847410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc71719-bc32-4710-8e9d-6052b493cc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:16:03.848063 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc71719-bc32-4710-8e9d-6052b493cc4f admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:03.848358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc71719-bc32-4710-8e9d-6052b493cc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:03.848637 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc71719-bc32-4710-8e9d-6052b493cc4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:03.849333 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc71719-bc32-4710-8e9d-6052b493cc4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:16:03.851257 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc71719-bc32-4710-8e9d-6052b493cc4f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:16:03.947726 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1391/2771] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:16:03 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:16:03.952054 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad979f6-4a16-4cb7-8bf5-4cc9c6b5462a admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:16:03.962458 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad979f6-4a16-4cb7-8bf5-4cc9c6b5462a admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:16:04.018952 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ad7fa-632b-4cc0-93a3-6c86b5893c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:16:04.019716 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ad7fa-632b-4cc0-93a3-6c86b5893c59 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:04.020002 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ad7fa-632b-4cc0-93a3-6c86b5893c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:04.020306 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ad7fa-632b-4cc0-93a3-6c86b5893c59 admin admin] PATH_INFO: `/v3/users` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:04.021002 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ad7fa-632b-4cc0-93a3-6c86b5893c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:16:04.022990 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ad7fa-632b-4cc0-93a3-6c86b5893c59 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:16:04.123315 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1381/2772] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:16:03 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:16:04.127629 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc71719-bc32-4710-8e9d-6052b493cc4f admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:16:04.138362 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc71719-bc32-4710-8e9d-6052b493cc4f admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:16:04.142904 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7fc29-96c7-4a43-b709-1a82a8c8c617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:16:04.143550 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7fc29-96c7-4a43-b709-1a82a8c8c617 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:04.143833 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7fc29-96c7-4a43-b709-1a82a8c8c617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:04.144121 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7fc29-96c7-4a43-b709-1a82a8c8c617 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:04.144863 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7fc29-96c7-4a43-b709-1a82a8c8c617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:16:04.146446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7fc29-96c7-4a43-b709-1a82a8c8c617 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:16:04.156625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1392/2773] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:16:04.160451 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ad7fa-632b-4cc0-93a3-6c86b5893c59 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:16:04.170854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ad7fa-632b-4cc0-93a3-6c86b5893c59 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:16:04.175396 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e958a1-fcbf-4712-830a-c43d3380f93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:16:04.176037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e958a1-fcbf-4712-830a-c43d3380f93b admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:04.176357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e958a1-fcbf-4712-830a-c43d3380f93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:04.176635 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e958a1-fcbf-4712-830a-c43d3380f93b admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:04.177357 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e958a1-fcbf-4712-830a-c43d3380f93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:16:04.178928 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e958a1-fcbf-4712-830a-c43d3380f93b admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:16:04.189204 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1382/2774] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:16:04.193074 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7fc29-96c7-4a43-b709-1a82a8c8c617 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:16:04.202628 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7fc29-96c7-4a43-b709-1a82a8c8c617 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:16:04.207135 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11416678-596e-4117-b3ab-f69a21425a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:16:04.207986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11416678-596e-4117-b3ab-f69a21425a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:04.208305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11416678-596e-4117-b3ab-f69a21425a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:04.208585 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11416678-596e-4117-b3ab-f69a21425a39 admin admin] PATH_INFO: `/v3/projects/2c32a4df73e946b2844051778a16a8c0/users/00da4e0bbeba4a1f954ea2d27ff18f59/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:04.222663 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11416678-596e-4117-b3ab-f69a21425a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c32a4df73e946b2844051778a16a8c0, user_id=00da4e0bbeba4a1f954ea2d27ff18f59, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:16:04.225432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11416678-596e-4117-b3ab-f69a21425a39 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:16:04.323446 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1393/2775] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:16:04 2022] PUT /identity/v3/projects/2c32a4df73e946b2844051778a16a8c0/users/00da4e0bbeba4a1f954ea2d27ff18f59/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:16:04.328747 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9692c-cdcd-4ce0-8d41-990d0335f0f4 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:04.329042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9692c-cdcd-4ce0-8d41-990d0335f0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:04.329328 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9692c-cdcd-4ce0-8d41-990d0335f0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:04.346872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-b4a9692c-cdcd-4ce0-8d41-990d0335f0f4 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:16:04.348446 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b4a9692c-cdcd-4ce0-8d41-990d0335f0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:16:04.409264 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1383/2776] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:16:04.419579 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11416678-596e-4117-b3ab-f69a21425a39 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:16:04.421313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-11416678-596e-4117-b3ab-f69a21425a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:16:04.443762 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:04.480193 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11416678-596e-4117-b3ab-f69a21425a39 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:16:04.489265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41d8a7-5158-4ca0-bccf-81e6e19b16c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:16:04.490005 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41d8a7-5158-4ca0-bccf-81e6e19b16c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:04.490295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41d8a7-5158-4ca0-bccf-81e6e19b16c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:04.490573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41d8a7-5158-4ca0-bccf-81e6e19b16c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:04.500837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41d8a7-5158-4ca0-bccf-81e6e19b16c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:16:04.502757 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41d8a7-5158-4ca0-bccf-81e6e19b16c1 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:16:04.513007 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1394/2777] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:16:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:16:05.915398 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9692c-cdcd-4ce0-8d41-990d0335f0f4 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:16:05.916892 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b4a9692c-cdcd-4ce0-8d41-990d0335f0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:16:05.949924 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:05.995316 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9692c-cdcd-4ce0-8d41-990d0335f0f4 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:16:06.001919 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f5afd-5dfb-4be0-99b5-0d90fd13f28a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:16:06.005251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f5afd-5dfb-4be0-99b5-0d90fd13f28a service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:06.005251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f5afd-5dfb-4be0-99b5-0d90fd13f28a service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:06.005251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f5afd-5dfb-4be0-99b5-0d90fd13f28a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:06.005251 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-4d9f5afd-5dfb-4be0-99b5-0d90fd13f28a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:16:06.018581 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f5afd-5dfb-4be0-99b5-0d90fd13f28a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:16:06.020221 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f5afd-5dfb-4be0-99b5-0d90fd13f28a service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:16:06.031755 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1384/2778] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:16:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:16:09.905058 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da751298-3992-4e9e-844e-6140b2872576 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:09.905624 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da751298-3992-4e9e-844e-6140b2872576 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:09.905624 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da751298-3992-4e9e-844e-6140b2872576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:09.938307 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-da751298-3992-4e9e-844e-6140b2872576 None None] MFA Rules not processed for user `00da4e0bbeba4a1f954ea2d27ff18f59`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:16:09.939534 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-da751298-3992-4e9e-844e-6140b2872576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:16:10.009039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1395/2779] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:16:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:16:10.013419 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f5afd-5dfb-4be0-99b5-0d90fd13f28a service nova] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:16:10.024488 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f5afd-5dfb-4be0-99b5-0d90fd13f28a service nova] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:16:10.029595 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f3aab-7d75-42ef-b314-87311cdbe91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:16:10.030284 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f3aab-7d75-42ef-b314-87311cdbe91d admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:10.030570 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f3aab-7d75-42ef-b314-87311cdbe91d admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:10.031596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f3aab-7d75-42ef-b314-87311cdbe91d admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:10.032353 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f3aab-7d75-42ef-b314-87311cdbe91d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:16:10.034272 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f3aab-7d75-42ef-b314-87311cdbe91d admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:16:10.157302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1385/2780] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:16:10 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:16:10.161416 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da751298-3992-4e9e-844e-6140b2872576 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:16:10.173808 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da751298-3992-4e9e-844e-6140b2872576 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:16:10.234221 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d90db9-a2c1-43cb-882f-1849b55118ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:16:10.234894 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d90db9-a2c1-43cb-882f-1849b55118ae admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:10.235177 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d90db9-a2c1-43cb-882f-1849b55118ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:10.235485 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d90db9-a2c1-43cb-882f-1849b55118ae admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:10.236230 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d90db9-a2c1-43cb-882f-1849b55118ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:16:10.238171 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d90db9-a2c1-43cb-882f-1849b55118ae admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:16:10.342751 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1396/2781] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:16:10 2022] POST /identity/v3/users => generated 295 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:16:10.346668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f3aab-7d75-42ef-b314-87311cdbe91d admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:16:10.357815 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f3aab-7d75-42ef-b314-87311cdbe91d admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:16:10.362639 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11dac68-3915-4357-b13d-c2b70e5bddeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:16:10.363318 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dac68-3915-4357-b13d-c2b70e5bddeb admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:10.363635 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dac68-3915-4357-b13d-c2b70e5bddeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:10.363910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11dac68-3915-4357-b13d-c2b70e5bddeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:10.364695 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11dac68-3915-4357-b13d-c2b70e5bddeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:16:10.367630 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11dac68-3915-4357-b13d-c2b70e5bddeb admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:16:10.379819 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1386/2782] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:16:10.384179 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d90db9-a2c1-43cb-882f-1849b55118ae admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:16:10.394670 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d90db9-a2c1-43cb-882f-1849b55118ae admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:16:10.400088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3d1f1-5fe0-4fa9-8d40-e3bf35beca76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:16:10.401003 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3d1f1-5fe0-4fa9-8d40-e3bf35beca76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:10.401290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3d1f1-5fe0-4fa9-8d40-e3bf35beca76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:10.401570 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3d1f1-5fe0-4fa9-8d40-e3bf35beca76 admin admin] PATH_INFO: `/v3/projects/b4140f2bb8b14d18af757819a63ba47c/users/6878f30fa4ed444e97d57eb9c1b103bc/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:10.418627 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3d1f1-5fe0-4fa9-8d40-e3bf35beca76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4140f2bb8b14d18af757819a63ba47c, user_id=6878f30fa4ed444e97d57eb9c1b103bc, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:16:10.421697 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3d1f1-5fe0-4fa9-8d40-e3bf35beca76 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:16:10.527839 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1397/2783] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:16:10 2022] PUT /identity/v3/projects/b4140f2bb8b14d18af757819a63ba47c/users/6878f30fa4ed444e97d57eb9c1b103bc/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:16:10.532008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11dac68-3915-4357-b13d-c2b70e5bddeb admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:16:10.542598 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11dac68-3915-4357-b13d-c2b70e5bddeb admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:16:10.605693 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9a98b-87ef-4789-b68d-3d9e9c84d3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:16:10.606366 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9a98b-87ef-4789-b68d-3d9e9c84d3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:10.606651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9a98b-87ef-4789-b68d-3d9e9c84d3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:10.606925 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9a98b-87ef-4789-b68d-3d9e9c84d3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:10.607667 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9a98b-87ef-4789-b68d-3d9e9c84d3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:16:10.609313 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9a98b-87ef-4789-b68d-3d9e9c84d3a2 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:16:10.623588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1387/2784] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:16:10.624898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3d1f1-5fe0-4fa9-8d40-e3bf35beca76 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:16:10.636089 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3d1f1-5fe0-4fa9-8d40-e3bf35beca76 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:16:10.640743 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6237f-790b-4868-96fb-6c7859d2313e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:16:10.641620 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6237f-790b-4868-96fb-6c7859d2313e admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:10.641899 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6237f-790b-4868-96fb-6c7859d2313e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:10.642317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6237f-790b-4868-96fb-6c7859d2313e admin admin] PATH_INFO: `/v3/projects/b4140f2bb8b14d18af757819a63ba47c/users/6878f30fa4ed444e97d57eb9c1b103bc/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:10.644146 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6237f-790b-4868-96fb-6c7859d2313e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4140f2bb8b14d18af757819a63ba47c, user_id=6878f30fa4ed444e97d57eb9c1b103bc, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:16:10.646789 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6237f-790b-4868-96fb-6c7859d2313e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:16:10.657981 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1398/2785] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:16:10 2022] PUT /identity/v3/projects/b4140f2bb8b14d18af757819a63ba47c/users/6878f30fa4ed444e97d57eb9c1b103bc/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:16:16.233499 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b18708-e89a-49ca-a673-845893469fed None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:16.233971 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b18708-e89a-49ca-a673-845893469fed None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:16.234070 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b18708-e89a-49ca-a673-845893469fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:16.262551 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-83b18708-e89a-49ca-a673-845893469fed None None] MFA Rules not processed for user `6878f30fa4ed444e97d57eb9c1b103bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:16:16.263771 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-83b18708-e89a-49ca-a673-845893469fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:16:16.336889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1388/2786] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:16:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:16:16.352626 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6237f-790b-4868-96fb-6c7859d2313e admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:16:16.354406 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-95a6237f-790b-4868-96fb-6c7859d2313e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:16:16.361438 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:16.435288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6237f-790b-4868-96fb-6c7859d2313e admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:16:16.441083 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed32e64-bbf4-4197-b5d5-3dc4e2330c9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:16:16.444313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed32e64-bbf4-4197-b5d5-3dc4e2330c9c service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:16.444313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed32e64-bbf4-4197-b5d5-3dc4e2330c9c service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:16.444313 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed32e64-bbf4-4197-b5d5-3dc4e2330c9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:16.503298 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed32e64-bbf4-4197-b5d5-3dc4e2330c9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:16:16.504922 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed32e64-bbf4-4197-b5d5-3dc4e2330c9c service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:16:16.531476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1399/2787] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:16:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:16:26.332891 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=98,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:26.521277 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=54 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:41.040800 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1bfb6-cd77-4191-b793-e8ef7fadeeed None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:41.041410 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1bfb6-cd77-4191-b793-e8ef7fadeeed None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:41.041410 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1bfb6-cd77-4191-b793-e8ef7fadeeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:41.061341 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-b3f1bfb6-cd77-4191-b793-e8ef7fadeeed None None] MFA Rules not processed for user `00da4e0bbeba4a1f954ea2d27ff18f59`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:16:41.062564 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b3f1bfb6-cd77-4191-b793-e8ef7fadeeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:16:41.069686 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1389/2788] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:16:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:16:51.054132 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:16:59.624009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed32e64-bbf4-4197-b5d5-3dc4e2330c9c service nova] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:16:59.677810 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed32e64-bbf4-4197-b5d5-3dc4e2330c9c service nova] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:16:59.681325 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1dc2ae-e924-45d7-9570-d9e87b47f9f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:16:59.681958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dc2ae-e924-45d7-9570-d9e87b47f9f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:16:59.682248 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dc2ae-e924-45d7-9570-d9e87b47f9f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:16:59.682531 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dc2ae-e924-45d7-9570-d9e87b47f9f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:16:59.691932 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1dc2ae-e924-45d7-9570-d9e87b47f9f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:16:59.693473 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1dc2ae-e924-45d7-9570-d9e87b47f9f3 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:16:59.703436 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1400/2789] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:16:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:17:09.699334 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=26 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:17:16.661186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1bfb6-cd77-4191-b793-e8ef7fadeeed None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:17:16.662593 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b3f1bfb6-cd77-4191-b793-e8ef7fadeeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:17:16.731731 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1bfb6-cd77-4191-b793-e8ef7fadeeed None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:17:16.736717 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dda6b-8dc6-4ebd-bc34-a2432a996011 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79a71fa89446c3abbb4fdbf2c93aac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:17:16.737361 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dda6b-8dc6-4ebd-bc34-a2432a996011 service placement] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:16.737644 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dda6b-8dc6-4ebd-bc34-a2432a996011 service placement] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:16.737927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dda6b-8dc6-4ebd-bc34-a2432a996011 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:16.739846 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-f56dda6b-8dc6-4ebd-bc34-a2432a996011 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:17:16.751968 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56dda6b-8dc6-4ebd-bc34-a2432a996011 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:17:16.753593 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56dda6b-8dc6-4ebd-bc34-a2432a996011 service placement] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:17:16.763510 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1390/2790] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:17:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:17:26.759230 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=32 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:17:44.154753 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1dc2ae-e924-45d7-9570-d9e87b47f9f3 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:17:44.163358 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1dc2ae-e924-45d7-9570-d9e87b47f9f3 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:17:44.166898 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdad02-4ca9-4194-b773-1f9cc14d7cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:17:44.167520 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdad02-4ca9-4194-b773-1f9cc14d7cfb service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:44.167809 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdad02-4ca9-4194-b773-1f9cc14d7cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:44.168087 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdad02-4ca9-4194-b773-1f9cc14d7cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:44.170144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c4bdad02-4ca9-4194-b773-1f9cc14d7cfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:17:44.231290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdad02-4ca9-4194-b773-1f9cc14d7cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:17:44.232768 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdad02-4ca9-4194-b773-1f9cc14d7cfb service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:17:44.242255 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1401/2791] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:17:47.566553 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dda6b-8dc6-4ebd-bc34-a2432a996011 service placement] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:17:47.583698 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dda6b-8dc6-4ebd-bc34-a2432a996011 service placement] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:17:47.590491 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7be72e-caa1-4b30-bdb8-8c67d2561f6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79a71fa89446c3abbb4fdbf2c93aac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:17:47.591166 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7be72e-caa1-4b30-bdb8-8c67d2561f6b service placement] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:47.591455 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7be72e-caa1-4b30-bdb8-8c67d2561f6b service placement] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:47.592490 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7be72e-caa1-4b30-bdb8-8c67d2561f6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:47.594368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-2b7be72e-caa1-4b30-bdb8-8c67d2561f6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:17:47.612317 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7be72e-caa1-4b30-bdb8-8c67d2561f6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:17:47.614953 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7be72e-caa1-4b30-bdb8-8c67d2561f6b service placement] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:17:47.634824 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1391/2792] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:17:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:17:47.703713 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdad02-4ca9-4194-b773-1f9cc14d7cfb service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:17:47.705290 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c4bdad02-4ca9-4194-b773-1f9cc14d7cfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:17:47.717329 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdad02-4ca9-4194-b773-1f9cc14d7cfb service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:17:47.721852 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada5626-0d09-418d-96d6-7a13335eb48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:17:47.722704 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada5626-0d09-418d-96d6-7a13335eb48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:47.722986 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada5626-0d09-418d-96d6-7a13335eb48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:47.723263 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada5626-0d09-418d-96d6-7a13335eb48c admin admin] PATH_INFO: `/v3/users/05951aa9ba2344a994f9fa1aa6fdb3bf` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:47.724504 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada5626-0d09-418d-96d6-7a13335eb48c admin admin] RBAC: Authorizing `identity:delete_user(user_id=05951aa9ba2344a994f9fa1aa6fdb3bf)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:17:47.726417 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada5626-0d09-418d-96d6-7a13335eb48c admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:17:47.868832 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fada5626-0d09-418d-96d6-7a13335eb48c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05951aa9ba2344a994f9fa1aa6fdb3bf'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:17:47.876252 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fada5626-0d09-418d-96d6-7a13335eb48c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05951aa9ba2344a994f9fa1aa6fdb3bf'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:17:47.876961 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fada5626-0d09-418d-96d6-7a13335eb48c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05951aa9ba2344a994f9fa1aa6fdb3bf'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:17:47.889524 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fada5626-0d09-418d-96d6-7a13335eb48c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05951aa9ba2344a994f9fa1aa6fdb3bf'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:17:47.890175 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-fada5626-0d09-418d-96d6-7a13335eb48c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05951aa9ba2344a994f9fa1aa6fdb3bf'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:17:47.981089 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1402/2793] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:17:47 2022] DELETE /identity/v3/users/05951aa9ba2344a994f9fa1aa6fdb3bf => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:17:48.242495 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7be72e-caa1-4b30-bdb8-8c67d2561f6b service placement] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:17:48.251325 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7be72e-caa1-4b30-bdb8-8c67d2561f6b service placement] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:17:48.308439 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016606b-93d0-4384-8124-c2b79d2a441f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:17:48.309927 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016606b-93d0-4384-8124-c2b79d2a441f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:48.310211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016606b-93d0-4384-8124-c2b79d2a441f admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:48.310488 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016606b-93d0-4384-8124-c2b79d2a441f admin admin] PATH_INFO: `/v3/projects/069840ebd26e434c861568668776df52` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:48.311667 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016606b-93d0-4384-8124-c2b79d2a441f admin admin] RBAC: Authorizing `identity:delete_project(project_id=069840ebd26e434c861568668776df52)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:17:48.313585 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016606b-93d0-4384-8124-c2b79d2a441f admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:17:48.419564 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3016606b-93d0-4384-8124-c2b79d2a441f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '069840ebd26e434c861568668776df52', 'request_id': 'req-3016606b-93d0-4384-8124-c2b79d2a441f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:17:48.464344 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3016606b-93d0-4384-8124-c2b79d2a441f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '069840ebd26e434c861568668776df52', 'request_id': 'req-3016606b-93d0-4384-8124-c2b79d2a441f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:17:48.470769 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3016606b-93d0-4384-8124-c2b79d2a441f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '069840ebd26e434c861568668776df52', 'request_id': 'req-3016606b-93d0-4384-8124-c2b79d2a441f'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:17:48.482342 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3016606b-93d0-4384-8124-c2b79d2a441f admin admin] The token cache is being invalidate because project 069840ebd26e434c861568668776df52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:17:48.482676 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3016606b-93d0-4384-8124-c2b79d2a441f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:17:48.483254 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-3016606b-93d0-4384-8124-c2b79d2a441f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:17:48.484817 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1392/2794] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:17:48 2022] DELETE /identity/v3/projects/069840ebd26e434c861568668776df52 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:17:48.489708 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f873f-44db-4f73-b205-f435e867222f None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:48.490007 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f873f-44db-4f73-b205-f435e867222f None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:48.490288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f873f-44db-4f73-b205-f435e867222f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:48.508254 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-d53f873f-44db-4f73-b205-f435e867222f None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:17:48.509452 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d53f873f-44db-4f73-b205-f435e867222f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:17:48.567393 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1403/2795] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:17:48.575324 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b01c00-b9cb-4f21-8ea3-760e5b6ffd3c None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:48.575804 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b01c00-b9cb-4f21-8ea3-760e5b6ffd3c None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:48.575940 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b01c00-b9cb-4f21-8ea3-760e5b6ffd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:48.594407 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-67b01c00-b9cb-4f21-8ea3-760e5b6ffd3c None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:17:48.595605 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-67b01c00-b9cb-4f21-8ea3-760e5b6ffd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:17:48.603473 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1393/2796] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:17:48.608235 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f873f-44db-4f73-b205-f435e867222f None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:17:48.617820 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f873f-44db-4f73-b205-f435e867222f None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:17:48.622363 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa7640-7711-4607-90ca-98d52f5fc541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:17:48.623006 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa7640-7711-4607-90ca-98d52f5fc541 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:48.623293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa7640-7711-4607-90ca-98d52f5fc541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:48.623572 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa7640-7711-4607-90ca-98d52f5fc541 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:48.624333 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa7640-7711-4607-90ca-98d52f5fc541 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:17:48.624646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa7640-7711-4607-90ca-98d52f5fc541 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:17:48.626247 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa7640-7711-4607-90ca-98d52f5fc541 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:17:48.627687 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:17:48.638215 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1404/2797] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:17:48.642399 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b01c00-b9cb-4f21-8ea3-760e5b6ffd3c None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:17:48.651514 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b01c00-b9cb-4f21-8ea3-760e5b6ffd3c None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:17:48.656673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21359517-9961-4bb3-8f18-00e21bf047d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:17:48.657315 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21359517-9961-4bb3-8f18-00e21bf047d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:48.657602 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21359517-9961-4bb3-8f18-00e21bf047d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:48.658940 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21359517-9961-4bb3-8f18-00e21bf047d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:48.658940 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21359517-9961-4bb3-8f18-00e21bf047d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:17:48.660492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21359517-9961-4bb3-8f18-00e21bf047d7 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:17:48.751173 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1394/2798] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:17:48 2022] POST /identity/v3/projects => generated 357 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:17:48.755234 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa7640-7711-4607-90ca-98d52f5fc541 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:17:48.765542 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa7640-7711-4607-90ca-98d52f5fc541 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:17:48.822059 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a441c-6bb7-4009-b99d-a95e0a72d971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:17:48.822726 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a441c-6bb7-4009-b99d-a95e0a72d971 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:48.823012 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a441c-6bb7-4009-b99d-a95e0a72d971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:48.823291 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a441c-6bb7-4009-b99d-a95e0a72d971 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:48.824000 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a441c-6bb7-4009-b99d-a95e0a72d971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:17:48.828124 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a441c-6bb7-4009-b99d-a95e0a72d971 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:17:48.910286 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1405/2799] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:17:48 2022] POST /identity/v3/users => generated 279 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:17:48.914525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21359517-9961-4bb3-8f18-00e21bf047d7 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:17:48.931174 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21359517-9961-4bb3-8f18-00e21bf047d7 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:17:48.935976 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbab4d-fb57-4946-8af8-4e3d0a84329d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:17:48.936660 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbab4d-fb57-4946-8af8-4e3d0a84329d admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:48.936947 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbab4d-fb57-4946-8af8-4e3d0a84329d admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:48.937226 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbab4d-fb57-4946-8af8-4e3d0a84329d admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:48.937998 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbab4d-fb57-4946-8af8-4e3d0a84329d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:17:48.939600 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbab4d-fb57-4946-8af8-4e3d0a84329d admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:17:48.950115 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1395/2800] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:17:48.954029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a441c-6bb7-4009-b99d-a95e0a72d971 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:17:48.963947 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a441c-6bb7-4009-b99d-a95e0a72d971 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:17:48.969293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae16cf-5d8e-4e23-b3b4-712809e8ff0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:17:48.969961 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae16cf-5d8e-4e23-b3b4-712809e8ff0a admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:48.970233 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae16cf-5d8e-4e23-b3b4-712809e8ff0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:48.970512 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae16cf-5d8e-4e23-b3b4-712809e8ff0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:48.971248 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae16cf-5d8e-4e23-b3b4-712809e8ff0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:17:48.972882 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae16cf-5d8e-4e23-b3b4-712809e8ff0a admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:17:48.982632 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1406/2801] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:17:48.986496 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbab4d-fb57-4946-8af8-4e3d0a84329d admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:17:48.996245 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbab4d-fb57-4946-8af8-4e3d0a84329d admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:17:49.000791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97259f77-ebec-41ce-bd82-98d569fc5608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:17:49.001701 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97259f77-ebec-41ce-bd82-98d569fc5608 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:49.001924 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97259f77-ebec-41ce-bd82-98d569fc5608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:49.002198 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97259f77-ebec-41ce-bd82-98d569fc5608 admin admin] PATH_INFO: `/v3/projects/9da567956b4644789fdf6da90ededd75/users/a8812a7f1ccb403f85516eb0cca9f339/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:49.017078 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97259f77-ebec-41ce-bd82-98d569fc5608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da567956b4644789fdf6da90ededd75, user_id=a8812a7f1ccb403f85516eb0cca9f339, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:17:49.019693 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97259f77-ebec-41ce-bd82-98d569fc5608 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:17:49.117844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1396/2802] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:17:48 2022] PUT /identity/v3/projects/9da567956b4644789fdf6da90ededd75/users/a8812a7f1ccb403f85516eb0cca9f339/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:17:49.130581 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806664c9-daee-4fab-a479-ee43d176333a None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:49.130882 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806664c9-daee-4fab-a479-ee43d176333a None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:49.131172 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806664c9-daee-4fab-a479-ee43d176333a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:49.158133 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-806664c9-daee-4fab-a479-ee43d176333a None None] MFA Rules not processed for user `a8812a7f1ccb403f85516eb0cca9f339`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:17:49.159348 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-806664c9-daee-4fab-a479-ee43d176333a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:17:49.220991 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1407/2803] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:17:49 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:17:49.225432 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97259f77-ebec-41ce-bd82-98d569fc5608 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:17:49.231682 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:17:49.286738 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97259f77-ebec-41ce-bd82-98d569fc5608 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:17:49.291761 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e7a3c-0d22-452a-985a-a6dafc563be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:17:49.292436 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e7a3c-0d22-452a-985a-a6dafc563be3 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:49.292719 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e7a3c-0d22-452a-985a-a6dafc563be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:49.293020 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e7a3c-0d22-452a-985a-a6dafc563be3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:49.293707 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e7a3c-0d22-452a-985a-a6dafc563be3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:17:49.295853 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e7a3c-0d22-452a-985a-a6dafc563be3 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:17:49.381940 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1397/2804] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:17:49 2022] POST /identity/v3/projects => generated 357 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:17:49.384227 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806664c9-daee-4fab-a479-ee43d176333a None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:17:49.395518 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806664c9-daee-4fab-a479-ee43d176333a None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:17:49.450468 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5c749-1f46-4a80-854c-8602de43559c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:17:49.451156 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5c749-1f46-4a80-854c-8602de43559c admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:49.451441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5c749-1f46-4a80-854c-8602de43559c admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:49.451718 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5c749-1f46-4a80-854c-8602de43559c admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:49.452460 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5c749-1f46-4a80-854c-8602de43559c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:17:49.454376 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5c749-1f46-4a80-854c-8602de43559c admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:17:49.461721 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:17:49.548067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1408/2805] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:17:49 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:17:49.551771 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e7a3c-0d22-452a-985a-a6dafc563be3 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:17:49.562814 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e7a3c-0d22-452a-985a-a6dafc563be3 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:17:49.567413 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897bce6-4c23-4a8e-aa00-c21e3e48efc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:17:49.568068 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897bce6-4c23-4a8e-aa00-c21e3e48efc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:49.568674 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897bce6-4c23-4a8e-aa00-c21e3e48efc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:49.568784 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897bce6-4c23-4a8e-aa00-c21e3e48efc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:49.569527 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897bce6-4c23-4a8e-aa00-c21e3e48efc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:17:49.571129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897bce6-4c23-4a8e-aa00-c21e3e48efc4 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:17:49.581873 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1398/2806] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 22 17:17:49.585700 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5c749-1f46-4a80-854c-8602de43559c admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:17:49.596408 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5c749-1f46-4a80-854c-8602de43559c admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:17:49.601221 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b44247-a3b8-4aef-9108-a1ee52a763ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:17:49.602088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b44247-a3b8-4aef-9108-a1ee52a763ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:49.602370 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b44247-a3b8-4aef-9108-a1ee52a763ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:49.602644 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b44247-a3b8-4aef-9108-a1ee52a763ad admin admin] PATH_INFO: `/v3/projects/df3d50a93ec248d0add7ba6e57582750/users/ded2c2866f584d959499715feef50337/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:49.619238 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b44247-a3b8-4aef-9108-a1ee52a763ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=df3d50a93ec248d0add7ba6e57582750, user_id=ded2c2866f584d959499715feef50337, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:17:49.622989 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b44247-a3b8-4aef-9108-a1ee52a763ad admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:17:49.690853 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1409/2807] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:17:49 2022] PUT /identity/v3/projects/df3d50a93ec248d0add7ba6e57582750/users/ded2c2866f584d959499715feef50337/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:17:49.694769 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897bce6-4c23-4a8e-aa00-c21e3e48efc4 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:17:49.704678 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897bce6-4c23-4a8e-aa00-c21e3e48efc4 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:17:49.758841 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d624cd-6424-4a06-af02-1ffae8ca79cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:17:49.759489 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d624cd-6424-4a06-af02-1ffae8ca79cc admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:49.759770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d624cd-6424-4a06-af02-1ffae8ca79cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:49.760042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d624cd-6424-4a06-af02-1ffae8ca79cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:49.760791 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d624cd-6424-4a06-af02-1ffae8ca79cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:17:49.762390 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d624cd-6424-4a06-af02-1ffae8ca79cc admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:17:49.771833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1399/2808] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:17:49.775884 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b44247-a3b8-4aef-9108-a1ee52a763ad admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:17:49.786139 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b44247-a3b8-4aef-9108-a1ee52a763ad admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:17:49.790700 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a29b75-35e5-402b-859f-d3bcc314883e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:17:49.791567 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a29b75-35e5-402b-859f-d3bcc314883e admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:49.791845 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a29b75-35e5-402b-859f-d3bcc314883e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:49.792145 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a29b75-35e5-402b-859f-d3bcc314883e admin admin] PATH_INFO: `/v3/projects/df3d50a93ec248d0add7ba6e57582750/users/ded2c2866f584d959499715feef50337/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:49.794620 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a29b75-35e5-402b-859f-d3bcc314883e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df3d50a93ec248d0add7ba6e57582750, user_id=ded2c2866f584d959499715feef50337, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:17:49.797551 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a29b75-35e5-402b-859f-d3bcc314883e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:17:49.807532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1410/2809] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:17:49 2022] PUT /identity/v3/projects/df3d50a93ec248d0add7ba6e57582750/users/ded2c2866f584d959499715feef50337/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:17:49.817671 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a48e7-c30a-4e55-992c-4acbb4b9b0aa None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:49.817961 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a48e7-c30a-4e55-992c-4acbb4b9b0aa None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:49.818238 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a48e7-c30a-4e55-992c-4acbb4b9b0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:49.843253 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-632a48e7-c30a-4e55-992c-4acbb4b9b0aa None None] MFA Rules not processed for user `ded2c2866f584d959499715feef50337`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:17:49.844462 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-632a48e7-c30a-4e55-992c-4acbb4b9b0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:17:49.907135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:17:49.910732 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1400/2810] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:17:49 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:17:49.923111 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a29b75-35e5-402b-859f-d3bcc314883e admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:17:49.924855 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-f4a29b75-35e5-402b-859f-d3bcc314883e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:17:49.981223 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a29b75-35e5-402b-859f-d3bcc314883e admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:17:49.984862 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e950d5a-89e7-453f-8df8-38e72bd5847e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:17:49.985489 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e950d5a-89e7-453f-8df8-38e72bd5847e service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:49.985771 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e950d5a-89e7-453f-8df8-38e72bd5847e service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:49.986045 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e950d5a-89e7-453f-8df8-38e72bd5847e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:49.994940 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e950d5a-89e7-453f-8df8-38e72bd5847e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:17:49.996611 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e950d5a-89e7-453f-8df8-38e72bd5847e service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:17:50.006028 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1411/2811] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:17:49 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:17:50.180854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a48e7-c30a-4e55-992c-4acbb4b9b0aa None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:17:50.190398 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a48e7-c30a-4e55-992c-4acbb4b9b0aa None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:17:50.193956 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d4689-7dae-47ff-b659-71be61ca4740 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:17:50.194634 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d4689-7dae-47ff-b659-71be61ca4740 service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:17:50.194910 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d4689-7dae-47ff-b659-71be61ca4740 service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:17:50.195205 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d4689-7dae-47ff-b659-71be61ca4740 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:17:50.251084 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d4689-7dae-47ff-b659-71be61ca4740 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:17:50.252536 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d4689-7dae-47ff-b659-71be61ca4740 service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:17:50.261244 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1401/2812] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:17:50 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:18:00.001628 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:18:00.257278 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=28 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:18:08.689198 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e950d5a-89e7-453f-8df8-38e72bd5847e service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:08.750445 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e950d5a-89e7-453f-8df8-38e72bd5847e service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:08.755038 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92180bf6-0f6a-45bd-b6b0-9013e9a365f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:08.755904 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92180bf6-0f6a-45bd-b6b0-9013e9a365f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:08.756217 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92180bf6-0f6a-45bd-b6b0-9013e9a365f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:08.756499 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92180bf6-0f6a-45bd-b6b0-9013e9a365f0 admin admin] PATH_INFO: `/v3/users/a8812a7f1ccb403f85516eb0cca9f339` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:08.757739 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92180bf6-0f6a-45bd-b6b0-9013e9a365f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8812a7f1ccb403f85516eb0cca9f339)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:08.759653 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92180bf6-0f6a-45bd-b6b0-9013e9a365f0 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:08.986460 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-92180bf6-0f6a-45bd-b6b0-9013e9a365f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8812a7f1ccb403f85516eb0cca9f339'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:08.993506 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-92180bf6-0f6a-45bd-b6b0-9013e9a365f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8812a7f1ccb403f85516eb0cca9f339'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:08.994174 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-92180bf6-0f6a-45bd-b6b0-9013e9a365f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8812a7f1ccb403f85516eb0cca9f339'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:09.006017 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-92180bf6-0f6a-45bd-b6b0-9013e9a365f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8812a7f1ccb403f85516eb0cca9f339'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:09.009272 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-92180bf6-0f6a-45bd-b6b0-9013e9a365f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8812a7f1ccb403f85516eb0cca9f339'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:09.083858 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1412/2813] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:18:08 2022] DELETE /identity/v3/users/a8812a7f1ccb403f85516eb0cca9f339 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:18:09.088515 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a9803-f614-4ef1-9a4f-6c6d1122202b None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:09.088982 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a9803-f614-4ef1-9a4f-6c6d1122202b None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:09.089097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a9803-f614-4ef1-9a4f-6c6d1122202b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:09.106378 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-6e0a9803-f614-4ef1-9a4f-6c6d1122202b None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:18:09.107596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6e0a9803-f614-4ef1-9a4f-6c6d1122202b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:09.165506 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1402/2814] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:18:09.175342 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92180bf6-0f6a-45bd-b6b0-9013e9a365f0 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:09.176742 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-92180bf6-0f6a-45bd-b6b0-9013e9a365f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:09.231816 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92180bf6-0f6a-45bd-b6b0-9013e9a365f0 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:09.235349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16a644-2d14-4f7e-90e7-d6315a0215e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:09.235977 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16a644-2d14-4f7e-90e7-d6315a0215e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:09.236301 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16a644-2d14-4f7e-90e7-d6315a0215e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:09.236633 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16a644-2d14-4f7e-90e7-d6315a0215e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:09.245294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16a644-2d14-4f7e-90e7-d6315a0215e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:09.246737 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16a644-2d14-4f7e-90e7-d6315a0215e4 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:09.255999 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1413/2815] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:18:09.653418 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a9803-f614-4ef1-9a4f-6c6d1122202b None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:09.655706 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6e0a9803-f614-4ef1-9a4f-6c6d1122202b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:09.671046 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a9803-f614-4ef1-9a4f-6c6d1122202b None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:09.678503 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae7190-a1c0-4726-9b5f-03c567123be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:09.679654 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae7190-a1c0-4726-9b5f-03c567123be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:09.680187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae7190-a1c0-4726-9b5f-03c567123be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:09.680631 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae7190-a1c0-4726-9b5f-03c567123be2 admin admin] PATH_INFO: `/v3/projects/9da567956b4644789fdf6da90ededd75` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:09.682106 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae7190-a1c0-4726-9b5f-03c567123be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da567956b4644789fdf6da90ededd75)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:09.684277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae7190-a1c0-4726-9b5f-03c567123be2 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:09.798532 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-76ae7190-a1c0-4726-9b5f-03c567123be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da567956b4644789fdf6da90ededd75', 'request_id': 'req-76ae7190-a1c0-4726-9b5f-03c567123be2'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:09.866220 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-76ae7190-a1c0-4726-9b5f-03c567123be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da567956b4644789fdf6da90ededd75', 'request_id': 'req-76ae7190-a1c0-4726-9b5f-03c567123be2'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:09.871809 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-76ae7190-a1c0-4726-9b5f-03c567123be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da567956b4644789fdf6da90ededd75', 'request_id': 'req-76ae7190-a1c0-4726-9b5f-03c567123be2'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:09.882517 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-76ae7190-a1c0-4726-9b5f-03c567123be2 admin admin] The token cache is being invalidate because project 9da567956b4644789fdf6da90ededd75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:18:09.882804 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-76ae7190-a1c0-4726-9b5f-03c567123be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:09.883417 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-76ae7190-a1c0-4726-9b5f-03c567123be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:09.885012 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1403/2816] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:18:09 2022] DELETE /identity/v3/projects/9da567956b4644789fdf6da90ededd75 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:18:09.889064 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16a644-2d14-4f7e-90e7-d6315a0215e4 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:09.899316 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16a644-2d14-4f7e-90e7-d6315a0215e4 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:09.918304 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:18:09.955659 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebc22f-7a87-42d8-964d-ef9526ce03a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:09.956548 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebc22f-7a87-42d8-964d-ef9526ce03a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:09.956855 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebc22f-7a87-42d8-964d-ef9526ce03a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:09.957115 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebc22f-7a87-42d8-964d-ef9526ce03a2 admin admin] PATH_INFO: `/v3/users/ded2c2866f584d959499715feef50337` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:09.958293 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebc22f-7a87-42d8-964d-ef9526ce03a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded2c2866f584d959499715feef50337)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:09.960297 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebc22f-7a87-42d8-964d-ef9526ce03a2 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:10.170732 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-45ebc22f-7a87-42d8-964d-ef9526ce03a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded2c2866f584d959499715feef50337'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:10.177552 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-45ebc22f-7a87-42d8-964d-ef9526ce03a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded2c2866f584d959499715feef50337'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:10.179696 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-45ebc22f-7a87-42d8-964d-ef9526ce03a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded2c2866f584d959499715feef50337'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:10.190373 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-45ebc22f-7a87-42d8-964d-ef9526ce03a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded2c2866f584d959499715feef50337'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:10.191024 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-45ebc22f-7a87-42d8-964d-ef9526ce03a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded2c2866f584d959499715feef50337'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:10.257517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1414/2817] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:18:09 2022] DELETE /identity/v3/users/ded2c2866f584d959499715feef50337 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:18:10.696128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae7190-a1c0-4726-9b5f-03c567123be2 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:10.697683 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-76ae7190-a1c0-4726-9b5f-03c567123be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:10.712406 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae7190-a1c0-4726-9b5f-03c567123be2 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:10.769485 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b344d5-a77f-40d0-948e-efcb25d961bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:10.770346 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b344d5-a77f-40d0-948e-efcb25d961bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:10.770627 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b344d5-a77f-40d0-948e-efcb25d961bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:10.770897 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b344d5-a77f-40d0-948e-efcb25d961bc admin admin] PATH_INFO: `/v3/projects/df3d50a93ec248d0add7ba6e57582750` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:10.772120 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b344d5-a77f-40d0-948e-efcb25d961bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=df3d50a93ec248d0add7ba6e57582750)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:10.774060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b344d5-a77f-40d0-948e-efcb25d961bc admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:10.882744 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:18:10.898872 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e6b344d5-a77f-40d0-948e-efcb25d961bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df3d50a93ec248d0add7ba6e57582750', 'request_id': 'req-e6b344d5-a77f-40d0-948e-efcb25d961bc'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:10.980870 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e6b344d5-a77f-40d0-948e-efcb25d961bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df3d50a93ec248d0add7ba6e57582750', 'request_id': 'req-e6b344d5-a77f-40d0-948e-efcb25d961bc'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:10.986486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e6b344d5-a77f-40d0-948e-efcb25d961bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df3d50a93ec248d0add7ba6e57582750', 'request_id': 'req-e6b344d5-a77f-40d0-948e-efcb25d961bc'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:10.997668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e6b344d5-a77f-40d0-948e-efcb25d961bc admin admin] The token cache is being invalidate because project df3d50a93ec248d0add7ba6e57582750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:18:10.997954 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e6b344d5-a77f-40d0-948e-efcb25d961bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:10.998581 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-e6b344d5-a77f-40d0-948e-efcb25d961bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:11.001044 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1404/2818] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:18:10 2022] DELETE /identity/v3/projects/df3d50a93ec248d0add7ba6e57582750 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:18:11.005597 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21ae34-ef48-434f-a5e7-21dbd4c99d93 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:11.006099 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21ae34-ef48-434f-a5e7-21dbd4c99d93 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:11.006209 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21ae34-ef48-434f-a5e7-21dbd4c99d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:11.024676 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-0c21ae34-ef48-434f-a5e7-21dbd4c99d93 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:18:11.026347 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-0c21ae34-ef48-434f-a5e7-21dbd4c99d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:11.084678 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1415/2819] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:18:11.093535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630f6b2-a161-45c3-af1b-f04424190790 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:11.093852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630f6b2-a161-45c3-af1b-f04424190790 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:11.094139 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630f6b2-a161-45c3-af1b-f04424190790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:11.111946 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-b630f6b2-a161-45c3-af1b-f04424190790 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:18:11.113200 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b630f6b2-a161-45c3-af1b-f04424190790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:11.121071 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1405/2820] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:18:11.125600 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21ae34-ef48-434f-a5e7-21dbd4c99d93 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:11.135108 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21ae34-ef48-434f-a5e7-21dbd4c99d93 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:11.139628 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca4c5c-192e-4e8a-8cfd-ebc4d5af603f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:11.140308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca4c5c-192e-4e8a-8cfd-ebc4d5af603f admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:11.141216 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca4c5c-192e-4e8a-8cfd-ebc4d5af603f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:11.141510 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca4c5c-192e-4e8a-8cfd-ebc4d5af603f admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:11.142240 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca4c5c-192e-4e8a-8cfd-ebc4d5af603f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:18:11.142550 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca4c5c-192e-4e8a-8cfd-ebc4d5af603f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:11.144200 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca4c5c-192e-4e8a-8cfd-ebc4d5af603f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:11.155481 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1416/2821] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:18:11.159619 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630f6b2-a161-45c3-af1b-f04424190790 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:11.168657 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630f6b2-a161-45c3-af1b-f04424190790 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:11.174034 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b4f8d-1863-4a28-9f20-174e01629f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:11.174667 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b4f8d-1863-4a28-9f20-174e01629f32 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:11.174947 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b4f8d-1863-4a28-9f20-174e01629f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:11.175223 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b4f8d-1863-4a28-9f20-174e01629f32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:11.175909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b4f8d-1863-4a28-9f20-174e01629f32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:11.177831 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b4f8d-1863-4a28-9f20-174e01629f32 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:11.251492 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1406/2822] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:18:11 2022] POST /identity/v3/projects => generated 407 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:18:11.255600 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca4c5c-192e-4e8a-8cfd-ebc4d5af603f admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:11.265626 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca4c5c-192e-4e8a-8cfd-ebc4d5af603f admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:11.292931 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:18:11.323739 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871e73b-9f19-410a-93ab-bba77d483973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:11.324483 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871e73b-9f19-410a-93ab-bba77d483973 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:11.324753 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871e73b-9f19-410a-93ab-bba77d483973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:11.325032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871e73b-9f19-410a-93ab-bba77d483973 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:11.325719 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871e73b-9f19-410a-93ab-bba77d483973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:11.327627 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871e73b-9f19-410a-93ab-bba77d483973 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:11.393219 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1417/2823] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:18:11 2022] POST /identity/v3/users => generated 304 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:18:11.397187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b4f8d-1863-4a28-9f20-174e01629f32 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:11.408484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b4f8d-1863-4a28-9f20-174e01629f32 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:11.413019 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05977326-ae8d-488c-847b-ffebe830e8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:11.413673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05977326-ae8d-488c-847b-ffebe830e8bc admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:11.413957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05977326-ae8d-488c-847b-ffebe830e8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:11.414228 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05977326-ae8d-488c-847b-ffebe830e8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:11.414953 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05977326-ae8d-488c-847b-ffebe830e8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:11.416684 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05977326-ae8d-488c-847b-ffebe830e8bc admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:11.427432 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1407/2824] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:18:11.431257 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871e73b-9f19-410a-93ab-bba77d483973 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:11.441076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871e73b-9f19-410a-93ab-bba77d483973 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:11.445716 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20fa08-d086-4ae7-8cd7-dc6de8e03feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:11.446357 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20fa08-d086-4ae7-8cd7-dc6de8e03feb admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:11.446645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20fa08-d086-4ae7-8cd7-dc6de8e03feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:11.446924 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20fa08-d086-4ae7-8cd7-dc6de8e03feb admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:11.447664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20fa08-d086-4ae7-8cd7-dc6de8e03feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:11.449278 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20fa08-d086-4ae7-8cd7-dc6de8e03feb admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:11.459709 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1418/2825] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:18:11.463714 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05977326-ae8d-488c-847b-ffebe830e8bc admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:11.474169 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05977326-ae8d-488c-847b-ffebe830e8bc admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:11.478767 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb850339-2fca-44fb-8e54-b8bcdca75fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:11.479625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb850339-2fca-44fb-8e54-b8bcdca75fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:11.479903 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb850339-2fca-44fb-8e54-b8bcdca75fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:11.480242 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb850339-2fca-44fb-8e54-b8bcdca75fb3 admin admin] PATH_INFO: `/v3/projects/93355f941ab940e8a02b0b4aac6f7444/users/04f6412ff823442cb6019663cf23272c/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:11.494467 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb850339-2fca-44fb-8e54-b8bcdca75fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93355f941ab940e8a02b0b4aac6f7444, user_id=04f6412ff823442cb6019663cf23272c, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:11.497168 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb850339-2fca-44fb-8e54-b8bcdca75fb3 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:11.567786 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1408/2826] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:18:11 2022] PUT /identity/v3/projects/93355f941ab940e8a02b0b4aac6f7444/users/04f6412ff823442cb6019663cf23272c/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:18:11.578091 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8c345-2e49-443e-8baa-d20f259c8796 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:11.578960 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8c345-2e49-443e-8baa-d20f259c8796 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:11.579332 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8c345-2e49-443e-8baa-d20f259c8796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:11.605645 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-70d8c345-2e49-443e-8baa-d20f259c8796 None None] MFA Rules not processed for user `04f6412ff823442cb6019663cf23272c`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:18:11.606854 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-70d8c345-2e49-443e-8baa-d20f259c8796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:11.671258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1419/2827] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:18:11 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:18:11.676440 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb850339-2fca-44fb-8e54-b8bcdca75fb3 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:11.737271 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb850339-2fca-44fb-8e54-b8bcdca75fb3 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:11.741979 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4446a6-4da8-46c6-b075-ff184cb1f152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:11.742625 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4446a6-4da8-46c6-b075-ff184cb1f152 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:11.742909 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4446a6-4da8-46c6-b075-ff184cb1f152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:11.743187 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4446a6-4da8-46c6-b075-ff184cb1f152 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:11.743889 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4446a6-4da8-46c6-b075-ff184cb1f152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:11.745826 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4446a6-4da8-46c6-b075-ff184cb1f152 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:11.853913 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1409/2828] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:18:11 2022] POST /identity/v3/projects => generated 407 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:18:11.858058 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8c345-2e49-443e-8baa-d20f259c8796 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:11.869402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8c345-2e49-443e-8baa-d20f259c8796 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:11.927925 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f1cc6-273f-4435-bd79-8a4be4f02670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:11.928612 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f1cc6-273f-4435-bd79-8a4be4f02670 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:11.928895 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f1cc6-273f-4435-bd79-8a4be4f02670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:11.929168 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f1cc6-273f-4435-bd79-8a4be4f02670 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:11.929900 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f1cc6-273f-4435-bd79-8a4be4f02670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:11.931798 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f1cc6-273f-4435-bd79-8a4be4f02670 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:12.015458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1420/2829] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:18:11 2022] POST /identity/v3/users => generated 310 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:18:12.020083 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4446a6-4da8-46c6-b075-ff184cb1f152 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:12.030673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4446a6-4da8-46c6-b075-ff184cb1f152 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:12.035960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21026e64-1356-40e1-9ba0-1263c179f20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:12.036653 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21026e64-1356-40e1-9ba0-1263c179f20a admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:12.036941 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21026e64-1356-40e1-9ba0-1263c179f20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:12.037220 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21026e64-1356-40e1-9ba0-1263c179f20a admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:12.037960 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21026e64-1356-40e1-9ba0-1263c179f20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:12.039555 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21026e64-1356-40e1-9ba0-1263c179f20a admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:12.050478 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1410/2830] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:18:12.054684 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f1cc6-273f-4435-bd79-8a4be4f02670 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:12.064594 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f1cc6-273f-4435-bd79-8a4be4f02670 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:12.069110 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205207b-cffc-4796-b7c0-d50e6ed41b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:12.069969 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205207b-cffc-4796-b7c0-d50e6ed41b7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:12.070251 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205207b-cffc-4796-b7c0-d50e6ed41b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:12.070522 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205207b-cffc-4796-b7c0-d50e6ed41b7a admin admin] PATH_INFO: `/v3/projects/d60c9a1504e44889932c1e2195aea2ab/users/3a4b56be4b514bd8bf39a027ef6ec929/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:12.085245 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205207b-cffc-4796-b7c0-d50e6ed41b7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60c9a1504e44889932c1e2195aea2ab, user_id=3a4b56be4b514bd8bf39a027ef6ec929, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:12.087880 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205207b-cffc-4796-b7c0-d50e6ed41b7a admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:12.164540 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1421/2831] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:18:12 2022] PUT /identity/v3/projects/d60c9a1504e44889932c1e2195aea2ab/users/3a4b56be4b514bd8bf39a027ef6ec929/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:18:12.164727 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21026e64-1356-40e1-9ba0-1263c179f20a admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:12.172880 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21026e64-1356-40e1-9ba0-1263c179f20a admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:12.193269 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:18:12.229610 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3610d-c6ae-4515-a927-372f980a4da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:12.230288 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3610d-c6ae-4515-a927-372f980a4da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:12.230576 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3610d-c6ae-4515-a927-372f980a4da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:12.230856 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3610d-c6ae-4515-a927-372f980a4da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:12.231600 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3610d-c6ae-4515-a927-372f980a4da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:12.233259 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3610d-c6ae-4515-a927-372f980a4da3 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:12.244199 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1411/2832] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:18:12.248462 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205207b-cffc-4796-b7c0-d50e6ed41b7a admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:12.254004 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:18:12.259271 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205207b-cffc-4796-b7c0-d50e6ed41b7a admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:12.263928 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516df95-cf63-4863-aea5-90214908e554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:12.264830 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516df95-cf63-4863-aea5-90214908e554 admin admin] REQUEST_METHOD: `PUT` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:12.265114 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516df95-cf63-4863-aea5-90214908e554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:12.265391 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516df95-cf63-4863-aea5-90214908e554 admin admin] PATH_INFO: `/v3/projects/d60c9a1504e44889932c1e2195aea2ab/users/3a4b56be4b514bd8bf39a027ef6ec929/roles/459b0e5c21c94fb1b81f76c65780fdb5` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:12.267888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516df95-cf63-4863-aea5-90214908e554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60c9a1504e44889932c1e2195aea2ab, user_id=3a4b56be4b514bd8bf39a027ef6ec929, role_id=459b0e5c21c94fb1b81f76c65780fdb5)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:12.270539 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516df95-cf63-4863-aea5-90214908e554 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:12.280666 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1422/2833] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:18:12 2022] PUT /identity/v3/projects/d60c9a1504e44889932c1e2195aea2ab/users/3a4b56be4b514bd8bf39a027ef6ec929/roles/459b0e5c21c94fb1b81f76c65780fdb5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:18:12.291596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06308f40-4ac4-47be-ad98-34ad14dcb303 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:12.291877 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06308f40-4ac4-47be-ad98-34ad14dcb303 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:12.292302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06308f40-4ac4-47be-ad98-34ad14dcb303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:12.318813 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-06308f40-4ac4-47be-ad98-34ad14dcb303 None None] MFA Rules not processed for user `3a4b56be4b514bd8bf39a027ef6ec929`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:18:12.320053 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-06308f40-4ac4-47be-ad98-34ad14dcb303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:12.386836 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1412/2834] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:18:12 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:18:12.398082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516df95-cf63-4863-aea5-90214908e554 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:12.399737 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e516df95-cf63-4863-aea5-90214908e554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:12.455655 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516df95-cf63-4863-aea5-90214908e554 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:12.459122 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39369523-b905-4dce-a4e6-830a38c0b942 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:12.459818 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39369523-b905-4dce-a4e6-830a38c0b942 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:12.460067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39369523-b905-4dce-a4e6-830a38c0b942 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:12.460368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39369523-b905-4dce-a4e6-830a38c0b942 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:12.469130 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39369523-b905-4dce-a4e6-830a38c0b942 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:12.470555 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39369523-b905-4dce-a4e6-830a38c0b942 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:12.479744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1423/2835] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:18:12 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:18:12.823871 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06308f40-4ac4-47be-ad98-34ad14dcb303 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:12.834042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06308f40-4ac4-47be-ad98-34ad14dcb303 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:12.837762 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fafbc-904b-4f56-915b-4a538ef449ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:12.838397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fafbc-904b-4f56-915b-4a538ef449ab service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:12.838681 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fafbc-904b-4f56-915b-4a538ef449ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:12.838957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fafbc-904b-4f56-915b-4a538ef449ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:12.894385 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fafbc-904b-4f56-915b-4a538ef449ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:12.895804 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fafbc-904b-4f56-915b-4a538ef449ab service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:12.904712 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1413/2836] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:18:12 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:18:22.475687 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:18:22.900699 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=80 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:18:24.940076 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39369523-b905-4dce-a4e6-830a38c0b942 service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:25.001097 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39369523-b905-4dce-a4e6-830a38c0b942 service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:25.006425 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc87c6d-0789-4be8-8d1b-286846391103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:25.007299 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc87c6d-0789-4be8-8d1b-286846391103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:25.007583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc87c6d-0789-4be8-8d1b-286846391103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:25.007860 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc87c6d-0789-4be8-8d1b-286846391103 admin admin] PATH_INFO: `/v3/users/04f6412ff823442cb6019663cf23272c` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:25.009110 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc87c6d-0789-4be8-8d1b-286846391103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04f6412ff823442cb6019663cf23272c)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:25.011068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc87c6d-0789-4be8-8d1b-286846391103 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:25.193638 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-bdc87c6d-0789-4be8-8d1b-286846391103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04f6412ff823442cb6019663cf23272c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:25.200357 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-bdc87c6d-0789-4be8-8d1b-286846391103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04f6412ff823442cb6019663cf23272c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:25.201020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-bdc87c6d-0789-4be8-8d1b-286846391103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04f6412ff823442cb6019663cf23272c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:25.212625 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-bdc87c6d-0789-4be8-8d1b-286846391103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04f6412ff823442cb6019663cf23272c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:25.213248 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-bdc87c6d-0789-4be8-8d1b-286846391103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04f6412ff823442cb6019663cf23272c'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:25.271583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1424/2837] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:18:24 2022] DELETE /identity/v3/users/04f6412ff823442cb6019663cf23272c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:18:25.276333 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77460611-a175-44bd-b312-34918f173916 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:25.280576 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77460611-a175-44bd-b312-34918f173916 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:25.280576 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77460611-a175-44bd-b312-34918f173916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:25.293764 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-77460611-a175-44bd-b312-34918f173916 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:18:25.294972 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-77460611-a175-44bd-b312-34918f173916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:25.352082 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1414/2838] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:18:25.362309 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc87c6d-0789-4be8-8d1b-286846391103 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:25.363812 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-bdc87c6d-0789-4be8-8d1b-286846391103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:25.420067 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc87c6d-0789-4be8-8d1b-286846391103 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:25.424513 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bd7bd-a684-47a3-b15e-131ca4526dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:25.425155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bd7bd-a684-47a3-b15e-131ca4526dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:25.425441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bd7bd-a684-47a3-b15e-131ca4526dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:25.425719 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bd7bd-a684-47a3-b15e-131ca4526dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:25.434579 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26bd7bd-a684-47a3-b15e-131ca4526dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:25.436007 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26bd7bd-a684-47a3-b15e-131ca4526dc9 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:25.445454 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1425/2839] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:18:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:18:25.855208 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77460611-a175-44bd-b312-34918f173916 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:25.856792 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-77460611-a175-44bd-b312-34918f173916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:25.870735 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77460611-a175-44bd-b312-34918f173916 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:25.875413 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba47c45-7ce6-46f3-98a8-c9a9c89900e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:25.876310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba47c45-7ce6-46f3-98a8-c9a9c89900e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:25.876596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba47c45-7ce6-46f3-98a8-c9a9c89900e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:25.876869 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba47c45-7ce6-46f3-98a8-c9a9c89900e7 admin admin] PATH_INFO: `/v3/projects/93355f941ab940e8a02b0b4aac6f7444` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:25.878734 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba47c45-7ce6-46f3-98a8-c9a9c89900e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93355f941ab940e8a02b0b4aac6f7444)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:25.881098 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba47c45-7ce6-46f3-98a8-c9a9c89900e7 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:25.985603 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4ba47c45-7ce6-46f3-98a8-c9a9c89900e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93355f941ab940e8a02b0b4aac6f7444', 'request_id': 'req-4ba47c45-7ce6-46f3-98a8-c9a9c89900e7'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:26.064337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4ba47c45-7ce6-46f3-98a8-c9a9c89900e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93355f941ab940e8a02b0b4aac6f7444', 'request_id': 'req-4ba47c45-7ce6-46f3-98a8-c9a9c89900e7'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:26.071010 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4ba47c45-7ce6-46f3-98a8-c9a9c89900e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93355f941ab940e8a02b0b4aac6f7444', 'request_id': 'req-4ba47c45-7ce6-46f3-98a8-c9a9c89900e7'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:26.082107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4ba47c45-7ce6-46f3-98a8-c9a9c89900e7 admin admin] The token cache is being invalidate because project 93355f941ab940e8a02b0b4aac6f7444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:18:26.084397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4ba47c45-7ce6-46f3-98a8-c9a9c89900e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:26.084397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4ba47c45-7ce6-46f3-98a8-c9a9c89900e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:26.084672 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1415/2840] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:18:25 2022] DELETE /identity/v3/projects/93355f941ab940e8a02b0b4aac6f7444 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:18:26.088640 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bd7bd-a684-47a3-b15e-131ca4526dc9 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:26.098517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bd7bd-a684-47a3-b15e-131ca4526dc9 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:26.117026 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:18:26.153681 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7740a-5370-4a54-9dca-bf98d22d05bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:26.154538 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7740a-5370-4a54-9dca-bf98d22d05bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:26.154816 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7740a-5370-4a54-9dca-bf98d22d05bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:26.155088 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7740a-5370-4a54-9dca-bf98d22d05bf admin admin] PATH_INFO: `/v3/users/3a4b56be4b514bd8bf39a027ef6ec929` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:26.156310 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7740a-5370-4a54-9dca-bf98d22d05bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a4b56be4b514bd8bf39a027ef6ec929)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:26.158215 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7740a-5370-4a54-9dca-bf98d22d05bf admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:26.387486 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d5b7740a-5370-4a54-9dca-bf98d22d05bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a4b56be4b514bd8bf39a027ef6ec929'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:26.394426 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d5b7740a-5370-4a54-9dca-bf98d22d05bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a4b56be4b514bd8bf39a027ef6ec929'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:26.395094 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d5b7740a-5370-4a54-9dca-bf98d22d05bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a4b56be4b514bd8bf39a027ef6ec929'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:26.407020 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d5b7740a-5370-4a54-9dca-bf98d22d05bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a4b56be4b514bd8bf39a027ef6ec929'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:26.407678 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-d5b7740a-5370-4a54-9dca-bf98d22d05bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a4b56be4b514bd8bf39a027ef6ec929'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:26.486337 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1426/2841] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:18:26 2022] DELETE /identity/v3/users/3a4b56be4b514bd8bf39a027ef6ec929 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:18:26.879335 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba47c45-7ce6-46f3-98a8-c9a9c89900e7 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:26.880785 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-4ba47c45-7ce6-46f3-98a8-c9a9c89900e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:26.894722 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba47c45-7ce6-46f3-98a8-c9a9c89900e7 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:26.952026 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b3278-bb3f-4568-8e1f-8220454bdd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:26.952852 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b3278-bb3f-4568-8e1f-8220454bdd65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:26.953139 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b3278-bb3f-4568-8e1f-8220454bdd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:26.953416 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b3278-bb3f-4568-8e1f-8220454bdd65 admin admin] PATH_INFO: `/v3/projects/d60c9a1504e44889932c1e2195aea2ab` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:26.954611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b3278-bb3f-4568-8e1f-8220454bdd65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60c9a1504e44889932c1e2195aea2ab)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:26.957170 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b3278-bb3f-4568-8e1f-8220454bdd65 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:27.033844 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:18:27.052289 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4c5b3278-bb3f-4568-8e1f-8220454bdd65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60c9a1504e44889932c1e2195aea2ab', 'request_id': 'req-4c5b3278-bb3f-4568-8e1f-8220454bdd65'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:27.095278 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4c5b3278-bb3f-4568-8e1f-8220454bdd65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60c9a1504e44889932c1e2195aea2ab', 'request_id': 'req-4c5b3278-bb3f-4568-8e1f-8220454bdd65'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:27.101102 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4c5b3278-bb3f-4568-8e1f-8220454bdd65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60c9a1504e44889932c1e2195aea2ab', 'request_id': 'req-4c5b3278-bb3f-4568-8e1f-8220454bdd65'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:27.112087 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4c5b3278-bb3f-4568-8e1f-8220454bdd65 admin admin] The token cache is being invalidate because project d60c9a1504e44889932c1e2195aea2ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:18:27.112413 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4c5b3278-bb3f-4568-8e1f-8220454bdd65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:27.113042 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4c5b3278-bb3f-4568-8e1f-8220454bdd65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:27.114635 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1416/2842] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:18:26 2022] DELETE /identity/v3/projects/d60c9a1504e44889932c1e2195aea2ab => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:18:27.119688 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebe6e9-9504-4724-b692-e5ba0a00cbdc None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:27.120201 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebe6e9-9504-4724-b692-e5ba0a00cbdc None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:27.120310 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebe6e9-9504-4724-b692-e5ba0a00cbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:27.138026 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-b6ebe6e9-9504-4724-b692-e5ba0a00cbdc None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:18:27.139208 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-b6ebe6e9-9504-4724-b692-e5ba0a00cbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:27.197472 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1427/2843] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:18:27.206987 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95504e71-d535-4a48-8ee9-b440c5aaf0e1 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:27.207214 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95504e71-d535-4a48-8ee9-b440c5aaf0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:27.207490 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95504e71-d535-4a48-8ee9-b440c5aaf0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:27.225575 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-95504e71-d535-4a48-8ee9-b440c5aaf0e1 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:18:27.226763 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-95504e71-d535-4a48-8ee9-b440c5aaf0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:27.234466 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1417/2844] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:18:27.239039 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebe6e9-9504-4724-b692-e5ba0a00cbdc None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:27.248638 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebe6e9-9504-4724-b692-e5ba0a00cbdc None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:27.253193 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639757f-ba2f-4eb6-bc2c-15fb20793799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:27.253840 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639757f-ba2f-4eb6-bc2c-15fb20793799 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:27.254129 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639757f-ba2f-4eb6-bc2c-15fb20793799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:27.254409 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639757f-ba2f-4eb6-bc2c-15fb20793799 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:27.255144 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639757f-ba2f-4eb6-bc2c-15fb20793799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:18:27.255483 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639757f-ba2f-4eb6-bc2c-15fb20793799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:27.257123 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639757f-ba2f-4eb6-bc2c-15fb20793799 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:27.269389 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1428/2845] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:18:27.272906 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95504e71-d535-4a48-8ee9-b440c5aaf0e1 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:27.281890 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95504e71-d535-4a48-8ee9-b440c5aaf0e1 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:27.289377 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b01361-b958-4c96-94db-ec82336cab37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:27.290035 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b01361-b958-4c96-94db-ec82336cab37 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:27.290321 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b01361-b958-4c96-94db-ec82336cab37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:27.290600 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b01361-b958-4c96-94db-ec82336cab37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:27.291314 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b01361-b958-4c96-94db-ec82336cab37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:27.295918 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b01361-b958-4c96-94db-ec82336cab37 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:27.370154 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1418/2846] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:18:27 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 22 17:18:27.374552 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639757f-ba2f-4eb6-bc2c-15fb20793799 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:27.384723 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639757f-ba2f-4eb6-bc2c-15fb20793799 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:27.412297 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:18:27.441132 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13573d7b-7c3f-498f-a9c4-7225a2baa64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:27.441793 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13573d7b-7c3f-498f-a9c4-7225a2baa64f admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:27.442082 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13573d7b-7c3f-498f-a9c4-7225a2baa64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:27.442363 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13573d7b-7c3f-498f-a9c4-7225a2baa64f admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:27.443065 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13573d7b-7c3f-498f-a9c4-7225a2baa64f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:27.445027 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13573d7b-7c3f-498f-a9c4-7225a2baa64f admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:27.515597 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1429/2847] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:18:27 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:18:27.520254 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b01361-b958-4c96-94db-ec82336cab37 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:27.530491 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b01361-b958-4c96-94db-ec82336cab37 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:27.535773 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb69c7-e499-471f-9bb6-c7cbb92eeb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:27.536544 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb69c7-e499-471f-9bb6-c7cbb92eeb91 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:27.536828 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb69c7-e499-471f-9bb6-c7cbb92eeb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:27.537104 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb69c7-e499-471f-9bb6-c7cbb92eeb91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:27.537830 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb69c7-e499-471f-9bb6-c7cbb92eeb91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:27.539417 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb69c7-e499-471f-9bb6-c7cbb92eeb91 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:27.550116 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1419/2848] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:18:27.554018 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13573d7b-7c3f-498f-a9c4-7225a2baa64f admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:27.563806 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13573d7b-7c3f-498f-a9c4-7225a2baa64f admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:27.568573 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b165df-2404-4bf5-ba87-4d05a8e286ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:27.569218 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b165df-2404-4bf5-ba87-4d05a8e286ce admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:27.569502 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b165df-2404-4bf5-ba87-4d05a8e286ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:27.569782 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b165df-2404-4bf5-ba87-4d05a8e286ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:27.570516 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b165df-2404-4bf5-ba87-4d05a8e286ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:27.572172 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b165df-2404-4bf5-ba87-4d05a8e286ce admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:27.582317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1430/2849] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:18:27.586397 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb69c7-e499-471f-9bb6-c7cbb92eeb91 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:27.597051 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb69c7-e499-471f-9bb6-c7cbb92eeb91 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:27.601683 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d861a-a60a-47eb-a909-57be65d83504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:27.602548 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d861a-a60a-47eb-a909-57be65d83504 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:27.602834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d861a-a60a-47eb-a909-57be65d83504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:27.603116 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d861a-a60a-47eb-a909-57be65d83504 admin admin] PATH_INFO: `/v3/projects/6e8b60143934471c9f73d73fbccdebd8/users/9f3b95a0a12249019b49b05bd9844657/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:27.617415 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d861a-a60a-47eb-a909-57be65d83504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8b60143934471c9f73d73fbccdebd8, user_id=9f3b95a0a12249019b49b05bd9844657, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:27.622820 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d861a-a60a-47eb-a909-57be65d83504 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:27.705996 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1420/2850] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:18:27 2022] PUT /identity/v3/projects/6e8b60143934471c9f73d73fbccdebd8/users/9f3b95a0a12249019b49b05bd9844657/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:18:27.717910 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17776a9a-101b-4726-aa8f-095e9366af3d None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:27.718244 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17776a9a-101b-4726-aa8f-095e9366af3d None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:27.718526 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17776a9a-101b-4726-aa8f-095e9366af3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:27.754842 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-17776a9a-101b-4726-aa8f-095e9366af3d None None] MFA Rules not processed for user `9f3b95a0a12249019b49b05bd9844657`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:18:27.756055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-17776a9a-101b-4726-aa8f-095e9366af3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:27.817776 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1431/2851] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:18:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:18:27.828702 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d861a-a60a-47eb-a909-57be65d83504 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:27.830537 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-533d861a-a60a-47eb-a909-57be65d83504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:27.886917 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d861a-a60a-47eb-a909-57be65d83504 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:27.890598 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04ee06-6446-4c61-a765-b38718656f70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:27.891237 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04ee06-6446-4c61-a765-b38718656f70 service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:27.891520 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04ee06-6446-4c61-a765-b38718656f70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:27.891796 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04ee06-6446-4c61-a765-b38718656f70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:27.899915 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04ee06-6446-4c61-a765-b38718656f70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:27.901356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04ee06-6446-4c61-a765-b38718656f70 service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:27.910598 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1421/2852] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:18:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:18:27.930482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17776a9a-101b-4726-aa8f-095e9366af3d None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:27.994253 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17776a9a-101b-4726-aa8f-095e9366af3d None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:27.998799 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc5491-c4d7-4768-9f1b-7d557715339c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:27.999656 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc5491-c4d7-4768-9f1b-7d557715339c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:27.999944 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc5491-c4d7-4768-9f1b-7d557715339c admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:28.000258 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc5491-c4d7-4768-9f1b-7d557715339c admin admin] PATH_INFO: `/v3/users/9f3b95a0a12249019b49b05bd9844657` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:28.002316 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc5491-c4d7-4768-9f1b-7d557715339c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f3b95a0a12249019b49b05bd9844657)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:28.004288 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc5491-c4d7-4768-9f1b-7d557715339c admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:28.180300 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:18:28.185923 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-70dc5491-c4d7-4768-9f1b-7d557715339c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f3b95a0a12249019b49b05bd9844657'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:28.192599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-70dc5491-c4d7-4768-9f1b-7d557715339c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f3b95a0a12249019b49b05bd9844657'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:28.193278 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-70dc5491-c4d7-4768-9f1b-7d557715339c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f3b95a0a12249019b49b05bd9844657'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:28.204712 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-70dc5491-c4d7-4768-9f1b-7d557715339c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f3b95a0a12249019b49b05bd9844657'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:28.205937 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-70dc5491-c4d7-4768-9f1b-7d557715339c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f3b95a0a12249019b49b05bd9844657'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:28.287281 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1432/2853] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:18:27 2022] DELETE /identity/v3/users/9f3b95a0a12249019b49b05bd9844657 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:18:28.291848 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68795746-2a28-4759-b435-d082cd5e1339 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:28.292175 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68795746-2a28-4759-b435-d082cd5e1339 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:28.292463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68795746-2a28-4759-b435-d082cd5e1339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:28.309608 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-68795746-2a28-4759-b435-d082cd5e1339 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:18:28.310834 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-68795746-2a28-4759-b435-d082cd5e1339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:28.356854 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:18:28.368612 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1422/2854] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:18:28.378594 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc5491-c4d7-4768-9f1b-7d557715339c admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:28.380032 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-70dc5491-c4d7-4768-9f1b-7d557715339c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:28.435949 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc5491-c4d7-4768-9f1b-7d557715339c admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:28.440056 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecf547-d127-4bed-9b62-147c070a0f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:28.440727 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecf547-d127-4bed-9b62-147c070a0f1d service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:28.441006 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecf547-d127-4bed-9b62-147c070a0f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:28.441285 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecf547-d127-4bed-9b62-147c070a0f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:28.450590 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecf547-d127-4bed-9b62-147c070a0f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:28.452029 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecf547-d127-4bed-9b62-147c070a0f1d service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:28.462097 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1433/2855] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:18:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:18:28.854127 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68795746-2a28-4759-b435-d082cd5e1339 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:28.855717 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-68795746-2a28-4759-b435-d082cd5e1339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:28.868567 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68795746-2a28-4759-b435-d082cd5e1339 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:28.873770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b274838b-e06c-43ce-96a1-932b6176d7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:28.874637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274838b-e06c-43ce-96a1-932b6176d7f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:28.874993 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274838b-e06c-43ce-96a1-932b6176d7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:28.875271 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b274838b-e06c-43ce-96a1-932b6176d7f6 admin admin] PATH_INFO: `/v3/projects/6e8b60143934471c9f73d73fbccdebd8` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:28.876494 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274838b-e06c-43ce-96a1-932b6176d7f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e8b60143934471c9f73d73fbccdebd8)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:28.878994 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b274838b-e06c-43ce-96a1-932b6176d7f6 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:29.001653 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-b274838b-e06c-43ce-96a1-932b6176d7f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e8b60143934471c9f73d73fbccdebd8', 'request_id': 'req-b274838b-e06c-43ce-96a1-932b6176d7f6'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:29.077714 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-b274838b-e06c-43ce-96a1-932b6176d7f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e8b60143934471c9f73d73fbccdebd8', 'request_id': 'req-b274838b-e06c-43ce-96a1-932b6176d7f6'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:29.083766 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-b274838b-e06c-43ce-96a1-932b6176d7f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e8b60143934471c9f73d73fbccdebd8', 'request_id': 'req-b274838b-e06c-43ce-96a1-932b6176d7f6'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:29.097329 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-b274838b-e06c-43ce-96a1-932b6176d7f6 admin admin] The token cache is being invalidate because project 6e8b60143934471c9f73d73fbccdebd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:18:29.097618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-b274838b-e06c-43ce-96a1-932b6176d7f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:29.098249 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-b274838b-e06c-43ce-96a1-932b6176d7f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:18:29.099847 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1423/2856] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:18:28 2022] DELETE /identity/v3/projects/6e8b60143934471c9f73d73fbccdebd8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:18:29.104817 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf4f7b-deb4-4ffd-8358-17b168b13c50 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:29.105196 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf4f7b-deb4-4ffd-8358-17b168b13c50 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:29.105482 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf4f7b-deb4-4ffd-8358-17b168b13c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:29.123424 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-c9cf4f7b-deb4-4ffd-8358-17b168b13c50 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:18:29.124654 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-c9cf4f7b-deb4-4ffd-8358-17b168b13c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:29.182308 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1434/2857] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:18:29.190015 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c84af-bb7d-4dd2-b0bb-5cd98f00a2ca None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:29.190304 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c84af-bb7d-4dd2-b0bb-5cd98f00a2ca None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:29.190599 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c84af-bb7d-4dd2-b0bb-5cd98f00a2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:29.207524 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-b41c84af-bb7d-4dd2-b0bb-5cd98f00a2ca None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:18:29.208737 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b41c84af-bb7d-4dd2-b0bb-5cd98f00a2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:29.216416 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1424/2858] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:18:29.220294 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf4f7b-deb4-4ffd-8358-17b168b13c50 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:29.230314 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf4f7b-deb4-4ffd-8358-17b168b13c50 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:29.234794 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964dec0-160e-499f-8bf7-c4f8cb52469d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:29.235432 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964dec0-160e-499f-8bf7-c4f8cb52469d admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:29.235718 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964dec0-160e-499f-8bf7-c4f8cb52469d admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:29.235998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964dec0-160e-499f-8bf7-c4f8cb52469d admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:29.236758 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964dec0-160e-499f-8bf7-c4f8cb52469d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:18:29.237071 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964dec0-160e-499f-8bf7-c4f8cb52469d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:29.239246 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964dec0-160e-499f-8bf7-c4f8cb52469d admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:29.256635 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1435/2859] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:18:29.260881 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c84af-bb7d-4dd2-b0bb-5cd98f00a2ca None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:29.269922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c84af-bb7d-4dd2-b0bb-5cd98f00a2ca None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:29.274493 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3874585-34a9-44df-8800-00aea5499e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:29.275128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3874585-34a9-44df-8800-00aea5499e4c admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:29.275408 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3874585-34a9-44df-8800-00aea5499e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:29.275705 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3874585-34a9-44df-8800-00aea5499e4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:29.276422 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3874585-34a9-44df-8800-00aea5499e4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:29.278292 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3874585-34a9-44df-8800-00aea5499e4c admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:29.380885 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1425/2860] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:18:29 2022] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:18:29.384978 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964dec0-160e-499f-8bf7-c4f8cb52469d admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:29.395411 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964dec0-160e-499f-8bf7-c4f8cb52469d admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:29.440958 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:18:29.457522 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b01e0-2c77-4f60-84f7-a913e425a631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:29.458295 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b01e0-2c77-4f60-84f7-a913e425a631 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:29.458583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b01e0-2c77-4f60-84f7-a913e425a631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:29.458863 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b01e0-2c77-4f60-84f7-a913e425a631 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:29.459562 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b01e0-2c77-4f60-84f7-a913e425a631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:29.461728 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b01e0-2c77-4f60-84f7-a913e425a631 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:29.561796 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1436/2861] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:18:29 2022] POST /identity/v3/users => generated 284 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:18:29.565855 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3874585-34a9-44df-8800-00aea5499e4c admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:29.576359 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3874585-34a9-44df-8800-00aea5499e4c admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:29.580916 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488f31a-455c-460f-94dc-26a222489aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:29.582071 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488f31a-455c-460f-94dc-26a222489aae admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:29.582349 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488f31a-455c-460f-94dc-26a222489aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:29.582618 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488f31a-455c-460f-94dc-26a222489aae admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:29.583378 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488f31a-455c-460f-94dc-26a222489aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:29.584996 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488f31a-455c-460f-94dc-26a222489aae admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:29.595579 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1426/2862] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:18:29.603276 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b01e0-2c77-4f60-84f7-a913e425a631 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:29.613650 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b01e0-2c77-4f60-84f7-a913e425a631 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:29.618402 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb988c82-592f-49a8-ae0f-822b5fd6cc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:29.619055 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb988c82-592f-49a8-ae0f-822b5fd6cc7c admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:29.619341 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb988c82-592f-49a8-ae0f-822b5fd6cc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:29.619619 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb988c82-592f-49a8-ae0f-822b5fd6cc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:29.620393 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb988c82-592f-49a8-ae0f-822b5fd6cc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:29.621983 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb988c82-592f-49a8-ae0f-822b5fd6cc7c admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:29.631951 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1437/2863] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:18:29.635841 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488f31a-455c-460f-94dc-26a222489aae admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:29.646183 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488f31a-455c-460f-94dc-26a222489aae admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:29.650675 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0248dee-764a-4031-991f-6d136466e9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:29.651532 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0248dee-764a-4031-991f-6d136466e9d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:29.651819 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0248dee-764a-4031-991f-6d136466e9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:29.652093 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0248dee-764a-4031-991f-6d136466e9d7 admin admin] PATH_INFO: `/v3/projects/51cb7a17964b42829783a44c8c7dda28/users/faafa81e11dc4c2f9a36158c3b0ff19e/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:29.666687 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0248dee-764a-4031-991f-6d136466e9d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51cb7a17964b42829783a44c8c7dda28, user_id=faafa81e11dc4c2f9a36158c3b0ff19e, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:29.669373 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0248dee-764a-4031-991f-6d136466e9d7 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:29.729368 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1427/2864] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:18:29 2022] PUT /identity/v3/projects/51cb7a17964b42829783a44c8c7dda28/users/faafa81e11dc4c2f9a36158c3b0ff19e/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:18:29.790955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726c218-e857-421a-9329-347beb0d3789 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:29.791247 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726c218-e857-421a-9329-347beb0d3789 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:29.791525 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726c218-e857-421a-9329-347beb0d3789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:29.818105 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-3726c218-e857-421a-9329-347beb0d3789 None None] MFA Rules not processed for user `faafa81e11dc4c2f9a36158c3b0ff19e`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:18:29.819228 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-3726c218-e857-421a-9329-347beb0d3789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:29.880816 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1438/2865] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:18:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:18:29.892674 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0248dee-764a-4031-991f-6d136466e9d7 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:18:29.894969 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-f0248dee-764a-4031-991f-6d136466e9d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:18:29.949566 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0248dee-764a-4031-991f-6d136466e9d7 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:18:29.953215 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcc006-3d04-4027-be64-9d262d2432a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '144e0074ab4d4e5c8743e4f7d68a89b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:18:29.953851 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcc006-3d04-4027-be64-9d262d2432a1 service glance] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:18:29.954135 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcc006-3d04-4027-be64-9d262d2432a1 service glance] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:18:29.954410 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcc006-3d04-4027-be64-9d262d2432a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:18:29.963356 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcc006-3d04-4027-be64-9d262d2432a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:18:29.964803 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcc006-3d04-4027-be64-9d262d2432a1 service glance] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:18:29.973390 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1428/2866] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:18:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:18:39.877499 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:18:39.969429 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:19:12.239594 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726c218-e857-421a-9329-347beb0d3789 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:12.300243 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726c218-e857-421a-9329-347beb0d3789 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:12.304681 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af420d04-0201-42e7-8f3b-94e18db6a473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:12.305547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af420d04-0201-42e7-8f3b-94e18db6a473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:12.305828 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af420d04-0201-42e7-8f3b-94e18db6a473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:12.306104 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af420d04-0201-42e7-8f3b-94e18db6a473 admin admin] PATH_INFO: `/v3/users/faafa81e11dc4c2f9a36158c3b0ff19e` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:12.307289 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af420d04-0201-42e7-8f3b-94e18db6a473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faafa81e11dc4c2f9a36158c3b0ff19e)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:12.309330 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af420d04-0201-42e7-8f3b-94e18db6a473 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:12.534465 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-af420d04-0201-42e7-8f3b-94e18db6a473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faafa81e11dc4c2f9a36158c3b0ff19e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:12.541592 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-af420d04-0201-42e7-8f3b-94e18db6a473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faafa81e11dc4c2f9a36158c3b0ff19e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:12.542289 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-af420d04-0201-42e7-8f3b-94e18db6a473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faafa81e11dc4c2f9a36158c3b0ff19e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:12.554184 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-af420d04-0201-42e7-8f3b-94e18db6a473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faafa81e11dc4c2f9a36158c3b0ff19e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:12.554737 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-af420d04-0201-42e7-8f3b-94e18db6a473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faafa81e11dc4c2f9a36158c3b0ff19e'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:12.629153 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1439/2867] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:19:12 2022] DELETE /identity/v3/users/faafa81e11dc4c2f9a36158c3b0ff19e => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:19:12.633631 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e190a-9ee2-49c2-865a-088e85d217b8 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:12.634129 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e190a-9ee2-49c2-865a-088e85d217b8 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:12.634260 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e190a-9ee2-49c2-865a-088e85d217b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:12.651476 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-175e190a-9ee2-49c2-865a-088e85d217b8 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:19:12.652729 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-175e190a-9ee2-49c2-865a-088e85d217b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:12.710127 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1429/2868] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:19:12.719818 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af420d04-0201-42e7-8f3b-94e18db6a473 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:12.721241 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-af420d04-0201-42e7-8f3b-94e18db6a473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:12.779708 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af420d04-0201-42e7-8f3b-94e18db6a473 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:12.783368 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e89ba-b5a0-4f0a-aa89-947b84bbf84b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:12.784009 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e89ba-b5a0-4f0a-aa89-947b84bbf84b service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:12.784334 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e89ba-b5a0-4f0a-aa89-947b84bbf84b service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:12.784613 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e89ba-b5a0-4f0a-aa89-947b84bbf84b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:12.793883 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e89ba-b5a0-4f0a-aa89-947b84bbf84b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:12.795305 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e89ba-b5a0-4f0a-aa89-947b84bbf84b service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:12.804957 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1440/2869] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:19:13.198117 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e190a-9ee2-49c2-865a-088e85d217b8 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:13.201083 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-175e190a-9ee2-49c2-865a-088e85d217b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:13.211617 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e190a-9ee2-49c2-865a-088e85d217b8 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:13.216247 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79628dd-366e-43b7-8848-eddfdcd77978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:13.217107 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79628dd-366e-43b7-8848-eddfdcd77978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:13.217391 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79628dd-366e-43b7-8848-eddfdcd77978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:13.217668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79628dd-366e-43b7-8848-eddfdcd77978 admin admin] PATH_INFO: `/v3/projects/51cb7a17964b42829783a44c8c7dda28` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:13.218896 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79628dd-366e-43b7-8848-eddfdcd77978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51cb7a17964b42829783a44c8c7dda28)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:13.220840 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79628dd-366e-43b7-8848-eddfdcd77978 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:13.350551 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f79628dd-366e-43b7-8848-eddfdcd77978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51cb7a17964b42829783a44c8c7dda28', 'request_id': 'req-f79628dd-366e-43b7-8848-eddfdcd77978'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:13.453070 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f79628dd-366e-43b7-8848-eddfdcd77978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51cb7a17964b42829783a44c8c7dda28', 'request_id': 'req-f79628dd-366e-43b7-8848-eddfdcd77978'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:13.459033 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f79628dd-366e-43b7-8848-eddfdcd77978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51cb7a17964b42829783a44c8c7dda28', 'request_id': 'req-f79628dd-366e-43b7-8848-eddfdcd77978'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:13.471006 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f79628dd-366e-43b7-8848-eddfdcd77978 admin admin] The token cache is being invalidate because project 51cb7a17964b42829783a44c8c7dda28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:19:13.471294 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f79628dd-366e-43b7-8848-eddfdcd77978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:13.471917 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f79628dd-366e-43b7-8848-eddfdcd77978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:13.473486 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1430/2870] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:19:13 2022] DELETE /identity/v3/projects/51cb7a17964b42829783a44c8c7dda28 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:19:13.478614 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f03d13-9fbb-4236-ba45-6be667c2fee3 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:13.479093 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f03d13-9fbb-4236-ba45-6be667c2fee3 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:13.479203 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f03d13-9fbb-4236-ba45-6be667c2fee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:13.496955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-d8f03d13-9fbb-4236-ba45-6be667c2fee3 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:19:13.498162 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-d8f03d13-9fbb-4236-ba45-6be667c2fee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:13.517161 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:19:13.565941 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1441/2871] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:19:13.573533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b5e86-a0e6-4042-8aba-0d4f2122a9dd None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:13.573820 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b5e86-a0e6-4042-8aba-0d4f2122a9dd None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:13.574099 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b5e86-a0e6-4042-8aba-0d4f2122a9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:13.592089 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-6f4b5e86-a0e6-4042-8aba-0d4f2122a9dd None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:19:13.593308 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6f4b5e86-a0e6-4042-8aba-0d4f2122a9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:13.601715 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1431/2872] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:19:13.605858 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f03d13-9fbb-4236-ba45-6be667c2fee3 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:13.616451 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f03d13-9fbb-4236-ba45-6be667c2fee3 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:13.621104 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f0397-08ec-4537-8b1e-f23fe3b3fd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:13.621747 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f0397-08ec-4537-8b1e-f23fe3b3fd13 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:13.622027 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f0397-08ec-4537-8b1e-f23fe3b3fd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:13.622302 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f0397-08ec-4537-8b1e-f23fe3b3fd13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:13.623023 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f0397-08ec-4537-8b1e-f23fe3b3fd13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:19:13.623327 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f0397-08ec-4537-8b1e-f23fe3b3fd13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:13.624955 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f0397-08ec-4537-8b1e-f23fe3b3fd13 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:13.636349 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1442/2873] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 22 17:19:13.640392 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b5e86-a0e6-4042-8aba-0d4f2122a9dd None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:13.649358 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b5e86-a0e6-4042-8aba-0d4f2122a9dd None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:13.653928 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8347b0-3e62-4c48-8281-1947f0e67666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:13.654563 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8347b0-3e62-4c48-8281-1947f0e67666 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:13.654846 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8347b0-3e62-4c48-8281-1947f0e67666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:13.655121 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8347b0-3e62-4c48-8281-1947f0e67666 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:13.655805 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8347b0-3e62-4c48-8281-1947f0e67666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:13.658200 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8347b0-3e62-4c48-8281-1947f0e67666 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:13.739775 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1432/2874] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:19:13 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:19:13.743691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f0397-08ec-4537-8b1e-f23fe3b3fd13 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:13.753758 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f0397-08ec-4537-8b1e-f23fe3b3fd13 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:13.809153 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f221f-ccb9-4a3c-9b44-c381d973aab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:13.809807 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f221f-ccb9-4a3c-9b44-c381d973aab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:13.810130 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f221f-ccb9-4a3c-9b44-c381d973aab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:13.810369 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f221f-ccb9-4a3c-9b44-c381d973aab5 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:13.811058 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f221f-ccb9-4a3c-9b44-c381d973aab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:13.813004 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f221f-ccb9-4a3c-9b44-c381d973aab5 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:13.917260 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1443/2875] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:19:13 2022] POST /identity/v3/users => generated 284 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:19:13.921823 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8347b0-3e62-4c48-8281-1947f0e67666 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:13.932213 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8347b0-3e62-4c48-8281-1947f0e67666 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:13.936770 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09780fc0-5bdf-402c-80e7-3e940b18fc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:13.937425 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09780fc0-5bdf-402c-80e7-3e940b18fc25 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:13.937713 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09780fc0-5bdf-402c-80e7-3e940b18fc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:13.938147 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09780fc0-5bdf-402c-80e7-3e940b18fc25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:13.938886 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09780fc0-5bdf-402c-80e7-3e940b18fc25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:13.940523 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09780fc0-5bdf-402c-80e7-3e940b18fc25 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:13.950989 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1433/2876] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:19:13.955409 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f221f-ccb9-4a3c-9b44-c381d973aab5 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:13.965381 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f221f-ccb9-4a3c-9b44-c381d973aab5 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:13.970964 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98923826-4e4a-45c7-bc29-6def1d6e58c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:13.971615 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98923826-4e4a-45c7-bc29-6def1d6e58c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:13.971902 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98923826-4e4a-45c7-bc29-6def1d6e58c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:13.972215 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98923826-4e4a-45c7-bc29-6def1d6e58c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:13.972954 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98923826-4e4a-45c7-bc29-6def1d6e58c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:13.974555 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98923826-4e4a-45c7-bc29-6def1d6e58c0 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:13.984570 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1444/2877] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:19:13.988694 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09780fc0-5bdf-402c-80e7-3e940b18fc25 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:13.998588 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09780fc0-5bdf-402c-80e7-3e940b18fc25 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:14.003101 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d86c0a-1cf9-42ba-ab72-cfc6ad4b3bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:14.003967 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d86c0a-1cf9-42ba-ab72-cfc6ad4b3bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:14.004280 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d86c0a-1cf9-42ba-ab72-cfc6ad4b3bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:14.004560 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d86c0a-1cf9-42ba-ab72-cfc6ad4b3bbe admin admin] PATH_INFO: `/v3/projects/ccf760672a294b4c8dc6ee6a62786b31/users/71f5ea88638a46f8a3b176a15e4919e7/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:14.019580 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d86c0a-1cf9-42ba-ab72-cfc6ad4b3bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf760672a294b4c8dc6ee6a62786b31, user_id=71f5ea88638a46f8a3b176a15e4919e7, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:14.022253 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d86c0a-1cf9-42ba-ab72-cfc6ad4b3bbe admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:14.087922 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1434/2878] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:19:13 2022] PUT /identity/v3/projects/ccf760672a294b4c8dc6ee6a62786b31/users/71f5ea88638a46f8a3b176a15e4919e7/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:19:14.099740 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d478f-42a0-4990-96d7-8bd08f9aeed1 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:14.100036 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d478f-42a0-4990-96d7-8bd08f9aeed1 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:14.100365 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d478f-42a0-4990-96d7-8bd08f9aeed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:14.126125 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-2e4d478f-42a0-4990-96d7-8bd08f9aeed1 None None] MFA Rules not processed for user `71f5ea88638a46f8a3b176a15e4919e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:19:14.128043 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2e4d478f-42a0-4990-96d7-8bd08f9aeed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:14.195658 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1445/2879] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:19:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:19:14.207352 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d86c0a-1cf9-42ba-ab72-cfc6ad4b3bbe admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:14.209060 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-f2d86c0a-1cf9-42ba-ab72-cfc6ad4b3bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:14.230448 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:19:14.265049 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d86c0a-1cf9-42ba-ab72-cfc6ad4b3bbe admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:14.269926 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27520bf8-58c9-4f54-8f2f-0e4780077331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:14.270564 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27520bf8-58c9-4f54-8f2f-0e4780077331 service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:14.270849 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27520bf8-58c9-4f54-8f2f-0e4780077331 service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:14.271125 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27520bf8-58c9-4f54-8f2f-0e4780077331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:14.279390 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27520bf8-58c9-4f54-8f2f-0e4780077331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:14.280893 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27520bf8-58c9-4f54-8f2f-0e4780077331 service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:14.290044 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1435/2880] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:19:14 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:19:14.314433 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d478f-42a0-4990-96d7-8bd08f9aeed1 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:14.333317 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:19:14.375480 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d478f-42a0-4990-96d7-8bd08f9aeed1 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:14.381034 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6897e7-1f68-42f7-a93e-66b7d2ffc58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:14.381887 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6897e7-1f68-42f7-a93e-66b7d2ffc58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:14.382164 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6897e7-1f68-42f7-a93e-66b7d2ffc58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:14.382438 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6897e7-1f68-42f7-a93e-66b7d2ffc58d admin admin] PATH_INFO: `/v3/users/71f5ea88638a46f8a3b176a15e4919e7` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:14.383621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6897e7-1f68-42f7-a93e-66b7d2ffc58d admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f5ea88638a46f8a3b176a15e4919e7)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:14.385552 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6897e7-1f68-42f7-a93e-66b7d2ffc58d admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:14.523525 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-df6897e7-1f68-42f7-a93e-66b7d2ffc58d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f5ea88638a46f8a3b176a15e4919e7'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:14.530189 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-df6897e7-1f68-42f7-a93e-66b7d2ffc58d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f5ea88638a46f8a3b176a15e4919e7'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:14.530855 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-df6897e7-1f68-42f7-a93e-66b7d2ffc58d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f5ea88638a46f8a3b176a15e4919e7'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:14.542641 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-df6897e7-1f68-42f7-a93e-66b7d2ffc58d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f5ea88638a46f8a3b176a15e4919e7'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:14.543310 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-df6897e7-1f68-42f7-a93e-66b7d2ffc58d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f5ea88638a46f8a3b176a15e4919e7'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:14.607212 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1446/2881] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:19:14 2022] DELETE /identity/v3/users/71f5ea88638a46f8a3b176a15e4919e7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:19:14.612289 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b3934-9078-4ea4-b6a6-6d6801a5edbd None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:14.612583 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b3934-9078-4ea4-b6a6-6d6801a5edbd None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:14.612863 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b3934-9078-4ea4-b6a6-6d6801a5edbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:14.630351 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-2f4b3934-9078-4ea4-b6a6-6d6801a5edbd None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:19:14.631541 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-2f4b3934-9078-4ea4-b6a6-6d6801a5edbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:14.688040 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1436/2882] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:19:14.698042 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6897e7-1f68-42f7-a93e-66b7d2ffc58d admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:14.699416 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-df6897e7-1f68-42f7-a93e-66b7d2ffc58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:14.754814 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6897e7-1f68-42f7-a93e-66b7d2ffc58d admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:14.758399 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073da26-33de-4110-a043-1393fbfcc6b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:14.759025 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073da26-33de-4110-a043-1393fbfcc6b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:14.759323 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073da26-33de-4110-a043-1393fbfcc6b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:14.759583 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073da26-33de-4110-a043-1393fbfcc6b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:14.768423 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073da26-33de-4110-a043-1393fbfcc6b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:14.769835 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073da26-33de-4110-a043-1393fbfcc6b4 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:14.779178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1447/2883] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:19:15.163302 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b3934-9078-4ea4-b6a6-6d6801a5edbd None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:15.164788 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-2f4b3934-9078-4ea4-b6a6-6d6801a5edbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:15.177379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b3934-9078-4ea4-b6a6-6d6801a5edbd None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:15.182560 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03c335-8342-4b0d-980c-7fcee0590979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:15.183454 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03c335-8342-4b0d-980c-7fcee0590979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:15.183708 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03c335-8342-4b0d-980c-7fcee0590979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:15.183984 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03c335-8342-4b0d-980c-7fcee0590979 admin admin] PATH_INFO: `/v3/projects/ccf760672a294b4c8dc6ee6a62786b31` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:15.185214 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03c335-8342-4b0d-980c-7fcee0590979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf760672a294b4c8dc6ee6a62786b31)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:15.187196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03c335-8342-4b0d-980c-7fcee0590979 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:15.287339 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-da03c335-8342-4b0d-980c-7fcee0590979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf760672a294b4c8dc6ee6a62786b31', 'request_id': 'req-da03c335-8342-4b0d-980c-7fcee0590979'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:15.350953 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-da03c335-8342-4b0d-980c-7fcee0590979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf760672a294b4c8dc6ee6a62786b31', 'request_id': 'req-da03c335-8342-4b0d-980c-7fcee0590979'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:15.356990 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-da03c335-8342-4b0d-980c-7fcee0590979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf760672a294b4c8dc6ee6a62786b31', 'request_id': 'req-da03c335-8342-4b0d-980c-7fcee0590979'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:15.369289 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-da03c335-8342-4b0d-980c-7fcee0590979 admin admin] The token cache is being invalidate because project ccf760672a294b4c8dc6ee6a62786b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:19:15.369578 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-da03c335-8342-4b0d-980c-7fcee0590979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:15.370340 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-da03c335-8342-4b0d-980c-7fcee0590979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:15.371905 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1437/2884] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:19:15 2022] DELETE /identity/v3/projects/ccf760672a294b4c8dc6ee6a62786b31 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:19:15.377435 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33414f-37db-492f-a37d-7776fe628086 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:15.377723 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33414f-37db-492f-a37d-7776fe628086 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:15.378012 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33414f-37db-492f-a37d-7776fe628086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:15.395169 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-5c33414f-37db-492f-a37d-7776fe628086 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:19:15.396383 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-5c33414f-37db-492f-a37d-7776fe628086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:15.432862 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:19:15.460601 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1448/2885] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:19:15.468155 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed65b0-36ba-4fc3-ab68-d76439f3995d None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:15.468531 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed65b0-36ba-4fc3-ab68-d76439f3995d None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:15.468845 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed65b0-36ba-4fc3-ab68-d76439f3995d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:15.493310 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-4eed65b0-36ba-4fc3-ab68-d76439f3995d None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:19:15.494820 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-4eed65b0-36ba-4fc3-ab68-d76439f3995d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:15.507636 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1438/2886] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:19:15.511786 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33414f-37db-492f-a37d-7776fe628086 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:15.522084 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33414f-37db-492f-a37d-7776fe628086 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:15.527513 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572ad40-09de-445a-ac80-d52cd699513a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:15.528397 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572ad40-09de-445a-ac80-d52cd699513a admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:15.528701 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572ad40-09de-445a-ac80-d52cd699513a admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:15.528998 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572ad40-09de-445a-ac80-d52cd699513a admin admin] PATH_INFO: `/v3/domains` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:15.529744 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572ad40-09de-445a-ac80-d52cd699513a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80542) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 22 17:19:15.530053 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572ad40-09de-445a-ac80-d52cd699513a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:15.531742 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572ad40-09de-445a-ac80-d52cd699513a admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:15.544622 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1449/2887] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jun 22 17:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 22 17:19:15.555481 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed65b0-36ba-4fc3-ab68-d76439f3995d None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:15.559755 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed65b0-36ba-4fc3-ab68-d76439f3995d None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:15.565067 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aee6af-411a-4faa-b657-4965dc563903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:15.565810 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aee6af-411a-4faa-b657-4965dc563903 admin admin] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:15.566243 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aee6af-411a-4faa-b657-4965dc563903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:15.566617 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aee6af-411a-4faa-b657-4965dc563903 admin admin] PATH_INFO: `/v3/projects` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:15.567457 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aee6af-411a-4faa-b657-4965dc563903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:15.569644 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aee6af-411a-4faa-b657-4965dc563903 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:15.643839 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1439/2888] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jun 22 17:19:15 2022] POST /identity/v3/projects => generated 399 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:19:15.648021 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572ad40-09de-445a-ac80-d52cd699513a admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:15.659179 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572ad40-09de-445a-ac80-d52cd699513a admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:15.716805 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b27ceb-16c0-4c4c-8127-ceafe887d363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:15.717477 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b27ceb-16c0-4c4c-8127-ceafe887d363 admin admin] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:15.717765 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b27ceb-16c0-4c4c-8127-ceafe887d363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:15.718045 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b27ceb-16c0-4c4c-8127-ceafe887d363 admin admin] PATH_INFO: `/v3/users` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:15.718750 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b27ceb-16c0-4c4c-8127-ceafe887d363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:15.721260 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b27ceb-16c0-4c4c-8127-ceafe887d363 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:15.780192 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1450/2889] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jun 22 17:19:15 2022] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 22 17:19:15.784611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aee6af-411a-4faa-b657-4965dc563903 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:15.795001 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aee6af-411a-4faa-b657-4965dc563903 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:15.800609 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ddccd-54e2-4c82-a514-58ece1e401f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:15.801277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ddccd-54e2-4c82-a514-58ece1e401f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:15.801565 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ddccd-54e2-4c82-a514-58ece1e401f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:15.801848 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ddccd-54e2-4c82-a514-58ece1e401f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:15.802596 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ddccd-54e2-4c82-a514-58ece1e401f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:15.804219 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ddccd-54e2-4c82-a514-58ece1e401f4 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:15.817917 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1440/2890] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:19:15.819599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b27ceb-16c0-4c4c-8127-ceafe887d363 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:15.829968 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b27ceb-16c0-4c4c-8127-ceafe887d363 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:15.834599 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb020e-a89c-439d-a173-237c89dc2a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:15.835248 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb020e-a89c-439d-a173-237c89dc2a97 admin admin] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:15.835533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb020e-a89c-439d-a173-237c89dc2a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:15.835809 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb020e-a89c-439d-a173-237c89dc2a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:15.836577 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb020e-a89c-439d-a173-237c89dc2a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:15.838265 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb020e-a89c-439d-a173-237c89dc2a97 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:15.848975 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1451/2891] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jun 22 17:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 22 17:19:15.853337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ddccd-54e2-4c82-a514-58ece1e401f4 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:15.864994 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ddccd-54e2-4c82-a514-58ece1e401f4 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:15.870710 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b04421-0918-4c2f-b9f8-e1e275e0ae4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:15.871632 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b04421-0918-4c2f-b9f8-e1e275e0ae4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:15.871920 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b04421-0918-4c2f-b9f8-e1e275e0ae4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:15.872229 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b04421-0918-4c2f-b9f8-e1e275e0ae4f admin admin] PATH_INFO: `/v3/projects/c600e26d9a3e462bbac8f4e5daeb2455/users/7411e9253b9740308f03434d46dbbdb8/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:15.874651 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:19:15.887583 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b04421-0918-4c2f-b9f8-e1e275e0ae4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c600e26d9a3e462bbac8f4e5daeb2455, user_id=7411e9253b9740308f03434d46dbbdb8, role_id=86ac1d96b1fe4fc4b3fd66b53b5d77c2)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:15.894277 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b04421-0918-4c2f-b9f8-e1e275e0ae4f admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:15.995501 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1441/2892] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jun 22 17:19:15 2022] PUT /identity/v3/projects/c600e26d9a3e462bbac8f4e5daeb2455/users/7411e9253b9740308f03434d46dbbdb8/roles/86ac1d96b1fe4fc4b3fd66b53b5d77c2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:19:16.005925 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee100c-0bc7-4fc2-9a09-e7d8845a154f None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:16.006218 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee100c-0bc7-4fc2-9a09-e7d8845a154f None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:16.006517 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee100c-0bc7-4fc2-9a09-e7d8845a154f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:16.034568 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-03ee100c-0bc7-4fc2-9a09-e7d8845a154f None None] MFA Rules not processed for user `7411e9253b9740308f03434d46dbbdb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:19:16.035815 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-03ee100c-0bc7-4fc2-9a09-e7d8845a154f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:16.098964 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1452/2893] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:19:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 22 17:19:16.110008 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b04421-0918-4c2f-b9f8-e1e275e0ae4f admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:16.111739 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-c7b04421-0918-4c2f-b9f8-e1e275e0ae4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:16.168298 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b04421-0918-4c2f-b9f8-e1e275e0ae4f admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:16.172130 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016ccfc-6be4-4e52-8fda-5623910c468e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:16.172777 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016ccfc-6be4-4e52-8fda-5623910c468e service cinder] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:16.173097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016ccfc-6be4-4e52-8fda-5623910c468e service cinder] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:16.173384 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016ccfc-6be4-4e52-8fda-5623910c468e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:16.181537 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016ccfc-6be4-4e52-8fda-5623910c468e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:16.182948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016ccfc-6be4-4e52-8fda-5623910c468e service cinder] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:16.192211 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1442/2894] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:19:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:19:17.058891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee100c-0bc7-4fc2-9a09-e7d8845a154f None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:17.060408 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-03ee100c-0bc7-4fc2-9a09-e7d8845a154f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:17.102603 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:19:17.119699 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee100c-0bc7-4fc2-9a09-e7d8845a154f None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:17.123440 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc70a21-9849-4d68-be94-de80a77b187c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:17.124155 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc70a21-9849-4d68-be94-de80a77b187c service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:17.124521 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc70a21-9849-4d68-be94-de80a77b187c service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:17.124833 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc70a21-9849-4d68-be94-de80a77b187c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:17.127229 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-bfc70a21-9849-4d68-be94-de80a77b187c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:17.197551 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc70a21-9849-4d68-be94-de80a77b187c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:17.198934 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc70a21-9849-4d68-be94-de80a77b187c service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:17.210378 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1453/2895] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:19:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:19:18.384868 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016ccfc-6be4-4e52-8fda-5623910c468e service cinder] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:18.386337 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-b016ccfc-6be4-4e52-8fda-5623910c468e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:18.397968 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016ccfc-6be4-4e52-8fda-5623910c468e service cinder] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:18.401597 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226302a4-36fc-46ab-ab6e-649b16a5dd41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:18.402219 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226302a4-36fc-46ab-ab6e-649b16a5dd41 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:18.402499 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226302a4-36fc-46ab-ab6e-649b16a5dd41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:18.402769 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226302a4-36fc-46ab-ab6e-649b16a5dd41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:18.404483 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-226302a4-36fc-46ab-ab6e-649b16a5dd41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:18.417198 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226302a4-36fc-46ab-ab6e-649b16a5dd41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:18.418593 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226302a4-36fc-46ab-ab6e-649b16a5dd41 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:18.430145 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1443/2896] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:19:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:19:25.174621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174329e-f19c-431e-bd4b-ea7049b6b7e7 None None] REQUEST_METHOD: `POST` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:25.175123 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174329e-f19c-431e-bd4b-ea7049b6b7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:25.175236 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174329e-f19c-431e-bd4b-ea7049b6b7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:25.193068 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.auth.core [None req-7174329e-f19c-431e-bd4b-ea7049b6b7e7 None None] MFA Rules not processed for user `00da4e0bbeba4a1f954ea2d27ff18f59`. Rule list: `[]` (Enabled: `True`). {{(pid=80542) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:19:25.194435 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-7174329e-f19c-431e-bd4b-ea7049b6b7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:25.251096 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1454/2897] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:19:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:19:25.570808 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226302a4-36fc-46ab-ab6e-649b16a5dd41 service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:25.580423 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226302a4-36fc-46ab-ab6e-649b16a5dd41 service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:25.584016 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09841ef7-8829-4847-8c67-7cc303a650a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:25.584696 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09841ef7-8829-4847-8c67-7cc303a650a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:25.584981 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09841ef7-8829-4847-8c67-7cc303a650a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:25.585260 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09841ef7-8829-4847-8c67-7cc303a650a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:25.586999 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-09841ef7-8829-4847-8c67-7cc303a650a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:25.596463 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09841ef7-8829-4847-8c67-7cc303a650a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:25.597875 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09841ef7-8829-4847-8c67-7cc303a650a8 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:25.606021 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1444/2898] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:19:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:19:26.258951 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174329e-f19c-431e-bd4b-ea7049b6b7e7 None None] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:26.336837 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174329e-f19c-431e-bd4b-ea7049b6b7e7 None None] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:26.341341 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bfbba-d86a-4187-8f02-869078466b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:26.342209 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bfbba-d86a-4187-8f02-869078466b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:26.342494 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bfbba-d86a-4187-8f02-869078466b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:26.342774 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bfbba-d86a-4187-8f02-869078466b6e admin admin] PATH_INFO: `/v3/users/7411e9253b9740308f03434d46dbbdb8` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:26.343982 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5bfbba-d86a-4187-8f02-869078466b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7411e9253b9740308f03434d46dbbdb8)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:26.346454 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5bfbba-d86a-4187-8f02-869078466b6e admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:26.369476 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:19:26.575217 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-eb5bfbba-d86a-4187-8f02-869078466b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7411e9253b9740308f03434d46dbbdb8'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:26.582682 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-eb5bfbba-d86a-4187-8f02-869078466b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7411e9253b9740308f03434d46dbbdb8'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:26.583344 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-eb5bfbba-d86a-4187-8f02-869078466b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7411e9253b9740308f03434d46dbbdb8'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:26.595621 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-eb5bfbba-d86a-4187-8f02-869078466b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7411e9253b9740308f03434d46dbbdb8'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:26.600383 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-eb5bfbba-d86a-4187-8f02-869078466b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7411e9253b9740308f03434d46dbbdb8'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:26.723546 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1455/2899] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:19:26 2022] DELETE /identity/v3/users/7411e9253b9740308f03434d46dbbdb8 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:19:26.727378 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8d02d-2863-4563-bd3b-11b17bb4fea0 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:26.727850 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8d02d-2863-4563-bd3b-11b17bb4fea0 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:26.727983 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8d02d-2863-4563-bd3b-11b17bb4fea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:26.744637 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-e0d8d02d-2863-4563-bd3b-11b17bb4fea0 None None] MFA Rules not processed for user `2ba6ed129dc941f49c2206f6d2b62dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:19:26.745841 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e0d8d02d-2863-4563-bd3b-11b17bb4fea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:26.804611 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1445/2900] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:19:26.814545 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bfbba-d86a-4187-8f02-869078466b6e admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:26.816001 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-eb5bfbba-d86a-4187-8f02-869078466b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:26.874343 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bfbba-d86a-4187-8f02-869078466b6e admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:26.878449 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2169862-b34f-4f6b-825f-65c13022c1c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:26.879094 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2169862-b34f-4f6b-825f-65c13022c1c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:26.879382 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2169862-b34f-4f6b-825f-65c13022c1c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:26.879664 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2169862-b34f-4f6b-825f-65c13022c1c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:26.888728 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2169862-b34f-4f6b-825f-65c13022c1c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:26.890165 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2169862-b34f-4f6b-825f-65c13022c1c7 service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:26.900285 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1456/2901] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:19:27.312097 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8d02d-2863-4563-bd3b-11b17bb4fea0 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:27.314093 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-e0d8d02d-2863-4563-bd3b-11b17bb4fea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:27.326473 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8d02d-2863-4563-bd3b-11b17bb4fea0 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:27.331801 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688ccd7-22ba-457e-98ca-d1dddb0f6a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:27.336673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688ccd7-22ba-457e-98ca-d1dddb0f6a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:27.336673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688ccd7-22ba-457e-98ca-d1dddb0f6a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:27.336673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688ccd7-22ba-457e-98ca-d1dddb0f6a5e admin admin] PATH_INFO: `/v3/projects/c600e26d9a3e462bbac8f4e5daeb2455` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:27.336673 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688ccd7-22ba-457e-98ca-d1dddb0f6a5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c600e26d9a3e462bbac8f4e5daeb2455)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:27.337621 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688ccd7-22ba-457e-98ca-d1dddb0f6a5e admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:27.458729 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f688ccd7-22ba-457e-98ca-d1dddb0f6a5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c600e26d9a3e462bbac8f4e5daeb2455', 'request_id': 'req-f688ccd7-22ba-457e-98ca-d1dddb0f6a5e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:27.462572 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:19:27.545093 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f688ccd7-22ba-457e-98ca-d1dddb0f6a5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c600e26d9a3e462bbac8f4e5daeb2455', 'request_id': 'req-f688ccd7-22ba-457e-98ca-d1dddb0f6a5e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:27.551957 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f688ccd7-22ba-457e-98ca-d1dddb0f6a5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c600e26d9a3e462bbac8f4e5daeb2455', 'request_id': 'req-f688ccd7-22ba-457e-98ca-d1dddb0f6a5e'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:27.563028 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f688ccd7-22ba-457e-98ca-d1dddb0f6a5e admin admin] The token cache is being invalidate because project c600e26d9a3e462bbac8f4e5daeb2455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:19:27.563260 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f688ccd7-22ba-457e-98ca-d1dddb0f6a5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:27.564426 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-f688ccd7-22ba-457e-98ca-d1dddb0f6a5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:19:27.566037 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1446/2902] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:19:27 2022] DELETE /identity/v3/projects/c600e26d9a3e462bbac8f4e5daeb2455 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 22 17:19:36.896053 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=46,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:19:37.761825 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=6,keystone:DELETE=2 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:19:40.300549 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2169862-b34f-4f6b-825f-65c13022c1c7 service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:19:40.302022 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-a2169862-b34f-4f6b-825f-65c13022c1c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:40.374921 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2169862-b34f-4f6b-825f-65c13022c1c7 service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:19:40.440083 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e065a-6acc-4a35-bcb8-dd3db1b5d0d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:19:40.440763 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e065a-6acc-4a35-bcb8-dd3db1b5d0d6 service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:19:40.441266 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e065a-6acc-4a35-bcb8-dd3db1b5d0d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:19:40.441554 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e065a-6acc-4a35-bcb8-dd3db1b5d0d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:19:40.443470 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e06e065a-6acc-4a35-bcb8-dd3db1b5d0d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:19:40.455343 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e065a-6acc-4a35-bcb8-dd3db1b5d0d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:19:40.456975 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e065a-6acc-4a35-bcb8-dd3db1b5d0d6 service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:19:40.467412 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1457/2903] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:19:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:19:50.462912 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=62 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:20:17.328833 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688ccd7-22ba-457e-98ca-d1dddb0f6a5e admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:20:17.330291 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-f688ccd7-22ba-457e-98ca-d1dddb0f6a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:20:17.386857 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688ccd7-22ba-457e-98ca-d1dddb0f6a5e admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:20:17.390477 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e829c3d-96ab-44df-bdc5-2ad81c7b1aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:20:17.391114 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e829c3d-96ab-44df-bdc5-2ad81c7b1aae service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:20:17.391393 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e829c3d-96ab-44df-bdc5-2ad81c7b1aae service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:20:17.391668 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e829c3d-96ab-44df-bdc5-2ad81c7b1aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:20:17.393484 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-6e829c3d-96ab-44df-bdc5-2ad81c7b1aae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:20:17.403396 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e829c3d-96ab-44df-bdc5-2ad81c7b1aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:20:17.404822 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e829c3d-96ab-44df-bdc5-2ad81c7b1aae service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:20:17.413210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1447/2904] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:20:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:20:27.409134 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=26 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:21:30.936886 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e065a-6acc-4a35-bcb8-dd3db1b5d0d6 service nova] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:21:30.938275 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e06e065a-6acc-4a35-bcb8-dd3db1b5d0d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:21:30.995007 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e065a-6acc-4a35-bcb8-dd3db1b5d0d6 service nova] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:21:30.998598 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea12328-6c5a-4c5d-816b-8830d453c615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d28208f3127499a98a9d50f8d63ea6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:21:30.999237 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea12328-6c5a-4c5d-816b-8830d453c615 service cinder] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:21:30.999518 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea12328-6c5a-4c5d-816b-8830d453c615 service cinder] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:21:30.999790 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea12328-6c5a-4c5d-816b-8830d453c615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:21:31.001568 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2ea12328-6c5a-4c5d-816b-8830d453c615 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:21:31.060008 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea12328-6c5a-4c5d-816b-8830d453c615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:21:31.061481 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea12328-6c5a-4c5d-816b-8830d453c615 service cinder] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:21:31.070228 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1458/2905] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:21:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:21:41.066174 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=48 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:21:44.745036 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3947b5-233a-4e34-91c2-f9f2f430d967 None None] REQUEST_METHOD: `POST` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:21:44.745559 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3947b5-233a-4e34-91c2-f9f2f430d967 None None] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:21:44.745695 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3947b5-233a-4e34-91c2-f9f2f430d967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:21:44.762727 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.auth.core [None req-5c3947b5-233a-4e34-91c2-f9f2f430d967 None None] MFA Rules not processed for user `00da4e0bbeba4a1f954ea2d27ff18f59`. Rule list: `[]` (Enabled: `True`). {{(pid=80543) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 22 17:21:44.763908 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-5c3947b5-233a-4e34-91c2-f9f2f430d967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:21:44.770616 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1448/2906] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jun 22 17:21:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 22 17:21:46.841078 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea12328-6c5a-4c5d-816b-8830d453c615 service cinder] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:21:46.843422 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-2ea12328-6c5a-4c5d-816b-8830d453c615 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:21:46.912929 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea12328-6c5a-4c5d-816b-8830d453c615 service cinder] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:21:46.917891 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7685a3-7e44-49fe-a9c8-c8f0c9530147 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79a71fa89446c3abbb4fdbf2c93aac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:21:46.918533 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7685a3-7e44-49fe-a9c8-c8f0c9530147 service placement] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:21:46.918817 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7685a3-7e44-49fe-a9c8-c8f0c9530147 service placement] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:21:46.919121 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7685a3-7e44-49fe-a9c8-c8f0c9530147 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:21:46.921532 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-ee7685a3-7e44-49fe-a9c8-c8f0c9530147 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:21:46.933827 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7685a3-7e44-49fe-a9c8-c8f0c9530147 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:21:46.935480 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7685a3-7e44-49fe-a9c8-c8f0c9530147 service placement] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:21:46.945734 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1459/2907] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:21:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:21:53.731394 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3947b5-233a-4e34-91c2-f9f2f430d967 None None] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:21:53.733210 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-5c3947b5-233a-4e34-91c2-f9f2f430d967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:21:53.753720 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3947b5-233a-4e34-91c2-f9f2f430d967 None None] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:21:53.759867 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411c3ef-7929-4393-917d-06d4e8db6ebe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:21:53.761069 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411c3ef-7929-4393-917d-06d4e8db6ebe service nova] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:21:53.761532 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411c3ef-7929-4393-917d-06d4e8db6ebe service nova] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:21:53.761973 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411c3ef-7929-4393-917d-06d4e8db6ebe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:21:53.764948 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-8411c3ef-7929-4393-917d-06d4e8db6ebe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:21:53.778196 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411c3ef-7929-4393-917d-06d4e8db6ebe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:21:53.780139 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411c3ef-7929-4393-917d-06d4e8db6ebe service nova] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:21:53.792481 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1449/2908] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:21:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:21:56.941190 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=32 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:22:03.786933 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=9 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:22:08.284888 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7685a3-7e44-49fe-a9c8-c8f0c9530147 service placement] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:22:08.294133 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7685a3-7e44-49fe-a9c8-c8f0c9530147 service placement] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:22:08.297834 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e47b14-1a42-45c3-91d6-f1c32c9a9f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:22:08.298458 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e47b14-1a42-45c3-91d6-f1c32c9a9f1d service neutron] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:22:08.298738 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e47b14-1a42-45c3-91d6-f1c32c9a9f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:22:08.299012 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e47b14-1a42-45c3-91d6-f1c32c9a9f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:22:08.300793 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e3e47b14-1a42-45c3-91d6-f1c32c9a9f1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:22:08.372097 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e47b14-1a42-45c3-91d6-f1c32c9a9f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:22:08.373566 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e47b14-1a42-45c3-91d6-f1c32c9a9f1d service neutron] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:22:08.383099 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1460/2909] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:22:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:22:18.378785 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=34 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:22:19.661838 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411c3ef-7929-4393-917d-06d4e8db6ebe service nova] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:22:19.721616 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411c3ef-7929-4393-917d-06d4e8db6ebe service nova] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:22:19.726741 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1c88f-3f1f-4dc6-846a-798f6ba1f381 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79a71fa89446c3abbb4fdbf2c93aac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:22:19.727379 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1c88f-3f1f-4dc6-846a-798f6ba1f381 service placement] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:22:19.727662 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1c88f-3f1f-4dc6-846a-798f6ba1f381 service placement] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:22:19.727938 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1c88f-3f1f-4dc6-846a-798f6ba1f381 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:22:19.729810 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-dac1c88f-3f1f-4dc6-846a-798f6ba1f381 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:22:19.753121 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1c88f-3f1f-4dc6-846a-798f6ba1f381 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:22:19.754708 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1c88f-3f1f-4dc6-846a-798f6ba1f381 service placement] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:22:19.764758 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1450/2910] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:22:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:22:29.760525 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=32 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:23:51.604410 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e47b14-1a42-45c3-91d6-f1c32c9a9f1d service neutron] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:23:51.606691 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e3e47b14-1a42-45c3-91d6-f1c32c9a9f1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:23:51.670670 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e47b14-1a42-45c3-91d6-f1c32c9a9f1d service neutron] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:23:51.676648 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534c6d3-0905-45b5-82d1-f594b25a4005 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78e7bdfffdc84465a570d135d1d86380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:23:51.680364 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534c6d3-0905-45b5-82d1-f594b25a4005 service nova] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:23:51.680364 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534c6d3-0905-45b5-82d1-f594b25a4005 service nova] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:23:51.680364 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534c6d3-0905-45b5-82d1-f594b25a4005 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:23:51.680364 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-5534c6d3-0905-45b5-82d1-f594b25a4005 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:23:51.692048 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534c6d3-0905-45b5-82d1-f594b25a4005 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:23:51.693708 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534c6d3-0905-45b5-82d1-f594b25a4005 service nova] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:23:51.704379 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1461/2911] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:23:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 22 17:24:01.699718 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=23 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:24:07.263566 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1c88f-3f1f-4dc6-846a-798f6ba1f381 service placement] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:24:07.284848 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1c88f-3f1f-4dc6-846a-798f6ba1f381 service placement] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:24:07.289047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8fc68-2639-427c-97ec-70765c502071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9090c22ba9f041e2a8d00750d853435a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:24:07.289688 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8fc68-2639-427c-97ec-70765c502071 service neutron] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:24:07.289973 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8fc68-2639-427c-97ec-70765c502071 service neutron] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:24:07.290253 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8fc68-2639-427c-97ec-70765c502071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:24:07.292047 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-75e8fc68-2639-427c-97ec-70765c502071 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:24:07.354111 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8fc68-2639-427c-97ec-70765c502071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:24:07.355535 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8fc68-2639-427c-97ec-70765c502071 service neutron] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:24:07.365067 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1451/2912] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:24:10.824856 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534c6d3-0905-45b5-82d1-f594b25a4005 service nova] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:24:10.837454 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534c6d3-0905-45b5-82d1-f594b25a4005 service nova] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:24:10.843261 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f7b74-0bfb-45b0-892c-ae966f35b13a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79a71fa89446c3abbb4fdbf2c93aac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:24:10.843918 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f7b74-0bfb-45b0-892c-ae966f35b13a service placement] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:24:10.844262 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f7b74-0bfb-45b0-892c-ae966f35b13a service placement] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:24:10.844547 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f7b74-0bfb-45b0-892c-ae966f35b13a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:24:10.846404 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e06f7b74-0bfb-45b0-892c-ae966f35b13a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:24:10.858515 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f7b74-0bfb-45b0-892c-ae966f35b13a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:24:10.860095 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f7b74-0bfb-45b0-892c-ae966f35b13a service placement] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:24:10.870572 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1462/2913] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:24:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:24:14.546902 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8fc68-2639-427c-97ec-70765c502071 service neutron] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:24:14.558557 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8fc68-2639-427c-97ec-70765c502071 service neutron] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:24:14.564288 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086183b7-7dd3-4983-afa9-db4c8c561ac1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79a71fa89446c3abbb4fdbf2c93aac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:24:14.565366 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086183b7-7dd3-4983-afa9-db4c8c561ac1 service placement] REQUEST_METHOD: `GET` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:24:14.565366 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086183b7-7dd3-4983-afa9-db4c8c561ac1 service placement] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:24:14.565628 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086183b7-7dd3-4983-afa9-db4c8c561ac1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:24:14.567954 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-086183b7-7dd3-4983-afa9-db4c8c561ac1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:24:14.579874 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086183b7-7dd3-4983-afa9-db4c8c561ac1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:24:14.581519 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086183b7-7dd3-4983-afa9-db4c8c561ac1 service placement] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:24:14.592367 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1452/2914] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:24:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:24:14.709939 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f7b74-0bfb-45b0-892c-ae966f35b13a service placement] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:24:14.711398 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-e06f7b74-0bfb-45b0-892c-ae966f35b13a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:24:14.758251 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f7b74-0bfb-45b0-892c-ae966f35b13a service placement] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:24:14.762729 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51271ede-cbc9-4af8-a6e8-484e311e4aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:24:14.763584 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51271ede-cbc9-4af8-a6e8-484e311e4aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:24:14.763869 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51271ede-cbc9-4af8-a6e8-484e311e4aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:24:14.764178 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51271ede-cbc9-4af8-a6e8-484e311e4aa2 admin admin] PATH_INFO: `/v3/users/00da4e0bbeba4a1f954ea2d27ff18f59` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:24:14.765357 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51271ede-cbc9-4af8-a6e8-484e311e4aa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00da4e0bbeba4a1f954ea2d27ff18f59)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:24:14.767268 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51271ede-cbc9-4af8-a6e8-484e311e4aa2 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:24:14.969375 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-51271ede-cbc9-4af8-a6e8-484e311e4aa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00da4e0bbeba4a1f954ea2d27ff18f59'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:24:14.976334 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-51271ede-cbc9-4af8-a6e8-484e311e4aa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00da4e0bbeba4a1f954ea2d27ff18f59'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:24:14.976925 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-51271ede-cbc9-4af8-a6e8-484e311e4aa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00da4e0bbeba4a1f954ea2d27ff18f59'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:24:14.988930 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-51271ede-cbc9-4af8-a6e8-484e311e4aa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00da4e0bbeba4a1f954ea2d27ff18f59'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:24:14.989722 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-51271ede-cbc9-4af8-a6e8-484e311e4aa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00da4e0bbeba4a1f954ea2d27ff18f59'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:24:15.115312 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1463/2915] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:24:14 2022] DELETE /identity/v3/users/00da4e0bbeba4a1f954ea2d27ff18f59 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:24:15.404070 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086183b7-7dd3-4983-afa9-db4c8c561ac1 service placement] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:24:15.418068 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086183b7-7dd3-4983-afa9-db4c8c561ac1 service placement] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:24:15.475653 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069c053-392f-490c-aa03-afde530f0305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:24:15.476540 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069c053-392f-490c-aa03-afde530f0305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:24:15.476826 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069c053-392f-490c-aa03-afde530f0305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:24:15.477104 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069c053-392f-490c-aa03-afde530f0305 admin admin] PATH_INFO: `/v3/projects/2c32a4df73e946b2844051778a16a8c0` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:24:15.478287 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069c053-392f-490c-aa03-afde530f0305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c32a4df73e946b2844051778a16a8c0)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:24:15.480279 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069c053-392f-490c-aa03-afde530f0305 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:24:15.648128 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0069c053-392f-490c-aa03-afde530f0305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c32a4df73e946b2844051778a16a8c0', 'request_id': 'req-0069c053-392f-490c-aa03-afde530f0305'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:24:15.750743 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0069c053-392f-490c-aa03-afde530f0305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c32a4df73e946b2844051778a16a8c0', 'request_id': 'req-0069c053-392f-490c-aa03-afde530f0305'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:24:15.757130 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0069c053-392f-490c-aa03-afde530f0305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c32a4df73e946b2844051778a16a8c0', 'request_id': 'req-0069c053-392f-490c-aa03-afde530f0305'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:24:15.768064 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0069c053-392f-490c-aa03-afde530f0305 admin admin] The token cache is being invalidate because project 2c32a4df73e946b2844051778a16a8c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:24:15.768374 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0069c053-392f-490c-aa03-afde530f0305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:24:15.768998 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-0069c053-392f-490c-aa03-afde530f0305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:24:15.770533 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1453/2916] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:24:15 2022] DELETE /identity/v3/projects/2c32a4df73e946b2844051778a16a8c0 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:24:15.774677 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51271ede-cbc9-4af8-a6e8-484e311e4aa2 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:24:15.776273 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-51271ede-cbc9-4af8-a6e8-484e311e4aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:24:15.789110 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51271ede-cbc9-4af8-a6e8-484e311e4aa2 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:24:15.845395 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a52750-9ff3-4afc-8bc6-579189352751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:24:15.846326 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a52750-9ff3-4afc-8bc6-579189352751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:24:15.846606 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a52750-9ff3-4afc-8bc6-579189352751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:24:15.846883 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a52750-9ff3-4afc-8bc6-579189352751 admin admin] PATH_INFO: `/v3/users/6878f30fa4ed444e97d57eb9c1b103bc` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:24:15.848606 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a52750-9ff3-4afc-8bc6-579189352751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6878f30fa4ed444e97d57eb9c1b103bc)` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:24:15.850521 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a52750-9ff3-4afc-8bc6-579189352751 admin admin] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:24:16.112441 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:24:16.125670 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-28a52750-9ff3-4afc-8bc6-579189352751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6878f30fa4ed444e97d57eb9c1b103bc'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:24:16.132607 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-28a52750-9ff3-4afc-8bc6-579189352751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6878f30fa4ed444e97d57eb9c1b103bc'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:24:16.133277 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-28a52750-9ff3-4afc-8bc6-579189352751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6878f30fa4ed444e97d57eb9c1b103bc'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:24:16.144705 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-28a52750-9ff3-4afc-8bc6-579189352751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6878f30fa4ed444e97d57eb9c1b103bc'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:24:16.145390 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.notifications [None req-28a52750-9ff3-4afc-8bc6-579189352751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6878f30fa4ed444e97d57eb9c1b103bc'} {{(pid=80542) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:24:16.247610 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1464/2917] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jun 22 17:24:15 2022] DELETE /identity/v3/users/6878f30fa4ed444e97d57eb9c1b103bc => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:24:16.508213 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069c053-392f-490c-aa03-afde530f0305 admin admin] Authenticating user token {{(pid=80543) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:24:16.510493 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.fernet_utils [None req-0069c053-392f-490c-aa03-afde530f0305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80543) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:24:16.518094 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:24:16.524837 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069c053-392f-490c-aa03-afde530f0305 admin admin] Validating token access rules against request {{(pid=80543) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:24:16.580406 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24c5dc-fb61-4dd6-bbb3-b07eb6936d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba6ed129dc941f49c2206f6d2b62dfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '591e7cfe38c74f35852c3e0ac79addb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80543) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:24:16.581186 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24c5dc-fb61-4dd6-bbb3-b07eb6936d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:24:16.581513 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24c5dc-fb61-4dd6-bbb3-b07eb6936d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:24:16.581740 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24c5dc-fb61-4dd6-bbb3-b07eb6936d26 admin admin] PATH_INFO: `/v3/projects/b4140f2bb8b14d18af757819a63ba47c` {{(pid=80543) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:24:16.583400 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24c5dc-fb61-4dd6-bbb3-b07eb6936d26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4140f2bb8b14d18af757819a63ba47c)` {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:24:16.585390 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24c5dc-fb61-4dd6-bbb3-b07eb6936d26 admin admin] RBAC: Authorization granted {{(pid=80543) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:24:16.726154 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4e24c5dc-fb61-4dd6-bbb3-b07eb6936d26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4140f2bb8b14d18af757819a63ba47c', 'request_id': 'req-4e24c5dc-fb61-4dd6-bbb3-b07eb6936d26'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:24:16.807546 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4e24c5dc-fb61-4dd6-bbb3-b07eb6936d26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4140f2bb8b14d18af757819a63ba47c', 'request_id': 'req-4e24c5dc-fb61-4dd6-bbb3-b07eb6936d26'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:24:16.813367 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4e24c5dc-fb61-4dd6-bbb3-b07eb6936d26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4140f2bb8b14d18af757819a63ba47c', 'request_id': 'req-4e24c5dc-fb61-4dd6-bbb3-b07eb6936d26'} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:24:16.825222 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4e24c5dc-fb61-4dd6-bbb3-b07eb6936d26 admin admin] The token cache is being invalidate because project b4140f2bb8b14d18af757819a63ba47c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80543) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 22 17:24:16.825508 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4e24c5dc-fb61-4dd6-bbb3-b07eb6936d26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:24:16.826134 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG keystone.notifications [None req-4e24c5dc-fb61-4dd6-bbb3-b07eb6936d26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80543) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 22 17:24:16.827667 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: [pid: 80543|app: 0|req: 1454/2918] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jun 22 17:24:16 2022] DELETE /identity/v3/projects/b4140f2bb8b14d18af757819a63ba47c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 22 17:24:26.379646 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=17,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:24:26.821972 dv-cinder-810457-10-iscsi devstack@keystone.service[80543]: DEBUG dbcounter [-] [80543] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80543) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 17:27:22.565666 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a52750-9ff3-4afc-8bc6-579189352751 admin admin] Authenticating user token {{(pid=80542) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 22 17:27:22.567102 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-28a52750-9ff3-4afc-8bc6-579189352751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:27:22.633995 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a52750-9ff3-4afc-8bc6-579189352751 admin admin] Validating token access rules against request {{(pid=80542) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 22 17:27:22.691116 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f92886-4754-439c-8240-7e3483520993 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a79a71fa89446c3abbb4fdbf2c93aac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59d78923fdef459abaf240bd0975494a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80542) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 22 17:27:22.691761 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f92886-4754-439c-8240-7e3483520993 service placement] REQUEST_METHOD: `GET` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 22 17:27:22.692047 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f92886-4754-439c-8240-7e3483520993 service placement] SCRIPT_NAME: `/identity` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 22 17:27:22.692354 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f92886-4754-439c-8240-7e3483520993 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80542) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 22 17:27:22.694137 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.fernet_utils [None req-34f92886-4754-439c-8240-7e3483520993 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80542) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 22 17:27:22.705208 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f92886-4754-439c-8240-7e3483520993 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 22 17:27:22.706787 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f92886-4754-439c-8240-7e3483520993 service placement] RBAC: Authorization granted {{(pid=80542) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 22 17:27:22.716585 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: [pid: 80542|app: 0|req: 1465/2919] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jun 22 17:27:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 22 17:27:32.712361 dv-cinder-810457-10-iscsi devstack@keystone.service[80542]: DEBUG dbcounter [-] [80542] Writing DB stats keystone:SELECT=58 {{(pid=80542) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}